Onboard Your GenAI Application

This guide walks you through setting up your first project and application, connecting it to your code, and starting real-time monitoring of your GenAI interactions.

Before You Begin

Before onboarding your GenAI application, ensure you have:

  • Fiddler Account - Active access to your Fiddler instance

  • GenAI Application - An LLM-powered application or agent ready to instrument

  • Admin or Project Admin Role - Permissions to create projects and applications

Key Concepts

Projects

A project represents a workspace that groups related AI applications together. Projects are typically organized by product, team, or use case.

Each project can have:

  • Multiple applications under it

  • Shared team members and permissions

  • Consolidated monitoring and analytics across all applications in that project

You can use an existing project if your team already has one, or create a new project for a fresh setup.

Applications

An application is the specific GenAI system or integration you want to monitor. It represents one instance of your deployed LLM or agentic workflow—such as a chatbot, summarization API, or evaluation pipeline.

Each application has its own:

  • Application ID - Unique identifier for SDK integration

  • Monitoring configuration - Metrics, evaluators, and alerts

  • Data streams - Span events, traces, and performance metrics

GenAI Applications list page
GenAI Applications List Page - View all applications you have created or been granted access to

Onboard Your Application

1

Choose Your Project

  1. Navigate to GenAI Applications in the left sidebar

  2. Click Add Application in the top-right corner

  3. Select how to organize your new application:

    Option 1: Use Existing Project

    • Select Use Existing Project

    • Choose a project from the dropdown menu

    • Review current team members, add or remove members, or change roles

    Option 2: Create New Project

    • Select Create New Project

    • (Optional) Add initial team members using the same process as above

  4. Click Next to continue

GenAI Application list showing choose new or use existing project for create application
Choose an existing application

Tip: Choose project names that reflect your team structure or product areas (for example, CustomerSupportChatbot or DataScienceTeamApps).

2

Create Your Application

  1. In the Create Your Application step:

    • Review the selected project name displayed at the top

    • Enter an Application Name in the text field

    • The name should uniquely identify the GenAI system you're monitoring

  2. Click Create Application to continue

GenAI Application list showing new application name entry
Enter your application name

Note: Application names must be unique within the project. Choose names that clearly identify the specific use case (for example, ContentSummarizer or CodeAssistant).

3

Integrate Your Application

Once your application is created, you'll see the Setup Complete! confirmation screen with your integration details.

GenAI Application list showing completed application creation modal
New application setup completed

1. Copy Your Credentials

You'll need two pieces of information to connect your application:

  • Application ID - Uniquely identifies your application (UUID format)

  • API Key - Authenticates requests from your code

To copy your credentials:

  1. Locate the Grab Your Application ID and API Key section

  2. Copy the Application ID:

    • Click the copy icon next to the Application ID field

    • Store it securely—you'll need it for SDK configuration

  3. Copy your API Key:

    • Navigate to Settings → Credentials in Fiddler

    • Copy your personal access token or create a new one

    • See Personal Access Tokens for details

Security Best Practice

Treat your API key like a password. Never commit it to version control or share it publicly. Use environment variables or secure credential management systems.

2. Integrate Using the SDK

Click View SDK Documentation to access integration guides for your technology stack:

  • Fiddler LangGraph SDK - For LangGraph and LangChain applications

  • Fiddler Evals SDK - For custom evaluations and testing workflows

  • OpenTelemetry Integration - For custom instrumentation

Follow the SDK-specific guide to:

  1. Install the Fiddler SDK in your application

  2. Configure authentication with your Application ID and API Key

  3. Instrument your code to send span events and metrics

  4. Verify data is flowing to Fiddler

3. Complete Setup

Once you've copied your credentials and reviewed the integration guide:

  • Click Finish Setup to close the onboarding dialog

Your application is now configured and ready to receive monitoring data

Next Steps

Now that your application is onboarded, you can:

Start Monitoring

  • Publish Data - Run your instrumented application to send span events to Fiddler

  • View Live Data - Navigate to your application to see real-time traces and metrics

  • Analyze Performance - Use dashboards to track latency, throughput, and errors

Configure Monitoring

  • Add Evaluators - Create custom evaluators to assess response quality

  • Set Up Alerts - Configure alerts for anomalies or performance degradation

  • Define Rules - Create business rules for content moderation or compliance

Scale Your Monitoring

  • Add More Applications - Onboard additional GenAI systems under the same project

  • Organize by Team - Create separate projects for different teams or products

  • Manage Access - Use project-level permissions to control who can view and modify applications

Frequently Asked Questions

Can I change the project an application belongs to?

No, once an application is created within a project, it cannot be moved to another project. If you need to reorganize, you'll need to create a new application in the correct project.

How many applications can I have in a project?

There is no hard limit on the number of applications per project. However, for better organization, we recommend grouping related applications that share common team members or business context.

What happens if I delete a project?

Deleting a project will remove all applications, monitoring data, and configurations within that project. This action cannot be undone. Ensure you export any data you need before deletion.

Can I use the same Application ID for multiple environments?

No, each application instance (development, staging, production) should have its own Application ID. This allows you to monitor each environment separately and apply different configurations or alerts.

Where do I find my API key?

Your API key (personal access token) is available in Settings → Credentials. See Creating Personal Access Tokens for step-by-step instructions.

Related Documentation

❓ Questions? Talk to a product expert or request a demo.

💡 Need help? Contact us at [email protected].