Create a Project and Onboard a Model for Observation
What is a Project?
A project within Fiddler helps organize models under observation. Additionally, a project acts as the authorization unit to govern access to your models. To onboard a model to Fiddler, you must first have a project that you wish to associate it with. After connecting Fiddler's Python client to your environment, you can either create a new project or use an existing project to onboard a model.
Create a Project
You can create a Project by using the client's create_project function
You should now see the newly created project on the UI.
List All Projects
Using an existing project, you may list all the projects that you are authorized to view.
Onboarding a Model
To onboard a model you need to define a ModelSpec and optionally a Model Task. If you do not specify a model task during Model creation then you can update it after the model creation.
Define the ModelSpec
A ModelSpec object defines what each column of your inference data is. The model spec translates to model's schema in Fiddler
Fiddler supports five columns types:
Inputs (features),
Outputs (predictions),
Targets (ground truth labels),
Metadata (additional information passed along with the inference)
Custom features (additional information that Fiddler should generate like embeddings or enrichments)
Define the Model task
Fiddler supports a variety of model tasks. Create a ModelTask object and an additional ModelTaskParams object to specify the ordering of labels. For a detailed breakdown of all supported model tasks, click here.
Edit the Model Schema (Optional)
Onboard the Model
Onboard the model schema to Fiddler by passing in the data sample dataframe, the ModelSpec object, the ModelTask and ModelTaskParams objects, and the event/inference ID column and the event/inference timestamp columns:
Last updated