Input Parameter | Type | Required | Description |
---|---|---|---|
project_id | string | Yes | The unique identifier for the project |
model_id | string | Yes | The unique identifier for the model |
baseline_id | string | Yes | The unique identifier for the baseline |
type | fdl.BaselineType | Yes | one of : PRE_PRODUCTION STATIC_PRODUCTION ROLLING_PRODUCTION |
dataset_id | string | No | Training or validation dataset uploaded to Fiddler for a PRE_PRODUCTION baseline |
start_time | int | No | seconds since epoch to be used as the start time for STATIC_PRODUCTION baseline |
end_time | int | No | seconds since epoch to be used as the end time for STATIC_PRODUCTION baseline |
offset | fdl.WindowSize | No | offset in seconds relative to the current time to be used for ROLLING_PRODUCTION baseline |
window_size | fdl.WindowSize | No | width of the window in seconds to be used for ROLLING_PRODUCTION baseline |
Add a pre-production baseline
PROJECT_NAME = 'example_project'
BASELINE_NAME = 'example_pre'
DATASET_NAME = 'example_validation'
MODEL_NAME = 'example_model'
client.add_baseline(
project_id=PROJECT_NAME,
model_id=MODEL_NAME,
baseline_id=BASELINE_NAME,
type=BaselineType.PRE_PRODUCTION,
dataset_id=DATASET_NAME,
)
Add a static production baseline
from datetime import datetime
from fiddler import BaselineType, WindowSize
start = datetime(2023, 1, 1, 0, 0) # 12 am, 1st Jan 2023
end = datetime(2023, 1, 2, 0, 0) # 12 am, 2nd Jan 2023
PROJECT_NAME = 'example_project'
BASELINE_NAME = 'example_static'
DATASET_NAME = 'example_dataset'
MODEL_NAME = 'example_model'
START_TIME = start.timestamp()
END_TIME = end.timestamp()
client.add_baseline(
project_id=PROJECT_NAME,
model_id=MODEL_NAME,
baseline_id=BASELINE_NAME,
type=BaselineType.STATIC_PRODUCTION,
start_time=START_TIME,
end_time=END_TIME,
)
Add a rolling time window baseline
from fiddler import BaselineType, WindowSize
PROJECT_NAME = 'example_project'
BASELINE_NAME = 'example_rolling'
DATASET_NAME = 'example_validation'
MODEL_NAME = 'example_model'
client.add_baseline(
project_id=PROJECT_NAME,
model_id=MODEL_NAME,
baseline_id=BASELINE_NAME,
type=BaselineType.ROLLING_PRODUCTION,
offset=WindowSize.ONE_MONTH, # How far back to set our window
window_size=WindowSize.ONE_WEEK, # Size of the sliding window
)
Return Type | Description |
---|---|
fdl.Baseline | Baseline schema object with all the configuration parameters |