Skip to main content

Monitoring settings

Each model has its own limits. Open the model's page and select Settings.

Figure 1. Monitoring settings for one model.

The next check uses these values. Thresholds apply to the model's features, prediction, primary metric and protected attributes. Until you save, the panel says Using the defaults; not saved yet.

SettingDefaultWhat it does
Current windowLast 7 daysThe trailing window compared with the reference.
Moderate drift (PSI)0.1PSI at or above this marks a feature as moderate drift.
Severe drift (PSI)0.25PSI at or above this marks a feature as severe drift.
Performance tolerance0.05How much the primary metric (F1, macro F1 or RMSE) may worsen before the model is degraded.
Minimum selection-rate ratio0.8Flag an attribute when the lowest group's selection rate divided by the highest falls below this. 0.8 is the four-fifths rule.
Maximum equalized odds difference0.1Flag an attribute when the equalized odds difference is above this. Also the regression tolerance between groups.

Select Save. A settings change also makes the model due for its next scheduled check (see How checks run).

See Drift and Performance and fairness for how each limit is applied.