Configuration may slightly vary depending on the baseline you choose.
STEP 1: choose the predictions you would like to monitor
You may select as many prediction fields as you want 😊
Note that the monitor will run on each selected field separately.
STEP 2: choose inspection period and baseline
For the predictions you chose in the previous step, the monitor will compare the inspection period distribution with the baseline distribution. An alert will raise if the monitor finds a drift between these two distributions.
STEP 3: calibrate thresholds
Use the monitor preview to help you choose the right threshold and make sure you have the amount of alerts that fits your needs.
The threshold for categorical predictions is different than the one for numeric predictions. Make sure to calibrate them both if relevant.
How are drifts calculated?
For numeric predictions, Aporia detects drifts based on the Jensen–Shannon divergence metric. For categorical predictions, drifts are detected using Hellinger distance.
If you need to use other metrics, please contact us.