Metric Change
Monitoring and measuring changes in features / raw inputs metrics allows for early detection of basic problems or changes in the model's input data.
For example - we can monitor and detect a deviation of more than 20% from the average of the feature 'age' from the average the monitor was trained with.
For this monitor, the following comparison methods are available:
Configuration may slightly vary depending on the comparison method you choose.
You may select as many prediction fields as you want (from raw inputs / features) 😊 the monitor will run on each selected field separately.
Our metric change monitor supports the following metrics:
- Missing count
- Average
- Minimum
- Maximum
- Sum
- Variance
- STD
For the fields you chose in the previous step, the monitor will raise an alert if the comparison between the inspection period and the baseline leads to a conclusion outside your threshold boundaries.
This step is important to make sure you have the right amount of alerts that fits your needs. For anomaly detection method, use the monitor preview to help you decide what is the appropriate sensitivity level.
Last modified 4mo ago