In many cases, the number of model predictions is within a predictable range. Identifying deviations from the range can indicate on underlying problems, anomalous events, or an ongoing trend that is worth noting.
Causes of change in the number of predictions include:
Natural increase in model invocations
Serving environment fault
Malicious attempt to analyze model behavior
For this monitor, the following comparison methods are available:
Configuration may slightly vary depending on the comparison method you choose.
You may select as many prediction fields as you want 😊
Note that the monitor will run on each selected field separately.
For the fields you chose in the previous step, the monitor will raise an alert if the amount of predictions in the inspection period exceeds your threshold boundaries compared to the baseline's amount of predictions.
This step is important to make sure you have the right amount of alerts that fits your needs. For anomaly detection method, use the monitor preview to help you decide what is the appropriate sensitivity level.
Last updated
