Drift Monitoring

Catch drift before your users do

Continuous statistical monitoring on every inference request. Multiple drift metrics evaluated against a stable training baseline. Alerts before the SLA breaks — not after.

Abstract glowing accuracy timeline visualization with drift detection markers and threshold indicators on dark background
Detection methods

Three types of drift. One monitor.

Different failure modes require different statistical tests. Inferpathio runs all of them in parallel and surfaces the right signal.

PSI — Population Stability Index

Feature distribution drift

Compare how input feature distributions shift between training baseline and production windows. PSI < 0.1 is stable; > 0.2 triggers an alert.

KS — Kolmogorov-Smirnov

Data shift detection

Non-parametric test for whether two samples come from the same distribution. Catches subtle continuous-feature drift before PSI does.

WD — Wasserstein Distance

Prediction output drift

Earth mover's distance between prediction score distributions. Catches model behavior changes even when input features look stable.

Alert routing

Alerts that go where your team works

Configure thresholds per model, per feature group. Route alerts to Slack, PagerDuty, webhook, or directly trigger a retraining pipeline. No manual check-in required.

Slack channel alerts
PagerDuty incidents
Webhook POST to any endpoint
Auto-trigger retraining pipeline