Amsterdam Area, Netherlands
• Architected and implemented a real-time monitoring solution using Flink to track Mean Scores and Feature Statuses for 400+ models.
• Enhanced the Argo workflow platform by enabling custom sensor arguments and integrating Spark scripts.
• Built a prediction drift monitoring system across 100+ models using Population Stability Index.
• Developed a robust system to monitor and track rolling performance metrics across varying levels of granularity for streamed data in near real-time.
• Engineered an advanced algorithm to monitor AUC in near real-time for streamed production data, leveraging reservoir sampling and probabilistic interpretation of AUC.