AWS EMR - Big data platform on EC2 and EKS

Data Infrastructure development

Designed and implemented the monitoring and alerting system for game usage data in Amazon AWS

− Built web UI (AngularJS) and backend database (DynamoDB) for alert configuration management under MVC frameworks;

− Implemented python workflows that will 1) fetch alert configurations from DynamoDB, 2) query and analyze data from the data warehouse (Redshift), 3)send alert messages to PagerDuty and Slack;

− Scheduled python monitoring workflows periodically according to alert configurations;