Greater New York City Area
2019 - present
• Working on Content Engine Team, lead a scrum team, developing low latency collection and processing system that process text/picture/video in various news format, and developing news distribution services that delivery news content to clients via different methods. Using Python, Java, Clojure, Serverless, Elasticsearch, DynamoDB, S3, ECS.
• Build a Serverless based push system, support S3, FTP, SFTP and WebSocket push, reduce the push latency by 50%, and also reduce the cost by 60%.
• Build a Restful API which powers news content distribution, using Java, Spring Boot, Elasticsearch.
2016 - 2018:
• Working on reutersconnect.com, a Single Page Application, as a team lead and core contributor, build Restful APIs which powers content, using Clojure, Clojure Script, Serverless, DynamoDB. Running in ECS.
• Build real-time notification system using WebSocket, reduce server load and push content to client in real-time.
• Build auto-suggest using Elasticsearch, keep the average query latency at around 100ms.
• Research and bring new technology, AWS Kinesis Firehose and Athena, to implement new trending feature.
• Migrate MySQL to DynamoDB, simplify the workflow, and reduce cost by 70%.