• Designed and implemented several ETL pipelines including: batch jobs that involve Scala Spark jobs running on EMRs; event driven data pipelines that involve Kinesis data streams and Lambda processings.
• Built the infrastructure for deploying and scheduling Spark jobs on demand so other developers can focus on writing the transformation logic. More than 5 jobs are currently running on this infrastructure.
• Upgraded our AWS Redis clusters to support one of our most trafficked .NET Core microservice with zero downtime at hundreds of requests/second with sub-hundred millisecond latencies.
• Onboarded and mentored new hires and interns; prepared slides and documented existing architectures to get them up to speed.
• Spun off bits of our legacy C#/.NET monolith into their own Scala microservices with zero application downtime and zero data loss.
• Implemented C#/.NET applications to facilitate information transfer between Zocdoc and numerous PMS's (Epic, Athena, Cerner,...) via REST and SOAP Apis, databases, web requests, and OCR.