Infra - Observability Pipelines

• Have been leading critical initiatives on Coinbase's log infrastructure end-to-end, collaborating closely with the Data Platform and Security teams. Revamped the 140PB archival log pipeline into a Databricks lakehouse, saving $1M+ annually and turning 48-hour restorations into near-instant SQL queries. Re-architected a dynamic log sampler that enforces a global throughput cap on Datadog ingestion, saving $1.2M+ annually by cutting daily log forwarding costs by 40% while preserving visibility for low-volume services. Also migrated the legacy EC2 log pipeline from Kinesis to a modern Vector-based stack.

(Datadog, Spark, Databricks, Vector.dev, Go, AWS)

Bloomberg DataHub Stream Functions

• Had an incredible journey with the DataHub Stream Functions team. Helped scale the platform to support hundreds of teams and process 1B+ messages daily, improving reliability and developer experience.

(Kafka, K8s, Java, Python, React)

Port Foundation Service

• Low latency distributed data processing system.

(C++, Kafka, Python)

Data Technologies

Holdings and Portfolios Team

Huawei Cloud - Huawei HiLens

● Designed and developed Human Detection AI Web Service to provide RESTful APIs for Alcidae camera which had over 14 million requests a day with Flask, TensorFlow and OpenCV.

● Deployed 5 AI Web Services with Gunicorn, Docker on Huawei ModelArts in production environment.

● Performed stress tests and long stability tests with JMeter in the development environment, guaranteeing the performance and stability of services.

● Collaborated with colleagues to develop Huawei HiLens Console with Java Spring in agile methodology to place skill development, device deployment and management, data management, and skill market all on one portal.

● Encapsulated Huawei DVPP to implement Skill Framework Media Processor in C++ to provide user-friendly APIs for cropping, resizing and converting images between RGB and YUV.

● Designed, developed and tested a WeChat mini program to communicate with a Flask service running on HiLens Kit to enable customers to register devices on their phone in batches.