Apr 2025 - Now:

AI Inference Platform - Efficiency and Reliability

Jun 2021 - Apr 2025:

Taiji: Edge-to-Origin load balancing.

CSLB: Origin-to-Origin load balancing.

Maintained TLS termination data-plane for most AWS services including S3, ELB, etc.

• Ported a reverse proxy from x86 to Arm, for on-host TLS termination and solved issues related to assembly, compilation and dependencies.

• Analyzed latency and throughput of TLS handshake and bulk data encryption on Arm. Profiled on both x86 and Arm to address the performance bottlenecks using perf-event and FlameGraph.

Tech Lead of infra for ML(Machine Learning) computing tasks and micro-services.

• Developed a container orchestration service with specific on-board environment with CPU/GPU control, dynamic network routing and clock synchronization.

• Developed L3 software-defined networking for container IP access with Calico/BGP/iptables, featuring IP affinity and floating IP.

• Performed end-to-end on-call duty on services and on-prem machines. Automated operation using Bash scripts and Ansible for a state-declaration approach. Solved the single point of failure on the HAProxy API gateway by DNS-level load balancing with Consul.