Vertex Gen AI API Serving Infra, cost attribution and traffic/resource management.

2024 - present:

Vertex Gen AI Infra analytics, LLM API reliability, large scale LLM inference/serving efficiency & optimization, disaggregated serving, TPU/GPU efficiency metrics and resource management.

2023: GCE (Google Compute Engine, IaaS) Compute Infra analytics, Shape-Based Planning, provided unit cost attribution analysis to a News Vendor based model to automate recommendations of capacity shaping (machine mixes) to reduce resource (CPU, RAM, L-SSD) stranding and improve efficiency.

Client-facing data science consultant. Project areas: Asset Management, Financial Services, Retail and Healthcare.