Google Cloud, Vertex AI Platform
• Architected distributed model training and inference system.
• Built model serving backend with task scheduling, handling and monitoring system.
• Engineered large-scale automated model onboarding pipeline with deploy and inference workers.
• Developed finetuning and serving docker for PyTorch, Tensorflow and vLLM models.
• Executed data labeling, benchmarking and evaluation for key custom models.
• Led critical security initiatives to ensure user data security across products.
Tech stacks
• Languages: Python, Java, C++, TypeScript, SQL
• AI/ML: PyTorch, Tensorflow, vLLM, MLops, LLM serving, Feature Engineering
• Infrastructure: Backend APIs, Cloud Computing (GCP), Kubernetes, Docker Management
• Tools: Git, Jupyter
