• Implemented the Field Accounting on Sawmill importer which is a petabyte scale pipeline that produces metrics on what data is stored within Sawmill that enabled our customers to have much more accurate data insights, with lower latency. The new pipeline produced unsampled Field Stats (~100x more data covered as we go from a 1% sample to 100%) at no additional resource cost and with lower latency. Time to stats was reduced from 24-72+ hours to P50 latency of 5 minutes, P99 of 2 hours. The project won Silver in 2024 Q3 Perfys.

• Worked on extracting metrics for PTokens across Sawmill logs used to power the Sawmill DMA central data insight dashboard that helped deliver DMA5(2) compliance on all user activity Logs data across all PAs, amounting to XX exabytes. The project won Silver in 2023 Q3 Healthys and the Core Tech Impact Award for H1’24.

• Worked on several projects that helped improve privacy infra for Sawmill logs including migrating from parsing colossus logs to using Ganpati and IoLAR to detect last usage and revoke it for direct log reader clients leading to unused access revocation for 1000+ clients across Google, migration to Grackle expanded permission column, etc.

Worked on data aggregation backend APIs (specifics covered under NDA). The APIs were built using Kotlin and deployed on Serverless AWS Fargate infrastructure.

• Implemented and successfully deployed into production a base user cron job, enqueuing a message into the message queue to trigger an asynchronous scan. Delivered a new message handler for this use case that ensures the scans triggered via scheduled runs run during off peak hours and with lower priority to prevent resource starvation for other message types.

• Set up Staggered Release process for the team. This included setting up of complete pipelines, related addons (Postgres db, Sumo Logic, Kafka), connected apps and environment variables. Code changes to allow dynamic switching of about 13 end points that were used to access the microservices. Moved these urls to a central config file to allow for easier maintainability down the line.

• Optimizer Lightning App: Delivered Optimizer Feature Mapping that mapped each of the 52 metrics from the PDF to the data model added to support the migration to a web app. Also delivered the story to insert these. Led the Performance testing effort for the Optimizer Lightning app.

• Implemented and successfully deployed into production a web tool extension for Transaction Debugging to allow people to query Splunk for the One Intuit Identity logs. The tool was built using Spring and React.

• Designed and implemented a Slack bot using the AWS: Lex, Lambda, Dynamo and Sage maker which would help solve for the service consumer pain point faced by my team and save up to US$ 307,008 in engineering support costs per year.