Working mainly around data engineering, managing big data infrastructure and building products around data.
Data Engineering -
1. Working in a team responsible to implement, manage and upgrade data pipeline systems to process and extract meaningful data from TBs of JioSaavn daily logs.
2. Handled migration of our entire data pipeline and Petabytes of data from AWS (EMR and S3) to Azure (Hdinsights and blobs)
3. Build framework for generating custom pipeline dags, using airflow.
4. Worked on optimization of big data clusters for better efficiency (through autoscaling of nodes and tuning parameters) bringing data processing cost by around 30% in a month.
Data Products -
Working and managing backend systems for various client facing data products.
1. Yourcast - Platform where podcasters can upload their shows through RSS feed (so that podcast is visible on jiosaavn app),manage it and track its performance.
2. Artist Insights - Platform where artists and their managers can get insights into their music-growth, fan base, create/share their playlists and manage their profile.
3. LabelOne - Platform used by labels and partners to track their song, album visibility on app and its performance (streams, users etc)
