• Overseen the entire working operations of Data Modeling, ETL and Data Warehousing operations of Big Data for Data management as well as for Pipeline orchestrations.

• Worked on AWS (Amazon Web Services) for executing Data Warehousing operations to handle Batch & Realtime Data, for wide variety of data needs.

• Built core applications as well as APIs using Python, & JS.

• Developed numerous Reports highlighting the KPIs to seek deeper insights on product, user, quality, and the infrastructure performance.

• Solved complex problems with optimized Data Structures & Algorithms.

• Involved in Data Warehousing activities which includes Hadoop, Microsoft SQL Server, Oracle Databases and other internal applications at Markit.

• Processed real-time events and deployed lockless applications which is achieved through Spark mainly using Python.

• Aggregated data with NoSQL databases too but not limited to Cassandra and Hbase (on ad-hoc basis).

• Managed billions of customer records using Hadoop Cluster and operated via Cloudera.

• Experienced on ETL processes and used Python, C Sharp, and Java Scripting languages wherever necessary.

• Designed Java Applications for supporting core operations of the team.

• Managed and maintained Oracle Db.

• Designed and developed core applications using Python.

• Worked on data porting from existing SQL Server databases to Oracle database.