Designed and developed Spark, Hive, Pig, and Python ETL pipelines. Built API-driven ingestion frameworks for downstream consumption. Migrated multiple datasets from Oracle to Hadoop / AWS platforms. Automated Airflow workflows and validation frameworks. Managed and optimized CI/CD pipelines using Jenkins, enabling continuous integration and streamlined production deployments. Improved pipeline performance and reduced runtime through Spark optimization, partition tuning, and resource right-sizing, consistently meeting strict business SLAs.