• Multiple Years of combined work experience in Python, Analysis, Design, Web Application Development, Management and Implementation of various stand alone, client - server enterprise applications. Involved in the Complete Software development life cycle (SDLC) to develop the application.
Experience
2023 — Now
• Develop programs to automate the testing of controllers in CI/CD environment using Python, Bash script, Git and Linux command line also used Django & Flask framework for API creation and application development.
• Wrote and executed various MYSQL database queries from python using Python MySQL connector and MySQL dB package. Build numerous Lambda functions using python and automated the process using the event created. With the use of Python OS module on Linux environment, made job cloning and forking.
• Managed and processed large datasets with a focus on efficient Extract, Transform, and Load (ETL) techniques, ensuring data integrity and reliability throughout the entire data lifecycle.
• Showcased proficiency in using IDEs, with Visual Studio Code as a primary development environment, ensuring efficient and collaborative coding practices. Leveraged Visual Studio Code features for code editing, debugging, and version control, contributing to streamlined development workflows.
• Created, planned and executed multi-threading PySpark jobs on multi node spark cluster with UDF and Migrated the Flask database from SQLite to MySQL to PostgreSQL with complete data integrity.
• Designed and developed the UI of the website using HTML5, CSS3, JavaScript, Angular, and jQuery. Wrote python scripts integrating Boto3 to supplement automation provided by Ansible and Terraform for tasks such as encrypting EBS volumes backing AMI's and scheduling lambda functions for routine AWS tasks.
• Led the development of a cloud-based data analytics platform using Python and AWS services, Developed and maintained a real-time data pipeline using AWS Kinesis and AWS Lambda, allowing the company to process and analyze data in near real-time.
• Worked on Container Orchestration tools like Docker & Kubernetes, in-order to build docker image from docker files and run the containers in the docker engine, whereas these clusters are securely managed by Kubernetes.
2020 — 2023
• Worked on integrating python with Web development tools and Web Services. Worked on Django and Flask, a high-level Python Web framework. Created a Handler function in Python using AWS Lambda that can invoke when the service is executed. Developed server side using PHP in both WAMP and LAMP server framework.
• Worked in using React JS components, Forms, Events, Keys, Router, Animations and Flux concept. Integrated Restful APIs with front-end Pages by generating JSON data from Mongo DB database.
• Worked with emerging technologies in the cloud computing and machine learning space, and an ability to learn quickly and adapt to new technologies. Implemented a serverless architecture using AWS Lambda and AWS API Gateway, reducing infrastructure costs and improving scalability and reliability.
• Implemented optimization techniques in Pandas, such as vectorization and parallelization, to enhance data processing speed. Utilized appropriate data types and memory management strategies to handle large datasets efficiently.
• Design and develop ETL Processes in AWS Glue to migrate Campaign data from external sources like AWS S3, ORC, Text Files into AWS Redshift. And worked on ETL big dataset to Databricks Delta Lake.
• Created, planned and executed multi-threading PySpark jobs on multi node spark cluster with UDF and Migrated the Flask database from SQLite to MySQL to PostgreSQL with complete data integrity.
• Integrated Pandas seamlessly with data visualization libraries like Matplotlib and Seaborn for creating insightful charts and plots. Produced informative visualizations to communicate complex patterns and trends within the data.
• Design ETL dataflow & database logical model for feature enhancement. Develop ETL dataflow with mapping, session & workflows. Followed agile methodology and involved in daily SCRUM meetings, sprint planning, showcases and retrospective.
2018 — 2020
Used SDLC process and used PHP to develop website functionality. Designed and developed the UI of the website using HTML, NodeJS, XHTML, AJAX, CSS and JavaScript.
Developed entire frontend and backend modules using Python on Django Web Framework on MySQL. Used Django APIs for database access.
Designed and developed data management system using MySQL. Built application logic using Python 2.7. Designed Cassandra schema for the APIs
Developed embedded firmware in C to create custom images on Oscilloscope, DSP: Digital Communication, Adaptive. Targeted to pique interest on DSP and embedded systems for beginners.
Worked on development of SQL and stored procedures, trigger and function on MYSQL.
Developed a module using Spring-REST consumed by the IVR Service to obtain the claim registration details from LDAP. Implementation of front end JSP/JSF and backing beans
Used Python to create the login page for project ‘Digital Cockpit’ as client requirement and Used Python to execute automation process for project ‘XML’ as requirement.
Used Python to control the backend logic of the web application and Automate Python script in AWS Cloud to filter, serialized and informative data store into AWS Arora
Scraping website using Python Beautiful Soup, and then parsed it with xml and Developed basic UI screens using HTML, CSS, and JavaScript
Developed the notification service by posting the JSON request in AWS API Gateway, AWS Glue Validating the response in Lambda by getting the data from DynamoDB and sending the notification through AWS SNS