 Developed server-based web traffic using RESTful API’s statistical analysis tool using Python/ Flask, Pandas. Analyzed the SQL scripts and designed the solution to implement using PySpark.

 Developed and implemented secure AWS Lambda and Kinesis serverless functions in Python and managed all Serverless functions with the serverless Framework allowing for ease of management and cloud provider flexibility.

 Prepared Unit test case and used Jenkins for continuous integration testing, involved in ETL system that ran on AWS lambda, was triggered by Kinesis streams, and sent SNS notifications throughout the process.

 Responsible for creating an instance on Amazon EC2 (AWS) and migrated existing monolithic application into microservices architecture based RESTful Service and deployments were done on AWS.

 Developed microservices by creating REST APIs and used them to access data from different suppliers, to gather network data from servers. Utilized Kubernetes for runtime environment of a CI/CD system to build, test and deploy.

 Created a Python/Flask based web application using Python scripting for data processing, MySQL for the database, and HTML/CSS/jQuery and High Charts for data visualization of the pages served.

 Implemented best practices to secure and manage the data in AWS S3 buckets and used the Spark custom framework to load the data from AWS S3 to Redshift and Created Pipelines in Python using Datasets/Pipeline to Extract, Transform and load the data.

 Developed views and templates with Python and Django's view controller and templating language to create user-friendly website interface and was involved in all phases of SDLC from requirement gathering, design, development, testing, Production, user training and support for production environment.

 Worked with NoSQL databases MongoDB and DynamoDB and worked with it to perform many different operations and optimized the search engine by replacing existing database with MongoDB (NoSQL Database).

 Worked on ETL testing and used SSIS tester automated tool for unit and integration testing and improved the performance while processing data by modifying functions, queries, cursors, triggers and stored procedures for MySQL database and designed Cassandra schema for the APIs.

 Built the Silent Circle Management System (SCMC) in Django, Python, and React.JS while integrating with infrastructure services, also maintained, and supported restful webservice using NoSQL, Couchbase and ElasticSearch.

 Responsible for maintaining and expanding our AWS infrastructure using AWS EC2/EBS and hosted micro services on AWS, used Elastic bean stalk to setup application and configured environments.

 Curated on-demand tables on S3 files using Lambda Functions and AWS Glue using Python and PySpark and worked on designing, building, deploying, and maintaining Mongo DB.

 Designed and developed data management system using MySQL and used Django APIs for database access worked in MySQL database on simple queries and writing Stored Procedures for normalization and renormalization.

 Developed full stack Python web framework with an emphasis on simplicity, flexibility, and extensibility and developed custom airflow operators using Python to generate and load CSV files into GS from SQL Server and Oracle databases.

 Wrote and executed several complex SQL queries in AWS glue for ETL operations in Spark data frame using SparkSQL successfully migrated the Django database from SQLite to MySQL to Postgres SQL with complete data integrity.

 Developed microservices on boarding tools leveraging Python and Jenkins allowing for easy creation and maintenance of build jobs and Kubernetes deploy and services.

 Worked in DevOps group running Jenkins in a Docker container with EC2 slaves in Amazon AWS cloud configuration also developed Spark Applications by using Scala, Java and Implemented Apache Spark data processing project to handle data from various RDBMS and Streaming sources.