Boston, Massachusetts, United States
In addition to continued responsibilities from previous role:
• Design, build, test and deploy a new, unified ETL pipeline to replace existing data ingest pipelines and API integrations; focus on modularity and easy extensibility.
• Optimize pipeline performance by leveraging external tools (such as AWS) and implementing async processing (reduced API call execution time by over 600%).
• Build an in-house API and a JavaScript/React-based UI to let internal teams interact with the new pipeline + operational database (e.g. upload configurations, retrieve job statuses, kick off a job from the UI)