Airflow, Snowflake, Python, SQL, JavaScript, dbt, AWS (CDK, Lambda, MWAA), DynamoDb, Postgres
• Broadened our analytics team's scope from a single marketing ML model to serving Finance, Marketing, Customer Success, Sales, and Operations. Built out our Snowflake data warehouse from scratch which helped our team expand from 4 to 30 people
• Responsible for creating and maintaining Airflow (MWAA) and dbt codebases, and did the initial setup of each
• Employee of the Month, Core Value Award for October 2021
• Increased data ingestion speed by over 200% by transitioning ClickUp's Airflow server from self-managed EC2 to MWAA using AWS CDK (Python) and multiprocessing
• Created office visualization (React, Flask API, Airflow, AWS EB) - a rotating globe of customers - for display on office TVs
• Produced video tutorials covering dbt cloud to onboarding analysts/data scientists
• Created multiple "scalable webhooks" using AWS CDK (TypeScript, Python): API Gateway -- Lambda -- SQS Queue -- Lambda -- Snowflake
• Built a custom integration: Implemented automated refreshes in Tableau extracts based on a successful dbt job run by creating a custom Airflow sensor task and hitting the dbt/Tableau APIs
• Created a way to dynamically account for schema changes on ingestion each day, output any schema changes to a central table, then take scheduled snapshots of these schema changes over time
• Responsible for most of the API ingestions for the company’s data lake
• Happy to help teammates with common issues such as understanding dbt, fixing git issues, creating slack alerts, creating new Snowflake users/roles/permissions, merging PRs, mapping data relationships, reviewing SQL logic, etc.
