Developed data pipeline/warehouse environment with distributed data processing architecture (Spark, Hadoop, Hive, Pig, Kafka, AWS Redshift)

Worked on Rails application and building out microservice architecture.

In charge of building all front-end UI and application logic using AngularJS. All rendering, routing, application state, sessions, etc. is handled on the front end, and connects via REST to a concurrent / asynchronous micro-service architecture on the server-side, using Scala and Finagle.

Responsible for data warehousing, reporting and analytics

Build and design batch and real-time ETL systems using concurrent/parallel programming techniques for handling large volumes of data from various sources

Develop interactive web applications for internal data analysis and visualization

Tools: Python (numpy, scipy, pandas, scikit-learn, flask) , Scala (Spark, Akka, Scalatra), Clojure (core.async, core.reducers, compojure, ring), Javascript (node, angular, d3, nvd3), MySQL, MongoDB, Hadoop/Spark / HDFS (shark/hive, mahout), Memchached, Nginx (OpenResty / ngx_lua)