Greater London, England, United Kingdom
Senior engineer responsible for code re-engineering, performance profiling and optimisation for an Apache Spark-based VAR calculation engine in early stages of development.
Delivered significant code simplification through appropriate abstraction layers, utilising open-source frameworks and reducing code duplication.
Realised significant performance gains by introducing a systematic approach to performance analysis, including performance metric capture, performance profiling, analysis of optimisation potential, and implementation of performanceimprovements. Reduced the batch execution from multiple days to several hours.
Lead development on initial cloud migration of the platform utilising Gitlab, Terraform and Dataproc on Google Cloud.
Now leading the full migration of the platform and reviewing opportunities to migrate to cloud-native technologies including BigQuery, BigTable, MemoryStore, Cloud Functions and Cloud Endpoints.
Key Technologies: Scala, Java, Apache Spark, Hive, Terraform, Docker, Kubernetes, Google Cloud - GCP