Created features for a highly flexible web crawler including uploading data to AWS DynamoDB, writing and testing Thrift service, implementing and testing Bolts in the Storm topology, and adding Puppet classes in order to automate deployment of the system.