Cloud Computing

Cloud computing has become an essential tool in our day-to-day operations by allowing us to efficiently execute analytics on large datasets at affordable costs. This is a common theme for every major high-tech industry today, including bioinformatics, quantitative finance, telecommunications, defense, climate science, pharmaceuticals, marketing, and the entertainment industry. We possess extensive experience in working with big data technologies such as Hadoop and the AWS cloud, as well as machine learning algorithms for large-scale out-of-core learning. Below are some screenshots of cloud-based scientific computing solutions that we have designed for various applications, including large-scale hyperparameter grid searches and cross-validations for machine learning applications, and Monte-Carlo simulations for benchmarking modern error-correcting codes at high SNRs.

custom-designed cloud computing workflow

Using spot instance pricing and EBS-checkpoints

Cloudwatch CPU metrics for a Hadoop cluster