CS 5/579, Winter 2020

February 17/19 / Week 7

President's Day; Commercial Cloud Computing

Monday: No Class (President’s day!)

Wednesday: Commercial Cloud Computing

• Marco A. S. Netto, Rodrigo N. Calheiros, Eduardo R. Rodrigues, Renato L. F. Cunha, and Rajkumar Buyya. 2018. HPC Cloud for Scientific and Business Applications: Taxonomy, Vision, and Research Challenges. ACM Comput. Surv. 51, 1, Article 8 (January 2018)
• Malla, S, Christensen, K. HPC in the cloud: Performance comparison of function as a service (FaaS) vs infrastructure as a service (IaaS). Internet Technology Letters. 2020; 3:e137.

Other Resources

• Google Cloud’s online documentation is very thorough; here are a few useful and/or interesting examples of things one can do:
  • Deploy an Auto-Scaling HPC Cluster with Slurm
  • Running RStudio® Server on a Cloud Dataproc Cluster
  • Dataflow (a managed Hadoop/Spark-like system) Quickstart using Python
    • The actual code itself here is largely uninteresting; instead, pay attention to the workflow: how one gets data in and out, actually runs a job, and so on.
  • Monte Carlo methods using Dataproc and Apache Spark
    • Same as above