Akamas will be one of the presenters during Google Cloud Data Makers online event on June 9 at 17:30 CEST. The event will take place in the Google offices.
Andrea Gallo, VP Operations US, will explain how to “Make your Spark application faster and cost-effective with AI techniques”.
While Dataproc provides a fully-managed and highly-scalable service to execute Spark applications, the user remains responsible for sizing the Dataproc infrastructure and defining the Spark application execution parameters. These activities have a relevant impact on both the execution time of the Spark applications and the cost of the Dataproc service.
In fact, performance tuning for big data frameworks can be challenging. The sheer number of parameters on different layers (i.e., Spark framework, JVM, YARN, etc.) and their interdependencies make predicting and optimizing performance immensely complex.
Akamas’ comprehensive AI-powered optimization platform can automatically identify the optimal configurations for the hundreds of parameters of today’s IT stacks and modern applications. In fact, Akamas supports performance engineering, SRE, service owner, and FinOps teams by enabling an effective decision process on how to deliver maximum service performance & resilience at minimum cost
Join us to discover how to leverage Akamas to automatically tune Dataproc and Spark applications!
Andrea has been involved in a number of high-profile projects working directly with some of the largest companies in the US in a wide range of fields including financial services, healthcare, insurance, and logistics. Andrea received his Master’s Degree in Computer Engineering from Politecnico di Milano.