Riza Suminto
Impala PMC Member, Cloudera
Actions
Riza Suminto is a Software Engineer at Cloudera. He completed a Ph.D in Computer Science at the University of Chicago under Prof. Haryadi Gunawi in UCARE group. He got his bachelor degree in Computer Science from Universitas Gadjah Mada, Yogyakarta, Indonesia, in 2011. He is interested in Distributed Systems, Cloud Computing, Performance, and Reliability.
Links
Intelligent Utilization Aware Scheduling for Impala Virtual Compute Clusters
Sizing Virtual compute clusters for diverse and complex workloads is hard. Queries often require large clusters to meet SLA requirements which can lead to low utilization and excessive cloud spend.
To solve this problem, we present intelligent autoscaling for Impala virtual warehouses. This powerful feature dynamically analyzes query execution plans and resource requirements and adjusts cluster size to follow the workload. Once cluster size limits have been set, the autoscaler works in the background to maintain the ideal cluster size and is transparent to users. Observability UIs have also been enhanced to help understand autoscaler behavior and further tune workloads.
We achieved 2 key goals with the design - delivering better ROI for compute cost and ease of use for admins/users to manage Virtual Clusters.
Community Over Code NA 2024 Sessionize Event
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top