Anup Ghatage
Salesforce.com, Lead Member of Technical Staff
San Francisco, California, United States
Actions
Anup works on Salesforce's Infrastructure platform.
Previously, he has worked on database internals, query processing and storage at SAP, Cisco Systems and other companies for more than 8 years. Anup holds a BS from the University of Pune and an MS from Carnegie Mellon University. Ask him to perform some close-up magic / read your mind for you.
Links
Topics
Petabyte-Scale Deployments: Balancing Immutability and Flexibility
At Salesforce, our team does Kubernetes deployments at the petabyte scale, with 100+ clusters, 10000+ pods, and 25+ PiB of provisioned storage and innumerable Kubernetes jobs. Operating at this massive scale necessitates an approach that reduces engineering toil. Maintaining such mammoth clusters while keeping security in mind is a whole different challenge.
We specifically talk about how and why we picked immutability and Infra-as-code as the cornerstone of our design and the challenges around it. Immutability provides security and scalability and eliminates config drift. Infra-as-code guarantees that changes to our infrastructure follow the same software lifecycle. but the trade-off is a lack of flexibility to adapt to changing requirements.
In this talk, we go over the unique design choices that help us manage, grow, and configure petabyte-scale deployments at Salesforce.
Boundless Scale: Blueprint for Petabyte Dominance using Apache Bookkeeper
The demand for scalable data storage is relentless as businesses grapple with exponentially growing data volumes.
Salesforce's innovation with Apache Bookkeeper has emerged as a game-changer, pushing scalability boundaries.
The traditional way Bookkeeper used its metadata store - Apache ZooKeeper, struggled to keep pace as storage scaled beyond the Petabyte mark.
Salesforce's innovation on the architecture allows the storage service to scale beyond the petabyte realm effortlessly, dramatically reducing the load on ZooKeeper and unlocking unprecedented scalability with 500+ node bookie clusters in the public cloud.
Join us as we share the challenges we overcame, design choices, trade-offs and learning. We're showcasing how Salesforce's blueprint for petabyte supremacy is redefining scalability limits while working with the Apache Community.
CloudX 2024Sessionize Event
Data Streaming Summit 2024Sessionize Event
Community Over Code NA 2024Sessionize Event
Anup Ghatage
Salesforce.com, Lead Member of Technical Staff
San Francisco, California, United States
Links
Actions
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top