Rohit Ghumare
CNCF Ambassador
London, United Kingdom
Actions
As a Google Developer Expert specializing in Google Cloud, I am a passionate DevOps Advocate and a dedicated Community Evangelist. I lead and nurture multiple communities across diverse platforms, fostering DevOps and Developer Relations awareness. My commitment to the open-source ecosystem is demonstrated through delivering presentations, crafting documentation and blogs, and contributing code. Presently, my focus is on innovating within the service mesh technology stack.
Links
Area of Expertise
Topics
Chaos & Behind the Scenes of Kubernetes in Production Blunders
In the fast-paced world of AI and cloud-native deployments, chaos can often become an uninvited guest. At Tune AI, we've encountered significant challenges while building and deploying a developer platform for Large Language Models (LLMs). This talk will delve into the incidents we faced and their resolutions while managing our deployed platform on Kubernetes in production, highlighting three critical production-level incidents that led to downtime. These incidents include manually updating Kubernetes deployments, handling resource deletions, and managing kubectl contexts. Additionally, it discusses the loss of the Terraform state of production due to an incorrect backend configuration of Terraform and how we recovered it. Attendees will learn best practices for managing Kubernetes deployments and avoiding common pitfalls, effective strategies for managing resources and contexts, and how to ensure robust Terraform configurations to prevent production downtime. By sharing these experiences, this session aims to provide practical insights and solutions to help attendees navigate similar challenges. Using our journey at Tune AI as a case study, it will illustrate the impact of these best practices and how they can significantly improve deployment stability and efficiency.
Cost-Effective Kubernetes Scaling with vCluster and Open-Source CNCF projects
This talk will explore how developers can save cost on Kubernetes scaling using vCluster and open-source CNCF ecosystem tools without needing to master Kubernetes intricacies. This talk will demonstrate how vCluster enables efficient resource utilization and reduced operational expenses, allowing developers to quickly and easily spin up virtual clusters with no need to handle K8s architecture or multiple VMs. Attendees will learn practical strategies for managing workloads economically, making Kubernetes accessible and affordable. Perfect for DevOps engineers, developers, and cloud native enthusiasts, this session offers insights into optimizing Kubernetes deployments while minimizing costs.
Enhanced Platform Engineering: A Guide to Infrastructure Modernization
In the rapidly evolving landscape of cloud computing, Google Cloud emerges as a pivotal tool for infrastructure modernization and platform engineering. This meetup delves into the strategic integration of Google Cloud services for developing robust internal platforms, focusing on leveraging existing cloud functionalities to streamline both development and operational processes. Key topics include understanding the user-centric approach in platform engineering, forming dedicated, cross-functional teams for platform development, and transitioning from traditional project metrics to product KPIs for measuring platform success. Additionally, the concept of 'Golden Paths' in engineering execution will be explored, emphasizing the importance of clear, self-service templates for common tasks, thereby enhancing developer productivity and project consistency. This session aims to equip participants with practical insights and strategies for avoiding common pitfalls in platform engineering projects, while fully leveraging the capabilities of Google Cloud.
Sustainability with WASM? - faster, greener computing
In an era prioritizing environmental sustainability, this panel explores Wasm's role in greener computing. We discuss WASM's efficient architecture, how Wasm can be used as an efficient virtualization layer, & its corresponding impact on eco-friendly software. We emphasize WASM's optimized performance & resource management over traditional containers, the talk highlights its benefits in sustainable software development.
We discuss one of the production case studies where we illustrate how the blend of software and hardware can power services while repurposing waste heat to provide electricity for consumer applications. Particularly, we also show Wasm's application in AI inferencing, demonstrating its effectiveness in green computing. The audience would gain insights into using Wasm for green computing. The panel will share best practices for reducing cloud computing's carbon footprint & applying these strategies in various tech endeavors, drawing from extensive experience in the field.
Oxymoronic Infrastructure - VM and containers is a false dichotomy
Yes we live in a cloud native world, but we bet you still have Virtual Machines around, quietly humming along and making revenue. What about those? Will you let them languish in the dark corners of your datacenters or will you give them new life in your shiny new container orchestration platform? Come join us in a practical demo of how Kubevirt and GitOps can do to fundamentally change how you think about old and new infrastructure, applications and services, and how to manage everything under the sun with one interface.
Making students industry ready with CNCF ecosystem as a catalyst
Everywhere we go, we hear layoffs, layoffs, and layoffs! Companies are looking to hire, but many students and professionals are struggling to find new jobs. So, where is the gap? The problem lies in a lack of industrial-demanded skills in the industry. We have been actively involved in the CNCF ecosystem for some years now, and it has helped us get connected worldwide and build a strong network. Sharing our knowledge with study groups, cloud-native, and AI community groups, we have also conducted webinars and online meetups to help people develop their skills. Join us in discovering the strategies for integrating CNCF projects into academic curricula, providing students with real-world experience and bridging the gap between academia and industry with us. This talk will explore the significant potential of engaging university students in open-source projects within the CNCF, offering fresh perspectives on collaboration and skill development outside of traditional Internship programs.
ML Engineer goes DevOps via MLOps
This talk and lecture are dedicated to helping those transform their careers by generating more awareness around patterns and concepts that stay the same and what is transferrable, to more modern approaches.
The talk will cover a brief story of my Machine Learning as well as Data scientist story and why I decided to change careers, still retain the same set of Development + Operations knowledge, and dive into areas of Cloud Native, Kubernetes, and microservices architectures.
ML Engineer goes DevOps via MLOps
This talk and lecture are dedicated to helping those transform their careers by generating more awareness around patterns and concepts that stay the same and what is transferrable, to more modern approaches.
The talk will cover a brief story of my Machine Learning as well as Data scientist story and why I decided to change careers, still retain the same set of Development + Operations knowledge, and dive into areas of Cloud Native, Kubernetes, and microservices architectures.
Additional things mentioned in this talk:
- Why DevOps
- DevOps roadmap
- Machine Learning issues which diverted me towards MLOps and DevOps
- Cloud-Native tools
- Pathways to get to these technologies
- Career prospects and what people are doing in these roles today
Kubernetes CRDs for Large Model Orchestration
In the dynamic landscape of AI/ML, deploying and orchestrating large open-source inference models on Kubernetes has become paramount. This talk delves into the intricacies of automating the deployment of heavyweight models like Falcon and Llama 2, leveraging Kubernetes Custom Resource Definitions (CRDs) to manage large model files seamlessly through container images. The deployment is streamlined with an HTTP server facilitating inference calls using the model library.
This session will explore eliminating manual tuning of deployment parameters to fit GPU hardware by providing preset configurations. Learn how to auto-provision GPU nodes based on specific model requirements, ensuring optimal utilization of resources. We'll discuss empowering users to deploy their containerized models effortlessly by allowing them to provide a pod template in the workspace custom resource inference field. The controller dynamically, in turn, creates deployment workloads utilizing all GPU nodes.
What Does Istio Ambient Mesh Mean For Your Wallet?
Istio is the most widely used service mesh platform in the world for large-scale production deployments. In September 2022, Google and Solo.io announced the release of the Istio Ambient Mesh to the community. Ambient offers a revolutionary data-plane architecture that allows service mesh users to ditch sidecars. It slashes operational complexity and enables incremental mesh adoption, all while reducing cost and computational overhead within a service mesh.
Injected sidecars can be replaced by two new components. First is a node-level zero-trust tunnel (ztunnel) that provides mTLS and Layer-4 capabilities. A service-account-level proxy called a waypoint leverages Envoy to deliver Layer-7 capabilities.
This talk will help you understand both the why and how of Istio Ambient Mesh. It includes a demo showcasing the new capabilities, including onboarding new services without sidecars and mixing Ambient with traditional sidecar-injected services. It will also provide pointers to further no-cost educational opportunities and user certification options.
Securing service meshes with eBPF
eBPF has several use-cases. For instance, it can be used by anyone trying to add traffic control, create network policy, add observability, routing traffic to a service mesh control plane, or for load balancing. Securing your applications with a defense in depth architecture and gaining visibility in your application behavior are the two key requirements to be successful in any modern cloud native deployment. While service meshes like Istio provide these capabilities via a user space proxy mechanism it's not always feasible to inject sidecars proxies for all your applications. On the other hand Kernel technologies like eBPF when used in a CNI like Cilium provides security and metrics transparently but lacks the richness of information and policy capabilities provided by a layer 7 proxy with strong identities.
In this session, We will present how we can leverage capabilities provided by both these technologies and achieve better security and observability ensuring all your applications can have uniform policy and visibility irrespective of whether they are in the mesh or not or if they are running as a container in Kubernetes or long running VM where making privileged changes are often not possible.
Art of DevOps: Harmonizing Code, Culture, and Continuous Delivery
In software development and IT operations, DevOps stands out as a masterpiece that merges the artistry of code creation with the discipline of operational excellence. This session delves into the "Art of DevOps," highlighting how it transcends mere technological practices and becomes a culture of continuous improvement, collaboration, and innovation. Participants will gain insights into the core principles of DevOps, understand its transformative impact on organizations, and learn how to integrate development and operations teams seamlessly. By marrying the agility of development with the stability of operations, DevOps acts as the paintbrush that crafts high-quality software products and services. Join us to explore the palette of tools, techniques, and best practices that make DevOps a transformative art form in the world of technology.
Sidecar-less Service mesh, Is it a dream or a reality ?
Every service mesh, including Istio, uses a sidecar proxy as its data plane. With this pattern, a mesh can intercept and enhance the capability of networking communication on behalf of an application. However, this sidecar deployment pattern comes with a set of challenges which include operational cost and complexity. With the advent of eBPF in modern kernels and some coordination with the Linux networking capabilities, we can remove the need to have a sidecar and adopt a transparent approach. In this talk, we dive into the future of Istio to show how Istio can run in an ambient mode while maintaining the features of Istio running in a standard mode.
Benefits: the top concerns we address with sidecar-less mode are simplified operational and management overhead, broader application compatibility, reduced infrastructure costs, and improved performance.
Kubernetes Observability with eBPF
eBPF is a revolutionary technology with origins in the Linux kernel that can run sandboxed programs in an operating system kernel. It is used to safely and efficiently extend the capabilities of the kernel without requiring to change kernel source code or load kernel modules. BumbleBee (https://github.com/solo-io/bumblebee) is a new Open Source project which helps to build, run and distribute eBPF programs using OCI images. It allows you to focus on writing eBPF code, while taking care of the user space components - automatically exposing your data as metrics or logs. In this workshop, we're introducing eBPF and the different ways to create eBPF programs. Then, attendees are creating their first eBPF program using BCC and libbpf to have a better understanding of the main concepts. Finally, they are going through several labs to build and deploy an eBPF program with BumbleBee. They also deploy Prometheus and a web application on Kubernetes to display all the communications happening in the Kubernetes cluster.
CNCF-hosted Co-located Events North America 2024 Sessionize Event
KCD UK London - 2024 Sessionize Event
KCD Porto Sessionize Event
90DaysOfDevOps - 2024 Community Edition Sessionize Event
API World 2023 Sessionize Event
State of Open Con 23 Sessionize Event
Devfest Mumbai 2022 Sessionize Event
Rohit Ghumare
CNCF Ambassador
London, United Kingdom
Links
Actions
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top