Shubham Agnihotri
Senior Manager - Generative AI - IDFC Bank
Mumbai, India
Actions
Senior Manager - Generative AI - IDFC Bank, Ex Organizer at TFUG Bangalore,
Links
Area of Expertise
Topics
Accelerating Training with Multi-GPU: Using PyTorch Lightning for PaLI-Gemma VLM
Dive into the world of high-performance model training with multi-GPU setups using PyTorch Lightning, featuring the PaLI-Gemma Vision-Language Model (VLM). This session will cover the essential tools and techniques for setting up efficient distributed training pipelines, allowing you to fully utilize multiple GPUs to speed up and scale model training. We’ll explore PyTorch Lightning’s seamless integration for handling multi-GPU workloads, making it accessible even for those new to distributed training. Attendees will get a step-by-step guide to configuring PaLI-Gemma for accelerated training, from data handling to model synchronization and optimization strategies. By the end, you'll have the skills needed to harness the power of multi-GPU training to scale multimodal AI models effectively.
MultiModel RAGs: Unlocking the Power of Multimodality with PaliGemma
Unlocking the Potential of Multimodality with Pali-Gemma. In this session, I’ll dive into the concepts and applications of multimodality, showcasing how combining multiple forms of data can enhance AI model capabilities. I’ll walk through the process of training on Colab/Kaggle, highlighting each step from data preparation to fine-tuning. Following the training phase, I’ll demonstrate how we can leverage Hugging Face Spaces for inference and deployment, providing a practical approach to deploying powerful Vision-Language Models (VLMs) in real-world applications. This session will serve as a comprehensive guide for anyone interested in building and deploying multimodal AI solutions, showing how PaLI-Gemma, a state-of-the-art model, is trained and implemented. By the end, participants will have a solid understanding of how multimodal RAGs work and how to bring them to production efficiently.
Building Transformers: Code Your Vision
From hugging face transformers to transformers from scratch in python, hands on Workshop with Transformers brush ups to implementing it.
Devfest Mumbai, 2023 Sessionize Event
Shubham Agnihotri
Senior Manager - Generative AI - IDFC Bank
Mumbai, India
Links
Actions
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top