ChatGPT has garnered immense success and is already transforming the daily routines of numerous professionals across various industries. But with great power comes great responsibility, which can only be achieved by knowing the tools we use.

We invite you to embark on a journey with us, where we demystify one such tool – the Generative Pre-trained Transformer, or GPT.

You might have heard of its capabilities, but what exactly is it? More importantly, what is it not? Our workshop will first lay the foundation by providing a clear, synthetic explanation of what language models essentially are: we'll delve into the intricacies of their inner workings, separating myths from facts. We will cover all the bases: from tokenisation and word embeddings to the training and fine-tuning of state-of-the-art language models, such as OpenAI’s latest GPT4.

While theory is a powerful first step, we believe that true understanding comes from hands-on experience. What if we told you that by the end of our session, you would be able to code your very own GPT? Our expert-guided workshop will ultimately have you build your own generative model. While your model will be simplified, small-scale, and not nearly as capable as the state of the art, this experience will equip you with a deep understanding of the potential and limitations of this technology.

Workshop held at Applied Machine Learning Days 2024, Lausanne, Switzerland