In today's fast-paced AI-World, new language models are being released almost daily, each claiming to be superior to the last. But how do you determine which one is best suited for your specific use case? How can you easily and freely compare them? What parameters should you consider, such as tokens per minute (TPM), latency, responsibleness, safety, and cost etc.? Moreover, how do you architect a system around these models? Are there established app design patterns? What about logging and monitoring?

These are valid questions that often go unanswered. Let me guide you through a developer's journey, from the selection of a language model to the design and production of AI applications. We'll also explore how to automate this journey with tests and evaluations.