Over 85% of GenAI related POCs never make it to production. The most cited reason for this is lack trust in the solution. In this session we explore tools to address this issue, LLM evaluations!

We will show both the philosophy behind how LLM evaluations work, what the metrics mean, as well and how you can use this data to overcome roadblocks to production, and ultimately, providing business value with your solution.

We will cover:
- What does measuring LLM solutions look like?
- Business process
- Timeline aggregation of data to address business problems
- Anecdotal vs objective evidence

- 30 or hour long session are both available
- 5 Minute lightning talk recording of this available here: https://youtu.be/Tda76JqGaNY?si=e6v9Vd02NMZcdO8l
- Attendees will need some GenAI familiarity with concepts like RAG and what LLMs are, but not much beyond that. Business focused attendees often find the information helpful, but the technical side a little too in depth for them.