This talk explores generative AI's transformative impact on Open edX and its competitors. It highlights the need for large-scale experimentation to enhance experiences for learners, creators, and instructors. Attendees will discover an AI extensibility framework empowering developers and power users to create, test, and measure LLM integrations. This approach fosters innovation and advances the field of learning engineering within the Open edX ecosystem.