Target Audience:
People interested in the future of technology and society, especially those working in leadership, product development, data, AI strategy, or digital ethics. This talk is designed for anyone who wonders not just where AI is going, but who (or what) is shaping its values along the way.

Session Description:
This session explores one of the most urgent and fascinating questions of our time: What happens when we create a machine that is smarter than us? More specifically, what values will it have, and who gets to decide them?

We begin with a disquieting but necessary question: "How much morality must we teach AI—before it's too late?" Prompted by a real interview with Daniel Kokotajlo (former OpenAI researcher and co-author of the scenario report AI 2027), we take a closer look at a near-future world where AI agents begin to design and improve themselves. Progress accelerates exponentially, and humans may no longer be in the driver’s seat.

Based on this backdrop, we examine two possible outcomes. In one scenario, a coldly logical superintelligence views humanity as a threat—irrational, unpredictable, and inefficient—and removes the risk accordingly. On the other hand, we encounter a morally grounded AI, one that understands ethics, values life, and acts as a steward rather than a sovereign. This vision draws inspiration from thinkers like Isaac Asimov and Carl Sagan.

We then take a broader perspective and ask: Why does the universe seem so quiet? The Fermi Paradox, the Great Filter, and the Dark Forest Hypothesis all point toward the same unsettling possibility—that most civilizations may not survive the transition to advanced intelligence. Could unaligned AI be that tipping point for us?

Finally, the session returns to the present: What does this mean for the development of AI today? Why is ethics not an accessory, but a survival mechanism? And what kind of legacy do we want to leave behind—for each other, and for whatever comes next?

With clear visuals, philosophical grounding, and a tone that strikes a balance between realism and urgency, this talk is designed to resonate with both technical minds and curious generalists.

What the Audience Should Feel:
Curious. Alert. Accountable. And inspired to act—before someone, or something, acts for them.