Search engines have revolutionized our access to information, providing nearly all of humanity's knowledge at our fingertips. As we navigate the age of AI, the challenge now lies in building the next generation of more intuitive search engines within applications that go beyond traditional text-based limitations.

In this talk, we will delve deep into the fundamentals of constructing multi-modal search engines that can process and understand diverse modalities of data. We will focus on how advanced multi-modal models like Gemini and open-source alternatives like Pali-Gemma can be leveraged to create powerful, private search engines tailored for domain-specific applications.

We will explore practical implementations and real-world applications, demonstrating how these technologies can drive the future of search in applications. The session will then connect with insights from Josh Woodward's and Sundar Pichai's Google I/O 2024 keynote speeches on Gemini and the future of search. The session will conclude by illustrating the transformative potential of AI in search for both major platforms like Google and individual developers who want to build applications of the future.