We explore how Apache NiFi can be used to integrate open source LLMs to implement scalable and efficient RAG pipelines. He shows how any kind of data including semistructured, structured and unstructured data from a variety of sources and types can be processed, queried, and used to feed large language models for smart, contextually aware answers. Look for his example utilizing Cortex AI, LLAMA, Apache NiFi, Apache Iceberg, Snowflake, open source tools, libraries, and Notebooks.