Session

Hydrating real-time data in Pinot with fast batch queries on Trino

In the spectrum of real-time to batch systems, there has never been a perfect solution that can be found that addresses the limitations of both extremes well. Some systems that fall between, typically only do one or the other well and can't be adopted for both. Pinot is state-of-the-art for real-time ingest and analytics streaming, but has common limitations any real-time systems have. Trino is well known for being an incredibly fast batch analytics query engine that enables not only large-scale batch processing but also runs federated joins across multiple tables across multiple data sources.

This talk covers the many benefits of running Trino and Pinot together like using Trino as a unified point of access for reads and executing writes into Pinot and interactive analytics over data in Pinot and cloud storage. This talk will also dive into recent updates in Trino's Pinot connector like optimizing the efficiency of reads; putting less load on Pinot brokers. Learn how to augment your real-time architecture with this ludicrously fast batch query engine.

Brian Olsen

Head of Developer Relations @ Tabular

Chicago, Illinois, United States

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top