Speaker

Fabian Hueske

Fabian Hueske

Apache Flink Committer & PMC Member

Berlin, Germany

Actions

Fabian Hueske is a committer and PMC member of Apache Flink. He is one of the three original authors of the Stratosphere research system, from which Apache Flink was forked in 2014. Fabian is a co-founder of Ververica (previously data Artisans), a Berlin-based startup devoted to fostering Flink, which was acquired by Alibaba. He works as a software engineer at Ververica and contributes to Apache Flink. Fabian holds a PhD in computer science from TU Berlin, is an author of "Stream Processing with Apache Flink", and frequently speaks at tech conferences about Flink.

Area of Expertise

  • Information & Communications Technology

Topics

  • stream processing
  • query processing
  • query optimization
  • distributed systems
  • parallel data processing

One SQL to Rule Them All – a Syntactically Idiomatic Approach to Management of Streams and Tables

Apache Calcite is a data management framework that includes a SQL parser and query optimizer. It is used by many projects that implement SQL processing capabilities, including Apache Beam and Apache Flink. Over the last years, members of these three communities had many discussions about the semantics and syntax of "Streaming SQL". End of last year, we decided to formalize and summarize our views and ideas in paper that we submitted to the Industrial Track of the SIGMOD 2019 conference. The paper got accepted (http://sigmod2019.org/sigmod_industry_list).

It presents a three-part proposal for integrating robust streaming into SQL, namely:
(1) time-varying relations as a foundation for classical tables as well as streaming data,
(2) event time semantics,
(3) a limited set of optional keyword extensions to control the materialization of time-varying query results.

The paper shows how with these minimal additions it is possible to utilize the complete suite of standard SQL semantics to perform robust stream processing and motivates and illustrate these concepts using examples and describe lessons learned from implementations in Apache Calcite, Apache Flink, and Apache Beam.

In this talk, we present our "Syntactically Idiomatic Approach to Manage Streams and Tables".

Fabian Hueske

Apache Flink Committer & PMC Member

Berlin, Germany

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top