When it comes to streaming data, there's a lot of data formats out there, and as much as we give JSON a pass because it's easy, it's an overhead we can't often afford, so let's dive in and see which ones matter and why!
Come along and we'll run through the how and why of data serialisations, how to manage schemas and why we need rows and columns in streaming, and in data lakes.
We'll talk through tools evolution, efficiency and portability. Some horror stories of data conflicts and some of the newer ways to take advantage of these