Abstract:

In the 1960s, software engineering went through a radical shift. Instead of writing programs, people started writing programs that wrote programs. The same is about to happen to data engineering.

Description:

Remember when people wrote low-level code with a basic instruction set that was quite similar across vendors but slightly different in annoying ways that made you want to tear your hair out? That's the life of a data engineer today, but it doesn't need to be this way.

Software engineering went through a similar shift back in the 1960s. This made their programs less buggy, more portable, easier to debug and enabled more people to "come to the party", driving further innovation.

Data engineering stands on the brink of the same revolution, and the semantic layer is the key to this. In this talk, Abhinav will demonstrate how compilers will change the field in the years to come.