Fabio Ramos
Data Enginner @ Cevo Australia
Sydney, Australia
Actions
I have worked in a range of industries including education, property management, accounting, and auditing. As a cloud consultant, I've interacted with many stakeholders at various industry levels, ranging from startups, government agencies and enterprises. This has helped me to build an appreciation for learning and adapting to new environments, to develop an ability to work with different teams, and to interact with multiple stakeholders with different technical skills and different businesses objectives.
Leveraging Apache Iceberg for Effective Data Governance in a Data Lakehouse
Description
Preamble:
Companies have and are continuously collecting and storing a range of consumer data for further analysis in data lakehouses. In a lot of cases, the collected data contains personal identifiable information. Recent data breaches have highlighted the need for better data governance guidelines and regulation on how companies handle consumer information. The Right To Be Forgotten presents some challenges for companies in how to remove personal information they can no longer legally hold, without compromising data quality, security and atomicity. Apache Iceberg is a data table format that enables data lakehouses to easily comply with this legislation.
Talk:
I will discuss Apache Iceberg and the benefits it provides in managing large amounts of data and how Apache Iceberg can be part of your modern data architecture by bringing a range of capabilities to your data lake, including compliance with proper regulations, ACID transactions, schema evolution, time travel, and incremental processing. By the end of the talk, attendees will have gained a better understanding on how Apache Iceberg can be successfully used in data lakehouses.
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top