Speaker

Neha Singla

Neha Singla

Apple, Senior Software Engineer

Actions

Neha Singla is a software engineer with Data platform team in Apple who provides Jupyter notebooks solutions at scale to help data scientists/data engineers at Apple build great data products. She is working with Apple for 3+ years and have experience building platforms at scale with Amazon, AWS and Microsoft

Streamline data science workflow development using Jupyter notebooks and Airflow

Jupyter Notebooks are widely used by data scientists and engineers to prototype and experiment with data. However these engineers are often required to work with other data or platform engineers to productionize these experiments due to the complexity in navigating infrastructure and systems. In this talk, we will deep dive into this PR https://github.com/apache/airflow/pull/34840 and share how airflow can be leveraged as a platform to execute notebook pipelines (python, scala or spark) in dynamic environments like Kubernetes for various heterogeneous use cases. We will demonstrate how data scientists can use a Jupyter extension to easily build and manage such pipelines which are executed using Airflow streamlining data science workflow development and supercharging productivity

Neha Singla

Apple, Senior Software Engineer

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top