AI has become a vital component of many organizations' value propositions. To prevent unintended data exposure, businesses are opting to pre-process data for AI in-house. Many are successfully building singular pipelines for data pre-processing on laptops or single clusters. This presentation explores how Kubeflow Pipelines, combined with Argo Workflows and KubeStellar, offer a solution for organizations to achieve scale for their AI data preprocessing needs utilizing multiple Kubernetes clusters.

Attendees will gain insights into the importance of in-house data pre-processing for AI, the challenges organizations face, and the solution provided by Kubeflow Pipelines, Argo Workflows, and KubeStellar. The presentation will include practical implementation tips and real-world examples, enabling attendees to harness the power of these tools effectively.