Diego Ciangottini
INFN Technologist specialized in platforms for large scale data analysis
Perugia, Italy
Actions
Diego Ciangottini is a physicist and received his PhD from the University of Perugia, Italy in 2012. Now he's working as technologist at INFN (Italian National Institute for Nuclear Physics) researching cloud-native solutions for the scientific use cases of the institute. In that sense his main occupation is building bridges between science communities and what the cloud-native ecosystem can do for them.
Area of Expertise
Topics
Testing AI Containers for Digital Twins in Science: A Cloud-HPC Workflow
CERN is advancing the development of AI-based digital twins in science through projects like interTwin, an EC-funded project to develop a digital twin engine for science. These digital twins rely on HPC resources for training multi-node, multi-GPU models using containerized workflows.
Developing such containers for HPC systems presents unique challenges, including accessing restricted HPC resources and integrating with HPC software stacks, while ensuring the interoperability between different container runtimes.
We introduce a CI/CD workflow that bridges cloud and HPC and enables automated testing of AI/ML containers on the same SLURM-managed clusters where they will be deployed. By integrating Dagger’s reproducible CI runtime with HPC offloading, this approach validates both the software in the containers and their compatibility with HPC environments. This ensures the seamless deployment of AI-based digital twins, addressing the critical need for robust testing in hybrid environments.
Pods everywhere! InterLink: a Virtual Kubelet abstraction streamlining HPC resource exploitation
Kubernetes APIs are already a valuable asset in many scientific endeavours, enabling workflows across a wide range of environments thanks to the flexibility of its declarative primitives. Therefore if one could keep using the same APIs while getting a transparent access to any number of external hardware-accelerated machines, that would represent a real game changer.
That is exactly what interLink project is about: an open source extension of the concept of Virtual-Kubelet, developed by INFN (the Italian National Institute for Nuclear Physics) in the context of interTwin, an EU funded project that aims to build a digital-twin platform for sciences and beyond. We will walk through the first phases of the prototype and the early use cases of a Kubernetes-based computing platform capable of extending its computational capabilities over heterogeneous providers: simple remote host, SLURM batch systems at world-class HPC centers, and serverless frameworks.
KubeCon + CloudNativeCon Europe 2025 Sessionize Event
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top