Speaker

Kazuki Yamamoto

Kazuki Yamamoto

NTT SIC, Engineer

Tokyo, Japan

Actions

Yamamoto Kazuki is a research engineer at NTT Software Innovation Center, engaging in distributed systems and virtualization.
He has researched computing technology, optimizing compiler, and worked on CI/CD tasks.
Currently, he focuses on disaggregated computing Infrastructure and the IOWN (Innovative Optical and Wireless Network) projects.

Area of Expertise

  • Information & Communications Technology

Topics

  • Cloud Native

Effortlessly Build High-Performance AI/ML Pipelines With Accelerator Chaining and K8s Native Tech

Join us for an enlightening presentation on effortlessly building advanced, high-performance processing infrastructure for AI/ML workloads with low power consumption.

In streaming processing, accelerators are assigned only for specific tasks in the workload. By assigning each task to the appropriate accelerator and "chaining" them, we obtain high-performance infrastructure with low power consumption at the service level.

Native Kubernetes is a popular choice for deploying AI/ML workloads. However, more is needed to create a new processing form, described above, "Accelerator Chaining Pipelines."

This presentation will demonstrate how we leverage Numaflow and "Dynamic Resource Allocation"(DRA) to overcome challenges, and effortlessly build an "Accelerator Chaining Pipeline" in NTT. You will see a glimpse of future innovations, including direct data transfer and CNI extensions for high-speed communication between accelerators.

Kazuki Yamamoto

NTT SIC, Engineer

Tokyo, Japan

Actions

Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.

Jump to top