JIanxiang Sun
Horizon Robotics, Software Engineer
Actions
Jianxiang Sun is a Senior Cloud-Native Engineer at Horizon Robotics, where he specializes in scaling workflow systems and scheduling for massive autonomous driving pipelines. He previously built machine learning platforms at Kuaishou and led scientific computing scheduling at DP Technology. An expert in Kubernetes efficiency and Go runtime optimization, Jianxiang Sun is dedicated to resolving bottlenecks in extreme-scale task orchestration and AI infrastructure.
8 Million Tasks Daily: Driving Efficiency in Multi-Tenant Data Platforms at Horizon Robotics
As autonomous driving shifts to end-to-end models, Horizon Robotics faces unprecedented scale. Thousands of concurrent, sub-minute workflows pushed infrastructure to its limits, where traditional orchestration and "Informer Choke" caused severe instability and resource waste.
We re-architected our platform to handle 8 million daily tasks, saving 1,000+ CPU nodes. We will dive into:
1. Orchestration Re-engineering: Replacing per-workflow agents with a centralized Argo Workflows Agent Service. This "Agentless" approach cut infrastructure costs by 2.4M CNY/month and saved 1,000+ CPU nodes.
2. Scheduling & State Optimization: Overcoming Informer bottlenecks by refactoring metadata, reducing VolcanoJob size by 30%, and slashing sync latency from 4 minutes to <10 seconds.
3. Stability & Multi-Tenancy: Leveraging Kueue and Volcano to implement elastic quotas and resolve preemption conflicts, ensuring system stability in large-scale multi-tenant environments.
JIanxiang Sun
Horizon Robotics, Software Engineer
Actions
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top