Senior Software Engineer - AI Inference
Location
New York, NY
Job Type
Full-time
Category
other-general
Posted
June 01, 2026
Senior Software Engineer - AI Inference
Location
New York
Business Area
Engineering and CTO
Ref #
10050779
**Description & Requirements**
**Our team:**
Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference Platform provides production-grade managed infrastructure for hosting, deploying, and serving all machine learning models, both predictive and cutting-edge generative models. We abstract away infrastructure complexity, empowering engineering teams to focus on creating intelligent applications with guaranteed scalability, performance, and governance. Our platform is built on the open-source KServe project, and the CNCS AI Inference team is a primary contributor to its development.
**We'll trust you to:**
+ Design and build scalable infrastructure for both online and offline inference workloads.
+ Lead integration of high-performance inference...
Location
New York
Business Area
Engineering and CTO
Ref #
10050779
**Description & Requirements**
**Our team:**
Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference Platform provides production-grade managed infrastructure for hosting, deploying, and serving all machine learning models, both predictive and cutting-edge generative models. We abstract away infrastructure complexity, empowering engineering teams to focus on creating intelligent applications with guaranteed scalability, performance, and governance. Our platform is built on the open-source KServe project, and the CNCS AI Inference team is a primary contributor to its development.
**We'll trust you to:**
+ Design and build scalable infrastructure for both online and offline inference workloads.
+ Lead integration of high-performance inference...