AI Platform Engineer (m/f/x)

Scalable GmbH • Munich, Bavaria, Germany • Posted May 22, 2026

Location Munich, Bavaria
Job Type full-time
Category Computer Occupations
Posted May 22, 2026
Job Description

As an AI Platform Engineer embedded within our Data Science and AI tribe, you will design and maintain the foundational infrastructure that enables our AI Software Engineers to build and scale generative AI applications.

You will build our internal AI provisioning platform, focusing on seamless model access, observability, and strict governance. In this role, you will ensure our AI integrations are secure, performant, and cost-effective, providing the robust backbone required for our agentic and LLM-driven workflows.

Responsibilities:

  • Develop and maintain an internal AI provisioning platform to streamline access to various LLMs & MCP Servers (e.g., via LiteLLM).
  • Implement comprehensive LLM observability, logging, and alerting systems using tools like Datadog and Langfuse.
  • Enforce model governance, ensuring security, data privacy, rate limiting, and strict LLM API cost management.
  • Collaborate...

Interested in this role?

Click the button below to start your application.

Apply Now