Lead Data Engineer

Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:Cloud, Data & Connected ServicesGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India Private Limited, BangaloreStartdatum:sofortVeröffentlichungsdatum:..6Stellennummer:MER3Z8BArbeitszeit:Vollzeit BewerbenAufgaben

Key Responsibilities

Data Engineering & Platform Architecture

Architect, design, and govern scalable batch and streaming data platforms using Python (strong OOP design), Apache Spark (PySpark, Spark SQL), and Azure Databricks.

Define end-to-end reference architectures for real-time and near-real-time streaming solutions using Apache Kafka or Apache Flink, with Spark Structured Streaming or Apache Flink, ensuring:Event-time correctnessExactly-once processing guaranteesStateful stream processing and checkpointingHigh availability and fault tolerance

Own the architectural design of Medallion architecture (Bron...