Senior Data Engineer

Mandatory Skill:

Azure Databrick Structured Streamin Delta Lake Delta Live Tables (DLTSpark Declarative Pipelines (SDP DatabricksAsset Bundle Unity Catalo Auto Loade Cloud File Apache SparK

Preferred Experience eMigration of traditional ETL pipelines to Spark Declarative Pipeline

Enterprise-scale Lakehouse implementation Data Quality frameworks and governance solution

Large-scale streaming architectures processing millions of events per da

Experience implementing Medallion Architecture

Streaming & Real-Time Data Processing

Design and develop real-time streaming pipelines using Databricks Structured Streaming.

Build and maintain Kafka-based ingestion frameworks.

Handle late-arriving events using watermarks, event-time processing, and statef...