Azure Data Engineer
Location
abu dhabi, abu dhabi emirate
Job Type
Full-time
Category
IT & Technology
Posted
June 01, 2026
We are looking for a highly skilled Azure Data Engineer for an engagement to build scalable, production-ready data solutions.
The ideal candidate will have strong hands‑on experience with Python, PySpark, Azure Databricks, and Azure Data Factory, along with a solid understanding of modern data engineering best practices.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using Python, PySpark, and Spark SQL
Build and optimize workloads on Azure Databricks (notebooks, job clusters, workflows)
Implement Delta Lake best practices (schema evolution, partitioning, performance tuning, merge strategies)
- Develop robust ingestion frameworks integrating with Azure Data Lake Storage Gen2 and Azure SQL
- Implement data validation, transformation logic, and quality control frameworks
- Ensure performance optimization and cost‑efficient execution
- Support producti...