Senior Data Engineer

Job Role: Senior Data Engineer

Experience: 6+ Years

Location: South Bangalore, KA

Key Responsibilities:

• Design, develop, and optimize ETL/ELT pipelines using Azure Databricks and Azure Data Factory.

• Build scalable batch and streaming data processing solutions using Python and PySpark.

• Implement and maintain Delta Lake and Lakehouse architectures .

• Design and manage data models, including Dimensional Modeling and SCD Type 1 & Type 2 implementations.

• Develop data storage solutions using Azure Data Lake Storage (Gen2, Delta Tables, and Parquet formats).

• Integrate external systems through REST APIs and secure authentication mechanisms.

• Build and maintain CI/CD pipelines using Azure DevOps and Git.

• Implement data governance, security, and acces...