Senior Data Engineering Technical Lead
Location
Remote, wes kaap
Job Type
Full-time
Category
Database, Analytics & BI
Posted
June 02, 2026
Key Duties and Responsibilities
- Architect and deliver large-scale data migration strategies for identity transformation
- Build robust batch and streaming pipelines using Apache Spark
- Develop data lineage, validation, and reconciliation frameworks to ensure data integrity
- Orchestrate highly parallel data workflows for performance and reliability
- Lead upgrades and optimisation of Spark and JVM environments in production
- Implement monitoring and observability to ensure system health and performance
- Design test frameworks to validate complex migration scenarios
Lead & Elevate Engineering Teams
- Take ownership of critical components and drive engineering excellence
- Mentor team members through pair programming, reviews, and coaching
- Lead technical discussions and influence architecture decisions
- Proactively identify risks and remove delivery blockers <...