DataOps Engineer - Lakehouse Operations
UAE/Dubai
Listed on 2026-01-05
-
IT/Tech
Data Analyst, Data Engineer
Deep Light AI is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across multiple industries, with particular depth in financial services and banking. Our team combines deep expertise in data science, statistical modeling, AI/ML technologies, workflow automation, and systems integration with a practical understanding of complex business operations.
As a Data Ops Engineer, you will be the guardian of our modern Lakehouse environment, ensuring that our complex data ecosystem remains reliable, transparent, and high-performing. Positioned at the vital intersection of Data Engineering and Operations, you will lead the charge in proactive monitoring and rapid incident response for mission‑critical pipelines, including AWS Glue, dbt, and Kafka. This is a high‑visibility role where you won’t just react to issues—you will own the end‑to‑end incident lifecycle, drive deep root‑cause analysis (RCA), and collaborate with development teams to build permanent automated preventions.
Key Responsibilities- Monitoring & Alerting:
- Monitor and act on incidents related to: AWS Glue job executions, Current DMS and dbt pipelines, Kafka lag and streaming health, Data freshness SLA breaches, Data quality issues, Platform health alerts.
- Perform L1 triage or distribute incidents to L2/L3 teams as needed.
- Incident Management:
- Own the incident response process:
Initial triage and severity assessment. - Coordinate with development teams for resolution.
- Create and assign JIRA tickets with full context.
- Track incident resolution and closure.
- Escalate high‑priority or long‑running incidents to management.
- Own the incident response process:
- Root Cause Analysis & Prevention:
- Conduct post‑incident root cause analysis.
- Maintain incident logs and post‑mortem documentation.
- Implement preventive measures for recurring issues in collaboration with dev teams.
- Operational Reporting:
- Manage the TV dashboard providing real‑time status of critical flows (with color‑coded indicators).
- Deliver a daily 10–15 min operational review of previous day’s executions, open incidents, and follow‑ups.
- Share daily summary emails with the team.
- Continuous Awareness:
- Stay up‑to‑date on the status of all critical flows and remediation efforts.
- Ensure proactive communication on risks and delays.
- You will have experience in:
Data Ops, Dev Ops, or data engineering roles, with a minimum of 5 years. - AWS Glue, DMS, dbt, and Kafka monitoring.
- Incident management tools (e.g., JIRA) and alerting systems.
- Identification of ways to automate repetitive tasks.
- Troubleshooting and triage process.
- Managing multiple incidents and prioritizing effectively.
- Root cause analysis and preventive action planning; communicating and coordination.
- Working under pressure and maintaining operational discipline.
- Bridging the gap between complex data science and actionable business value.
- Compelling communication and persuasive advocacy for one's own skills.
- Ability to "sell" technical vision to high‑level stakeholders.
- Competitive salary and performance bonuses.
- Comprehensive health insurance.
- Professional development and certification support.
- Opportunity to work on cutting‑edge AI projects.
- Flexible working arrangements.
- Career advancement opportunities in a rapidly growing AI company.
This role is based 4 days per week on client site in Abu Dhabi, with 1 day (Friday) working from home.
Diversity & InclusionAt Deep Light AI, we recognize that diversity drives innovation. We are committed to fostering an inclusive environment where individuals with different thinking styles can thrive and contribute their unique strengths to our specialized AI and data solutions. Our goal is to ensure our application and interview process is accessible, predictable, and fair for all candidates. If you require any specific adjustments to the application process, or if you require any reasonable adjustments should you be successful in being processed to the interview stage, please let us know.
This information will be kept strictly confidential and will not impact hiring decisions. By applying to Deeplight, you also agree for us to share your profile, where necessary, with external clients.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).