Senior Data Engineer Darwin

DLG is evolving. Across every facet of our business our teams are embracing new opportunities and putting customers at the heart of everything they do. By joining them youll have the opportunity to not just be recognised for your skills but encouraged to build upon them and empowered to do your absolute best.

At Darwin Insurance a brand within DLG youll help build the next generation of our low-latency cloud-native data platforms the systems that power real-time pricing machine learning workflows and operational intelligence. Youll own the design of resilient ETL / ELT pipelines distributed data processing and scalable AWS infrastructure collaborating closely with a tight-knit team of engineers architects and product leaders who care deeply about doing things the right way.

We engineer like a startup :
Clean Code TDD CI / CD Infrastructure-as-Code full ownership and a bias for shipping well-designed well-tested systems. Youll have a genuine voice in architectural direction mentor strong engineers and help raise the technical bar across the team.

This role is ideal for someone who wants meaningful impact someone whos excited by the blend of startup autonomy and big-company reach and who wants to shape the future of Darwins data platform as we scale our ambitions.

As a Senior Data Engineer based out of our London office and working closely with Platform Owner you will play a key role in developing and maintaining robust cloud-based data platform solutions within AWS.

• Leaduração cross‑functional collaborations with cross‑functional teams to understand business requirements and communicate complex data concepts clearly to non‑technical stakeholders facilitating informed decision‑making across the organization.
• Design robust data transformation solutions using ETL and ELT methodologies and maintain comprehensive documentation for all data pipelines and integration procedures to ensure clarity and effective management.
• Proactively monitor data systemspics for performance optimization and implement data quality checks to maintain high standards of accuracy Azərbayc reliability in data processing.
• Develop and enforce security protocols to protect data assets and ensure all data handling complies with legal and regulatory standards supporting robust data governance.
• Stay abreast of advancements in data engineering technologies and practices incorporating innovative tools and methods to enhance the organization’s data capabilities.
• Mentor junior data engineers fostering an environment of growth and continuous learning while leading by example in technical expertise and basic project management.
• Work closely with data architects and other engineers to refine data storage and architecture ensuring the infrastructure supports scalable solutions and future technological developments.

• Significant years of experience gained in professional services setting in designing and implementing complexে data transformations using both ETL and ELT methodologies to support scalable data architecture in high‑demand environments.
• Excellent understanding of distributed data processing ideally working with Apache Spark
• Extensive experience (5 years) with advanced SQL techniques and database management including proficiency with database systems like Postgre
  
  SQL MySQL and Amazon Redshift optimizing database performance and integrity in large‑scale environments.
• In‑depth knowledge of AWS cloud services including Glue S3 KMS Lambda and Kinesis demonstrating capability in deploying and managing scalable secure cloud infrastructure.
• Advanced proficiency in Python programming with demonstrated experience in developing automating and enhancing data processing tasks and analytical applications.
• Strong command over Unix / Linux operating environments with the ability to manage and optimize system performance for data applications.
• Solid understanding डॉक practical experience in Agile development processes skilled in translating strategic goals into executable stories with a focus on incremental and iterative delivery.
• Strong advocate for Software Craftsmanship and Clean Code with a commitment to maintaining…