Senior Data Engineer - Darwin

DLG is evolving. Across every facet of our business, our teams are embracing new opportunities and putting customers at the heart of everything they do. By joining them, you’ll have the opportunity to not just be recognised for your skills but encouraged to build upon them and empowered to do your absolute best.

At Darwin Insurance
, a brand within DLG, you’ll help build the next generation of our low-latency, cloud-native data platforms — the systems that power real-time pricing, machine learning workflows, and operational intelligence. You’ll own the design of resilient ETL/ELT pipelines, distributed data processing, and scalable AWS infrastructure, collaborating closely with a tight-knit team of engineers, architects, and product leaders who care deeply about doing things the right way.

We engineer like a startup:
Clean Code, TDD, CI/CD, Infrastructure-as-Code, full ownership, and a bias for shipping well-designed, well-tested systems. You’ll have a genuine voice in architectural direction, mentor strong engineers, and help raise the technical bar across the team.

This role is ideal for someone who wants meaningful impact — someone who’s excited by the blend of startup autonomy and big-company reach, and who wants to shape the future of Darwin’s data platform as we scale our ambitions.

As a Senior Data Engineer, based out of our London office and working closely with Platform Owner, you will play a key role in developing and maintaining robust cloud-based data platform solutions within AWS.

• Cross-Functional Collaboration and Stakeholder Communication:
  Lead collaborations with cross-functional teams to understand business requirements and communicate complex data concepts clearly to non-technical stakeholders, facilitating informed decision-making across the organization.

• Data Solutions Development and Documentation:
  Design robust data transformation solutions using ETL and ELT methodologies and maintain comprehensive documentation for all data pipelines and integration procedures to ensure clarity and effective management.

• Performance Monitoring and Data Quality Assurance:
  Proactively monitor data systems for performance optimization and implement data quality checks to maintain high standards of accuracy and reliability in data processing.

• Security and Compliance:
  Develop and enforce security protocols to protect data assets and ensure all data handling complies with legal and regulatory standards, supporting robust data governance.

• Innovation and Technology Advancement:
  Stay abreast of advancements in data engineering technologies and practices, incorporating innovative tools and methods to enhance the organization’s data capabilities.

• Mentorship and Team Leadership:
  Mentor junior data engineers, fostering an environment of growth and continuous learning, while leading by example in technical expertise and basic project management.

• Architectural Collaboration and Optimization:
  Work closely with data architects and other engineers to refine data storage and architecture, ensuring the infrastructure supports scalable solutions and future technological developments.

Our hybrid model offers a 'best of both worlds' approach. When you'll be in the office depends on your role and team, but colleagues spend at least 2 days a week in the office

• Significant years of experience, gained in professional services setting, in designing and implementing complex data transformations using both ETL and ELT methodologies to support scalable data architecture in high-demand environments.

• Excellent understanding of distributed data processing, ideally working with Apache Spark

• Extensive experience (5+ years) with advanced SQL techniques and database management, including proficiency with database systems like Postgre
  
  SQL, MySQL, and Amazon Redshift, optimizing database performance and integrity in large-scale environments.

• In-depth knowledge of AWS cloud services including Glue, S3, KMS, Lambda, and Kinesis, demonstrating capability in deploying and managing scalable, secure cloud infrastructure.

• Advanced proficiency in Python programming, with demonstrated experience in developing,…