Databricks Engineer; SC Cleared

Databricks Engineer (SC Cleared)

London (Hybrid)

6 Month Contract

£(Apply online only)/day (Inside IR35)

Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid).

Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start asap in Dec 2025 / Jan 2026.

Hybrid Working - 2 days/week remote (WFH), and 3 days/week working on-site from the Central London office.

A chance to work with a leading global IT and Digital transformation business specialising in Government projects:

• In-depth Data Engineering + strong hands-on Azure Databricks expertise.
• Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database.
• Designing, developing, building + optimising data pipelines, implementing data transformations, ensuring data quality and reliability.
• Deep Data Warehousing knowledge including data modelling techniques + data integration patterns.
• Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design.
• Implementing complex data transformations using Spark, PySpark or Scala + working with SQL / MySQL databases.
• Experience with data quality, data governance processes, Git version control + Agile development environments.
• Azure Data Engineer certification preferred
  -eg
  - Azure Data Engineer Associate.
• Advantageous skills:
  Azure Event Hubs, Kafka, data visualisation tools, Power BI, Tableau, Azure Dev Ops, Docker, Kubernetes, Jenkins.