Senior Data Engineer; Databricks

Position: Senior Data Engineer (Databricks)
About the job
Join our research team as an experienced data analyst, delivering actionable data driven insights across diverse global shipping, trade, offshore, renewables and energy datasets. You will help us build and derive valuable data used widely to analyse impacts of market trends, geopolitics, and decarbonisation.

What you’ll be doing :
Lead in proposing plans and implementing systems for  processing and analysing big data sets
Develop and use algorithmic and machine learning techniques to extract, transform, derive, aggregate and validate data
Work alongside data analysts and developers to deliver big data processing solutions and analytics
Collaborate  with stakeholders for requirement gathering, plan project deliverables, and track implementation with analysts, data engineers and developers
Lead implementation of ETL and processing  pipelines , data derivation and analysis
Work in a fast-paced, motivated and agile team, supporting clients and reporting progress to senior management

You’ll need to have:
4+ years’   experience working with Big Data tools including:
Databricks, Apache Spark, Kafka, Data Lakes
Experience designing and scaling Big Data systems including   partitioning strategies
Excellent demonstratable  SQL  skills including complex queries, stored procedures,  Spark SQL, and Spark Streaming abilities
Expert in   Spark optimization  , Delta, and Databricks Lakehouse
Working knowledge of Azure, including streaming data from   Event Hubs or Kafka
Working knowledge of Python or Py Spark
Comfortable with Git in Azure Dev Ops and Infrastructure as Code (IaC) provisioning
A degree in relevant numerate or analytical subject
Good organisational skills and strong attention to detail

We love to see:
Curiosity and willingness to learn new techniques, programming languages and software tools
Appreciation of the wider data science technology landscape
Any spatial data experience using H3 indexes
Any knowledge of the maritime, offshore oil and gas, or offshore renewable industries
Awareness of global trade, economics and statistics

Working at Clarksons Research:
Clarksons Research is the leading global provider of intelligence and research across shipping, trade, offshore and energy. Respected worldwide, the Clarksons Research team of over 175 experts provides powerful analysis, insight, and data through a range of online platforms, reports, valuations, and consultancy work. Clarksons Research is part of the Clarksons Group, the world’s leading integrated shipping services provider and a FTSE 250 company.

Clarksons Research is currently offering exciting opportunities for experienced senior data engineers to join its expanding Development team. Successful candidates will join a fast-expanding business offering excellent opportunities for career progression within a supportive organisation with a strong track record of training, mentoring and ensuring people reach their full potential. We offer a competitive range of benefits including 21-days holiday and health insurance.

Details:
Salary:  Competitive (dependent on experience) plus bonus and benefits
Location :
Gurgaon, Delhi
Number of vacancies:  1-2

Start date:

Q2 2026
Closing date:  30 th  March 2026   (though applications reviewed and accepted immediately)

Think you’d be a good fit:
To prioritise your application for immediate review or to highlight relevant maritime or energy industry experience, please send a CV and letter directly to Apeksha Mehta at  quoting reference  CRSL/RES-DEV- DEL/51  6

In the meantime, have a look at  and

What to expect from us:
We believe in human insights, and all applications are reviewed by real people, not algorithms. We know your time is valuable and aim to keep to a two-stage process where possible.