Senior Data Engineer

Apply using Smart Recruiters, the City and County of San Francisco's application portal.

Department: DataSF
Job class: 1043 Senior Data Engineer
Salary range: $153,686/year - $193,388/year
Role type: Permanent Exempt
Hours: Full-time (Hybrid work schedule)

About: Permanent Exempt:
This is an Exempt position excluded by the Charter from the competitive Civil Service examination process, pursuant to the City and County of San Francisco, Charter Section 10.104. It is considered "at will" and shall serve at the discretion of the Appointing Officer.
Application Opening:
Wednesday, November 19, 2025
Application Closing:
Interested candidates are encouraged to apply as soon as possible, as this job announcement will close at any time, but not earlier than Friday, January 2, 2026

The Office of the City Administrator and its 25+ divisions and departments operate core internal and public-facing services in San Francisco.
The Office of the City Administrator’s Mission and Vision
Our vision is to lead the nation in public administration and to enable City departments to effectively deliver critical public services. We aim to help the city run better, to connect San Francisco residents and constituents to the vital public services they seek, and to create a meaningful and diverse work culture that is the place of choice for people who are invested in a career in public service.

We are committed to ensuring that City services are inclusive, efficient, equitable, and culturally competent for San Franciscans of all races, ethnic backgrounds, religions, and sexual orientations. This commitment requires comprehensive review and thorough analysis of existing practices and policies to remove barriers to real inclusion. We are also committed to ensuring that we have a safe, equitable, and inclusive workplace for individuals of all races.

This includes creating opportunities for hiring, promotion, training, and development, for all employees, including but not limited to, Black, Indigenous, and people of color (BIPOC).

Want to build robust and scalable data infrastructure to power data-driven City services? Join the DataSF team to empower and expand the use of data in government!

Company Description

DataSF’s mission is to transform the way San Francisco works with data. We believe that data, when harnessed effectively, can improve transparency, resident engagement, and government performance. We are committed to removing barriers and making it easier for all people to access services and knowledge, and we actively seek team members whose diverse life experiences reflect the residents we serve.

DataSF is seeking a Senior Data Engineer with 3+ years of experience to join our growing team. Reporting to the Principal Data Engineer, you will be instrumental in designing, building, and maintaining the City's data infrastructure, enabling robust data pipelines and reliable data access for analytical and operational needs. This is an exciting position for someone eager to apply advanced data engineering techniques to complex urban challenges, contributing directly to San Francisco's commitment to efficient, equitable, and ethical service delivery.

Learn more about DataSF’s recent work on our blog. If you are an entrepreneurial and passionate data enthusiast, join our team to improve government through good use of data!

Essential duties include, but are not limited to, the following:

• Platform Administration
  :
  Manage our central Snowflake data warehouse, including access control, security policies, resource monitoring, performance tuning, and cost optimization. Administer our platform with a focus on data democratization and accessibility, while protecting privacy and security.
• Pipeline Development
  :
  Build and maintain scalable and resilient pipelines to ingest and structure data from diverse sources. Design infrastructure to support both streaming and batch processes, and both structured and unstructured data sources.
• Infrastructure as Code (IaC):
  Use Terraform to define, deploy, and manage data infrastructure, ensuring our pipelines are reproducible, version-controlled, and production-ready.
• Best Practices & Innovation
  :
  Champion and…