Lead Data Engineer

Join to apply for the Lead Data Engineer role at 540

540 is seeking a Lead Data Engineer to own the technical direction of mission‑critical, cloud‑based data platforms supporting high‑impact federal missions. In this role, you’ll lead the architecture and implementation of scalable data pipelines in AWS, set engineering standards, and act as a technical mentor across teams, while remaining deeply hands‑on in building and evolving our data infrastructure. This is an opportunity for a senior engineer who thrives at the intersection of architecture, execution, and mentorship and wants to build modern data solutions that matter.

Location: Remote within the continental United States. Core collaboration hours align with Eastern Time, with flexibility. Occasional travel (3–4 × annually).

Citizenship & Clearance Requirement: per client requirements, must be a U.S. Citizen with the ability to obtain a DoD Secret clearance.

Education Requirement: Bachelor's Degree in Computer Science or related engineering field (preferred).

540 Internal Thrive Level: Senior Software Engineer.

540 is a forward‑thinking company that the government turns to in order to #getshitdone. We don't just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission‑critical problems.

• Lead the design and implementation of enterprise‑scale data pipelines and ETL processes in AWS environments.
• Provide technical leadership and architectural guidance to cross‑functional engineering teams.
• Drive best practices for data modeling, pipeline optimization, and cloud infrastructure design.
• Architect and implement solutions using Python, AWS Lambda, and modern data engineering frameworks.
• Oversee code quality, conduct architectural reviews, and establish engineering standards.
• Collaborate with stakeholders to translate complex business requirements into technical solutions.
• Mentor and develop junior and senior engineers through code reviews and technical guidance.
• Troubleshoot and resolve complex data engineering challenges across the technology stack.
• Stay current with emerging technologies and recommend innovative approaches to data challenges.

• 9+ years of professional experience in data engineering or related technical roles.
• Demonstrated experience as a technical lead or architect on complex data projects.
• Expert‑level proficiency in Python programming and software engineering best practices.
• Deep understanding of AWS services including Lambda, S3, Step Functions, Glue, EMR, Redshift, and related data tools.
• Strong experience with Git version control and collaborative development workflows.
• Proven track record of designing and implementing scalable, high‑performance data solutions.
• Experience with data warehousing concepts, dimensional modeling, and analytics platforms.
• Strong understanding of CI/CD pipelines and infrastructure‑as‑code principles.
• Excellent communication skills with ability to explain complex technical concepts to diverse audiences.
• Currently possess or be able to obtain within 30 days of hire:
• AWS Cloud Practitioner certification (or higher);
  CompTIA Security+ certification (or higher).

• Familiarity with X12/MILS processing.
• AWS certifications (Solutions Architect, Data Analytics, or similar).
• Background in Agile/Scrum development methodologies.
• Experience with containerization technologies (Docker, ECS, EKS).
• Familiarity with data governance and security best practices.

• Flexible PTO + all Federal holidays off.
• Health, dental, and vision insurance plans.
• Flexible Spending Account (FSA).
• 401(k) with employer match.
• Company‑sponsored life insurance, short‑ and long‑term disability.
• Professional development (training, certifications, conferences).
• Paid cloud developer accounts.
• Referral bonuses.
• HQ office perks (parking / metro reimbursement, nitro coffee & lunches).
• Annual social events (540 Week, hackathon, charity golf tournament, etc.).
• Access to 540's Washington Capitals & Nationals tickets.

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.