Senior Data Engineer; Op AI
Listed on 2026-01-12
-
IT/Tech
Data Engineer, Data Science Manager
About Us
PMAT is an innovative small business founded with a passion for developing forward-leaning solutions from exceptional people that increase the mission's capability. We focus on designing and building impactful digital solutions that utilize modern cloud, data, and software concepts. Our passion is working on complex and progressive challenges such as edge platform computing, containerizing legacy platforms, distributed data platforms, or heterogeneous data analysis.
We recruit, retain, and foster a team motivated to pursue passions, investigate new ways of doing things, and embody an innovative and entrepreneurial spirit.
We believe in being curious about every element of a problem and experiment relentlessly. We foster continuous learning in an environment that encourages positive collaboration and expands our capabilities. We tap into collective intelligence, acknowledging that the most brilliant people may not be in the room. Above all else, we believe that delivering and demonstrating is more potent than a sheet of paper.
We are passionate about mission-centric design and delivering effective capabilities to and for the warfighter.
Whether you’re an experienced engineer or just beginning your career, you’ll work alongside experts who are committed to solving mission‑critical problems. If you’re passionate about using your skills to make a real difference, apply today and become part of a team that’s shaping the future of defense technology!
About the RolePMAT is seeking a Senior Data Engineer to design, build, and operationalize advanced data pipelines and analytics supporting Naval and DoD mission challenges. This role requires deep experience across data engineering, distributed systems, event streaming, cloud data frameworks, and mission‑focused analytics. The Senior Data Engineer will support complex data integration efforts, collaborate with cross‑functional engineering teams, and lead data architecture improvements aligned with operational Navy needs.
Responsibilities- Collaborate with cross‑functional teams to understand and address Navy operational challenges using data pipelines and analytics.
- Design, develop, and implement data pipelines and analytics for naval applications.
- Perform exploratory data analysis, algorithm development, and testing.
- Normalize and structure data to common standards for interoperability.
- Work with multiple data formats, including CSV, JSON, XML, Parquet, and ORC.
- Develop and deploy data pipelines and analytics in real‑world operational environments.
- Deploy, monitor, and optimize data pipelines to ensure high performance and reliability.
- Implement event streaming pipelines using Apache Kafka, AWS Kinesis, Rabbit
MQ, or ZeroMQ. - Utilize distributed computing platforms such as AWS Lambda, Dask, or Spark.
- Leverage cloud‑native tools including AWS S3, RDS, EFS, SNS, and SQS.
- Utilize data pipeline frameworks such as Air Byte, Apache Airflow, dbt, Apache Iceberg, and Snowflake.
- Work with GIS data using ArcGIS, PostGIS, and related tooling.
- Implement containerized environments using Docker or Kubernetes.
- Apply cybersecurity principles in the context of secure DoD data applications.
- Communicate findings and engineering solutions effectively with technical and mission stakeholders.
- At least 10 years of experience as a business analyst, data analyst, data scientist, data engineer, database administrator, geospatial analyst/engineer, machine learning engineer, or software engineer.
- Strong programming skills in Python.
- Programming experience in Go or Rust.
- Proven experience designing, developing, and deploying complex data pipelines.
- Familiarity with data formats including CSV, JSON, XML, Parquet, ORC.
- Familiarity with event streaming technologies:
Kafka, AWS Kinesis, Rabbit
MQ, ZeroMQ. - Experience deploying, monitoring, and optimizing operational data pipelines.
- Expertise in Elasticsearch, Redis, S3, Postgre
SQL, or related data stores. - Experience with AWS data services (EFS, RDS, S3, SNS, SQS).
- Experience with distributed computing: AWS Lambda, DASK, Spark.
- Familiarity with Air Byte, Airflow, dbt, Iceberg, Snowflake.
- Experience integrating and retrieving GIS…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).