×
Register Here to Apply for Jobs or Post Jobs. X

Sr Data Engineer

Job in St. Louis, Saint Louis, St. Louis city, Missouri, 63105, USA
Listing for: TechDigital Group
Full Time position
Listed on 2026-01-12
Job specializations:
  • IT/Tech
    Data Engineer, Cloud Computing
Salary/Wage Range or Industry Benchmark: 60000 - 80000 USD Yearly USD 60000.00 80000.00 YEAR
Job Description & How to Apply Below
Location: St. Louis

The Data Engineer will work iteratively on the cloud platform to design, develop and implement scalable, high performance solutions that offer measurable business value to customers.

Responsibilities
  • Data Solutions: Design and implementation of data pipelines using GCP services.
  • Manage Deployments with Helm and Kubernetes: Oversee containerized deployments of data applications on Kubernetes Engine using Helm for package management, ensuring efficient orchestration of services.
  • Automation with Jenkins: Implement CI/CD pipelines using Jenkins to automate data pipeline deployment, testing, and integration with other services, ensuring quick iterations and deployments.
  • Develop and Optimize Pipelines: Write efficient Python and SQL scripts to build data pipelines and ETL/ELT processes. Continuously monitor and optimize data workflows for performance and cost-effectiveness.
  • Data Integration and Orchestration: Design workflows to integrate data from various sources using GCP services, and orchestrate complex tasks with Cloud Composer (Apache Airflow).
  • Security and Compliance: Ensure data security and compliance by implementing IAM policies, encryption, and other security measures in GCP, adhering to best practices for handling sensitive data.
  • Collaborate Across Teams: Work closely with application developers, data architects, and business stakeholders to define and deliver robust data-driven solutions. Provide technical leadership and ensure alignment between business and technical objectives.
  • Monitoring and Logging: Set up monitoring, logging, and alerting using Cloud Monitoring (formerly Stackdriver), Datadog, or other tools to ensure visibility into pipeline performance and quickly identify and resolve issues.
  • Skills
  • Google Cloud Platform (GCP) Tools: (Preferred) - Big Query, Cloud Storage, Dataflow, Cloud Functions, Pub/Sub, Cloud Run, Cloud Composer (Airflow), Cloud Spanner, Bigtable.
  • Container Orchestration: Kubernetes (preferred on GKE) and Helm for managing and deploying containerized applications.
  • CI/CD and Automation: Jenkins for building CI/CD pipelines to automate deployment and testing of data pipelines.
  • Programming

    Languages:

    Proficient in Python for data processing and automation, SQL for querying and data manipulation. Experience with Java is a plus.
  • Dev Ops Tools: Familiarity with Terraform or Deployment Manager for Infrastructure as Code (IaC) to manage GCP resources.
  • Monitoring and Logging: Experience with Cloud Monitoring, Datadog, or other monitoring solutions to track pipeline performance and ensure operational efficiency.
  • Data Engineering

    Skills:

    Expertise in ETL/ELT pipelines, data modeling, and data integration across large datasets.
  • Strong understanding of data warehousing and real-time data processing workflows.
  • Strong communication skills to work effectively with cross-functional teams and mentor junior developers. Proven ability to lead in an Agile environment.
  • 3+ years of experience as a data engineer, with hands-on experience in Kubernetes, Helm, Python and Jenkins.
  • Strong experience building and optimizing data pipelines and services in any cloud platform.
  • Proficiency in Python and SQL. Familiarity with Java and Docker is a plus.
  • #J-18808-Ljbffr
    To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
    (If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
     
     
     
    Search for further Jobs Here:
    (Try combinations for better Results! Or enter less keywords for broader Results)
    Location
    Increase/decrease your Search Radius (miles)

    Job Posting Language
    Employment Category
    Education (minimum level)
    Filters
    Education Level
    Experience Level (years)
    Posted in last:
    Salary