Senior Software Engineer; Cloud Data Engineering

Technology Partners is currently seeking a talented Senior Software Engineer (Cloud Data Engineering).

Do you have experience building scalable data pipelines using Spark and Azure, and supporting cloud-based data engineering workloads?

Let us help you make your next big career move a reality!

A leading provider of mobility solutions is seeking a Senior Software Engineer to join their Cloud Data Engineering Product Services team. You'll be central to innovating, designing, and developing powerful technology solutions that are redefining how customers rent, buy, and share vehicles globally.

• Create workflows toingest datainto the Enterprise Data Lake.
• Provide initial Tier 1 support for Databricks workflows, Spark streaming applications, and Azure Function applications within the Cloud Data Engineering ecosystem.
• Be part of a shared services team responsible for initial triage of production products.
• Support domain teams' development projects.
• Identify and implement hardening and resiliency opportunities across the environment.
• Collaborate with other engineers to develop newdata pipelines.
• Utilize Microsoft Azure Cloud PaaS technologies to engineer data solutions, optimizing information for better decision-making and customer needs.

• 3+ years of full-lifecycle development experience including testing and data validation.
• Strong understanding of Apache Spark fundamentals, including Data Frames, Spark SQL, and distributed computing.
• Experience with relational databases (Oracle, SQL Server, Postgres, or Teradata).
• Hands-on experience with Azure services such as Azure Databricks, Azure Functions, and Azure SQL.
• Proficiency in developing scalable pipelines using
  
  Python, Scala, or Java.
• Strong troubleshooting skills, including debugging multi-threaded applications.
• Familiarity with Databricks work spaces, clusters, notebooks, and job orchestration.
• Familiarity with CI/CD pipelines (Git Hub Actions, Azure Dev Ops).
• Excellent written and verbal communication skills.
• Ability to collaborate in a team environment as well as work independently.
• Must reside in St. Louis, MO or surrounding areas.
• Must be authorized to work in the U.S. without sponsorship.
• Must be able to work within U.S. Central Time business hours.
• Most critical skill/experience:
  
  Hands-on expertise with Apache Spark and Azure-based data engineering pipelines(core to the role’s daily responsibilities and required for both development and production support).

• Bachelor’s degree in Computer Science, CIS, MIS, or related field.
• Experience with big data solutions and No
  
  SQL databases.
• Experience working with
  
  ADLS Gen2, Blob Storage, Delta Lake, or Cosmos DB.
• Knowledge of change data capture (CDC), SCD1, or SCD2 incremental processing patterns.
• Experience developing and supporting Azure Functions and APIs.
• Background in Azure, AWS, or other public cloud platforms.
• Experience with Event Hubs, Data Factory, Dev Ops tooling, or large-scale ingestion pipelines.
• Previous experience in the vehicle rental or fleet management domain.
• Prior experience leading large-scale or enterprise-level engineering projects.

$49.00 - $70.00 /hr.

We are interested in every qualified candidate who is eligible to work in the United States. However, we are not able to provide sponsorship at this time or accept candidates who would require a corp-to-corp agreement.

If this position sounds like you,
WE SHOULD TALK!

Your better future is ready, and we want to put the right tools in your hands to get you there. Let's go!

Senior Software Engineer, Cloud Data Engineering, Azure, Spark, Databricks, Data Lake, Data Pipeline, Data Ingestion, Data Validation, ETL

Looking for more opportunities with Technology Partners? Check out !

All offers of employment at Technology Partners are contingent upon clear results of a thorough background check and drug screening that meet corresponding laws and regulations at the city, state and federal level.

Pay ranges are influenced by candidate qualifications, experience, and role specifics, with the actual rate determined considering skills, market conditions, and are subject to change by the employer; pay negotiations follow all state and federal legal guidelines.