Engineer - Software

Title - Sr. Data Engineer

Location – Charlotte NC Onsite

Duration: 12 Months contract with an extension

The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company’s objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/PySpark and AWS tools.

• Provide scoping, estimating, planning, design, development, and support services to a project.
• Identify and develop the technical detail design document.
• Work with developers and business areas to design, configure, deploy, and maintain custom ETL infrastructure to support project initiatives.
• Design and develop data/batch processing, data manipulation, data mining, and data extraction/transformation/loading (ETL pipelines) into large data domains.
• Document and present solution alternatives to clients, which support business processes and business objectives.
• Work with business analysts to understand and prioritize user requirements.
• Design, development, test, and implement application code.
• Follow proper software development lifecycle processes and standards.
• Quality analysis of the products, responsible for defect tracking and classification.
• Track progress and intervene as needed to eliminate barriers and ensure delivery.
• Resolve or escalate problems and manage risk for both development and production support.
• Coordinate vendors and contractors for specific projects or systems.
• Maintain deep knowledge and awareness of technical and industry best practices and trends, especially in technology and methodologies.

• Developer experience specifically focusing on data engineering.
• Hands‑on experience in development using Python and PySpark as an ETL tool.
• Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step Functions, RDS, EKS, etc.
• Experience in databases like Postgres, SQL Server, Oracle, Sybase, etc.
• Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
• Strong technical experience in design (mapping specifications, HLD, LLD), development (coding, unit testing).
• Knowledge in developing UNIX scripts, Oracle SQL/PL‑SQL.
• Experience with data models, data mining, data analysis, and data profiling.
• Experience in working with REST APIs.
• Experience in workload automation tools like Control‑M, Autosys, etc.
• Good knowledge in CI/CD Dev Ops processes and tools like Git Hub, Jenkins.
• Strong experience with Agile/SCRUM methodology.
• Experience with other ETL tools (Data Stage, Informatica, Pentaho, etc.).
• Knowledge in MDM, data warehouse, and data analytics.