Data Engineer – PySpark & Python IRC

Lead Software Engineer

Designation: Lead Software Engineer

Function: Engineering

Experience: 5-10 years

Location: United States - Charlotte, NC

Skills: Apache Spark / PySpark, AWS, AWS S3, Logical Thinker, Python, SQL

Global Logic estimates the starting pay range for this role to be performed in Charlotte, NC to be $95K to $100K and reflects base salary only and does not include additional performance-linked variable compensation, benefits etc that may be applicable for the role. This pay range is provided as a good faith estimate and the amount offered may be higher or lower.

Global Logic takes many factors into consideration in making an offer, including candidate qualifications, work experience, operational needs, travel and onsite requirements, internal peer equity, prevailing wage, responsibilities, and other market and business considerations.

• Strong hands‑on experience with PySpark and Python, especially in designing and implementing scalable data transformations.
• Solid understanding of Object‑Oriented Programming (OOP) principles and design patterns.
• Proficient in SQL, with the ability to write complex queries and optimise performance.
• Strong problem‑solving skills and the ability to troubleshoot complex data issues independently.
• Excellent communication and collaboration skills.

• Design, develop, and optimise large‑scale data pipelines using PySpark and Python.
• Implement and adhere to best practices in object‑oriented programming to build reusable, maintainable code.
• Write advanced SQL queries for data extraction, transformation, and loading (ETL).
• Collaborate closely with data scientists, analysts, and stakeholders to gather requirements and translate them into technical solutions.
• Troubleshoot data‑related issues and resolve them in a timely and accurate manner.
• Leverage AWS cloud services (e.g., S3, EMR, Lambda, Glue) to build and manage cloud‑native data workflows (preferred).
• Participate in code reviews, data quality checks, and performance tuning of data jobs.

Culture of caring. At Global Logic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.

Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career h our Career Navigator tool as just one example, Global Logic offers a rich array of programs, training curricula, and hands‑on opportunities to grow personally and professionally.

Interesting & meaningful work. Global Logic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem‑solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting‑edge and impactful solutions shaping the world today.

Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!

High‑trust organization. We are a high‑trust organization where integrity is key. By joining Global Logic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

Global Logic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward‑thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.

Explore our services, industries, career opportunities, and more.