Lead Software Engineer

** Our Purpose
*** Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
*** Title and Summary**### Lead Data Engineer### At Mastercard, we’re shaping the future of data integrity and trust to empower organization wide Data and Analytics platforms. We are looking for a hands-on Data Engineer with strong software engineering skills to design and implement scalable, cloud-based solutions that ensure the accuracy, consistency, and reliability of our data pipelines. This role is highly technical—about 70% coding—and will evolve to lead AI-driven data processing initiatives.  

If you’re passionate about building robust data systems, working with cutting-edge technologies like Databricks, PySpark, and AWS, and want to make a global impact, we’d love to hear from you.
What You’ll Do  Develop & Optimize:
Build and maintain data processing and data quality frameworks using PySpark, Databricks, and Python.  Design & Deploy:
Architect and implement ETL/ELT pipelines leveraging AWS services (S3, Glue, Lambda, Redshift) and streaming data solutions.  Monitor & Automate:
Implement data quality checks, anomaly detection, and workflow orchestration using Apache Airflow, AWS Step Functions, and Unix shell scripting.  Collaborate:
Work closely with data engineers, scientists, and business stakeholders to define standards and resolve data issues.  Lead & Mentor:
Provide technical guidance to junior engineers and contribute to best practices across the team.  Future Focus:
Drive adoption of AI-based tools for anomaly detection and predictive data quality improvements.
What We’re Looking For  Required Skills & Experience  Strong software engineering background with experience in data engineering roles.  Proficiency in:  PySpark, Databricks, and Python for pipeline development.  AWS cloud services (S3, Glue, Lambda, Redshift).  

Working experience of Graph databases and G-Sql.  Workflow orchestration tools (Apache Airflow, AWS Step Functions).  Advanced SQL for validation and reconciliation.  Ability to design and deploy solutions for streaming and batch data.  Excellent problem-solving and communication skills.
Nice-to-Have  

Experience with AI/ML-based anomaly detection.  Exposure to CI/CD pipelines and Dev Ops practices.  Exposure to master data management platform  Knowledge of Scala or advanced Python.
Work on global-scale data systems impacting millions of transactions daily.  Be part of a forward-thinking team embracing AI and next-gen data technologies.  Opportunities for career growth and continuous learning.### Mastercard is a merit-based, inclusive, equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

We hire the most qualified candidate for the role. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact reasonable and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.###

** Corporate Security Responsibility
** All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
* Abide by Mastercard’s security policies and practices;
* Ensure the confidentiality and integrity of the information being accessed;
* Report any suspected information security violation or breach, and
*…