Advance Data Engineer

Scam Alert : To all Tech Mahindra job aspirants and applications, beware of fraudulent job offers Learn More..

This job posting is for an existing, active vacancy and we are looking to hire Advanced Data Engineer immediately who has experience in Python & Pyspark:

Role Overview:

Baseline:

• Python & PySpark:
  Proficient in both, with strong understanding of software engineering best practices.
• FastAPI is an advantage.
• Data Exploration & Troubleshooting:
  Ability to investigate data quality issues, debug pipelines, and explore datasets beyond surface‑level analysis.
• CI/CD & Git Hub:
  Experience with Git Hub and Git Hub Actions for version control and automation; familiarity with CI/CD practices for testing and deployment.
• Azure & Databricks:
  Hands‑on experience with Azure cloud services and Databricks, including:
• Databricks Jobs, Clusters, Unity Catalog
• Design, build, and maintain robust, scalable, and automated data pipelines for both batch and streaming data ingestion using Databricks Workflows.
• Implement data quality checks, profiling, validation, and root cause analysis to ensure data accuracy and consistency.
• Design and implement data models and architectures that align with business needs and support efficient processing, analysis, and reporting.
• Orchestration & Monitoring
• Use workflow orchestration tools (e.g., Airflow) to automate pipeline execution and manage dependencies.
• Integrate monitoring and alerting mechanisms to track pipeline health and proactively address issues.
• Work in Agile environments, participating in sprint planning, stand‑ups, reviews, and retrospectives.
• Collaborate across teams and be adaptable to rotating responsibilities and changing priorities

The pay range for this role is $100,000 - $120,000 per annum including any bonuses or variable pay. Tech Mahindra also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience and location of the candidate.

AI tools may assist in the recruitment process; however, all hiring decisions are made by the recruitment team based on a comprehensive evaluation of candidates.

Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin, or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations.

Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at ADA_A .

Eligibility / Applicability to proceed with Buddy Referral.

• a) Buddy referrals can be submitted against all Lateral open demand in bands U2 to E1.
• b) Candidature of a Buddy will remain valid for consideration against any opening for a maximum period of three months (90 days) from the date of screening by the Recruiter (Applicant  Date). Thus, associate would be eligible for Referral Fee even if the Buddy doesn't get selected against the opening for which buddy was referred initially but gets selected subsequently (within this six months validity period) for another opening and joins Tech M.
• Referred candidate should have been registered in the Buddy Portal with an Applicant .
• Referrer should have provided correct details pertaining to Buddy being referred including details like IT PAN Card No., Passport Details, Date of Birth, Email  ex-Tech M  without any ambiguity in the Buddy Tool. Profile/s uploaded with incorrect details will not be eligible for the referral.
• Buddy bonus payout will be subject to applicable tax deductions.
• The buddy bonus is payable after the Buddy completes 90 days in TechM subject to fulfillment of all…