Databricks Engineer

This range is provided by Tata Consultancy Services. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

$80,000.00/yr - $/yr

Direct message the job poster from Tata Consultancy Services

• 7+ years of experience in data engineering with Databricks and Spark
• Strong knowledge of Databricks development, tools and capabilities
• Experience in Design, develop, and optimize ETL/ELT data pipelines using Databricks on AWS.
• Good understanding of AWS native services – S3, Data Sync, DMS, Lambda, SNS, SQS.
• SQL and PySpark : strong command over querying databases and proficiency in PySpark.
• Experience with Delta Lake and building data lakes.
• Familiarity with CI/CD pipelines using tools such as Gitlab, or Code Pipeline.
• Strong analytical and problem-solving skills, with the ability to optimize complex data workflows.
• Excellent communication skills and the ability to work in a fast-paced, collaborative environment
• Ability to drive technical and business conversations.
• Prior experience with coding in a core programming language (i.e., Python, Java, Scala) and willingness to learn a base level of Spark.
• Hands-on expertise with complex proofs-of-concept and public cloud platform(s).
• Accountable for the design and development of new and current systems
• Act as technical lead for medium to large complex project/feature enhancements
• Work with the Product Management team, Project Management, Business and User Experience teams
• to identify and prioritize initiatives and features
• Participate in all grooming and priority setting sessions and accountable for project sizing and estimation
• Work closely with other development teams across organization to troubleshoot issues, performance
• tuning and identify opportunities for seamless integrations across systems
• Works closely with the Production Support team to train, guide and troubleshoot production issues
• Provides coaching and technical guidance for Software Engineers at different levels of experience
• Thrives on working in a fast-paced environment.

#LI-RJ2

Salary Range-$80,000-$120,000 a year

• Seniority level
  
  Mid-Senior level

• Employment type
  
  Full-time

• Job function
  
  Information Technology
• Industries
  
  IT Services and IT Consulting

Referrals increase your chances of interviewing at Tata Consultancy Services by 2x

Medical insurance

401(k)

Apply BELOW