More jobs:
Job Description & How to Apply Below
Mumbai, Maharashtra (Onsite)
Experience:
5+ years
Employment Type:
Full-time
About the Role:
We’re seeking a Senior Data Engineer with deep expertise in large-scale data scraping and end-to-end data architecture design. This role focuses on building the backbone of our AI-driven systems—from developing responsive, semantic scraping frameworks to architecting robust, scalable data pipelines from the ground up. You’ll play a key role in ensuring that our data infrastructure is intelligent, efficient, and future-ready.
Key Responsibilities:
Design and implement scalable web scraping systems capable of handling high-volume, high-velocity data sources.
Develop responsive and semantic scraping solutions using advanced AI and NLP methods to extract meaningful, context-rich information.
Architect and build data pipelines from scratch, integrating structured and unstructured data across multiple platforms.
Establish reliable, fault-tolerant data architectures for long-term scalability and maintainability.
Integrate scraped data into RAG (Retrieval-Augmented Generation) and other intelligent workflows.
Continuously enhance scraping performance, pipeline efficiency, and data quality through automation and innovation.
Required Skills and Qualifications:
5+ years of experience in data engineering, data scraping, and pipeline development.
Proven track record of building end-to-end data systems from the ground up.
Deep knowledge of web scraping tools (Scrapy, Selenium, Beautiful Soup) and anti-blocking, concurrent scraping strategies.
Strong understanding of AI-driven data extraction, NLP, and semantic enrichment.
Experience implementing RAG pipelines and integrating LLMs with retrieval systems.
Familiarity with cloud infrastructure (AWS/GCP/Azure) and CI/CD best practices.
Why Join Us:
Build cutting-edge, AI-powered data scraping ecosystems at production scale.
Shape the data architecture roadmap for next-generation intelligent systems.
Collaborate with a highly skilled, forward-thinking engineering team.
Competitive salary, challenging projects, and high growth potential.
If you’re passionate about turning large-scale web data into meaningful, AI-ready insights, we want you on our team.
Position Requirements
10+ Years
work experience
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×