Senior Data Engineer; Agentic AI

PubX builds next-generation publisher-first agentic advertising infrastructure. Our AI makes real-time, revenue-critical pricing decisions for digital publishers. Our Bid Intelligence uses machine learning to optimize every programmatic ad auction individually, generating measurable revenue uplift for publishers. We’re currently ranked #5 globally in Prebid Analytics Adapter Rankings, and growing.

Digital publishers leave significant revenue on the table because ad pricing is still largely manual, static or simple rule-based. Every ad impression is unique, but most pricing systems treat them the same. PubX's AI analyzes bid-stream data and historical patterns to arrange optimal deals, in near real-time.

As a founding member of Agentic Advertising.org, we're building the next generation of autonomous advertising infrastructure.

Tech:
Python, SQL, Spark, Airflow, dbt, Kafka/Kinesis/SQS, AWS, Terraform/CDK, modern ETL

• Design and maintain high-volume data pipelines (batch + streaming) powering agentic AI features and core product workflows
• Build event-driven components using Kafka and message queues, including idempotency patterns, replay strategies, and backfill mechanisms
• Develop data models and transformation layers (lakehouse patterns, dbt-style modeling) supporting both analytics and ML/AI consumption
• Own data quality and reliability: schema management, validation, lineage, SLAs, and incident response
• Enable AI/ML workflows with robust datasets for training, evaluation, feature generation, and feedback loops from production agents
• Deploy and operate data infrastructure on AWS using infrastructure-as-code

We’re looking for an experienced engineer who has worked on production systems and enjoys solving practical problems with AI.

• Strong data engineering fundamentals: data modeling, partitioning, performance tuning, and cost-aware design for high-volume workloads
• Experience building streaming and event-driven systems(Kafka/queues), including handling late/out-of-order events, backfills, and real-world data edge cases
• Strong SQL + Python skills, and comfort with modern data stack tooling (e.g., Spark, Airflow/Dagster, dbt, warehouse/lakehouse patterns)
• Hands-on AWS experience with production operations for data systems: monitoring, incident response, and security considerations (PII, access control, encryption, auditability)
• Familiarity integrating data with AI/ML and agentic systems: feature pipelines, evaluation datasets, grounding/citations inputs, and feedback capture from agent outcomes

• Make pragmatic decisions balancing speed, quality, cost, and risk trade-offs.
• Communicate technical ideas well in writing and conversation to both technical and non-technical audiences.
• Write clean, well-tested code with thoughtful abstractions that’s easy to extend and operate.
• Learn quickly when things are unfamiliar by prototyping, then hardening and documenting what you ship.

• Experience with AdTech or other high volume real-time systems

This role suits engineers who like a mix of autonomy and collaboration, and who are comfortable working in an environment that’s still evolving.

We’re a distributed team with a growing engineering presence in India, so comfort with async collaboration and clear written communication is important.

We use agentic coding tools heavily (e.g. Cursor and Claude Code) to plan, scaffold, refactor, and debug production code, while maintaining strong engineering judgment and ownership of outcomes.

• What We Offer Competitive salary with meaningful equity
• Fully remote, async-friendly working
• Budget for learning and professional development

Our process is designed to be practical and respectful.

• CV & Profile Review – Relevant experience and background
• Initial Chat (30 mins) – Motivation and role fit
• Technical Interview (60 mins) – Architecture, design choices, and real scenarios
• Practical Exercise + Discussion (60 mins) – A small task related to the role

If you’re interested in building and shaping real systems in a growing product company, at the forefront of AdTech innovation, we’d love to hear from you.

We will process your personal data in accordance with our Recruitment Privacy Notice: (Use the "Apply for this Job" box below)./