Big Data Software Engineer - DataOps Software Leader
Listed on 2026-01-12
-
IT/Tech
Data Engineer, Machine Learning/ ML Engineer, Data Analyst, Data Science Manager
Big Data Software Engineer - Intelligent Data Ops Software Leader
Big Data Software Engineer — Batch & OLAP
OverviewBuild robust batch pipelines and analytical stores for large-scale reporting, experimentation, and ML feature generation.
Responsibilities- Develop cost-efficient batch processing (Spark/Dataproc/EMR) and orchestration (Airflow/Dagster).
- Design lakehouse tables (Iceberg/Delta/Hudi) with compaction, partitioning, and Z-ordering.
- Implement semantic/metrics layers and OLAP acceleration (Big Query/Snowflake/Click House).
- Enforce governance: lineage, access controls, PII handling, and retention policies.
- 4+ years in big data; expert SQL and performance tuning.
- Strong understanding of storage formats, file layout, and query engines.
Andiamo is a globally recognized staffing and consulting firm specializing in placing the top 2% of technology and go-to-market professionals with the world’s largest and most well-known companies.
For over 20 years, we have maintained the status of tier-one vendor for firms such as Amazon, Bloomberg, Palantir, Master Card, Visa, Two Sigma, Citadel, as well as other major financial services firms, elite hedge funds, Google-backed tech start-ups, and major software firms.
Our talent solutions include Permanent Placement, Contract Staffing, Executive Search, and Dedicated Recruiting Services (RPO). Find out more at
Details- Seniority level:
Mid-Senior level - Employment type:
Full-time - Job function:
Engineering and Information Technology - Industries:
Staffing and Recruiting
Referrals increase your chances of interviewing at Andiamo by 2x
New York, NY
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).