Data Engineer

Job Description:

Data Engineer - Santa Clara, CA (Full-Time Employment)

We’re seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and transform terabytes of data. In this role, you’ll collaborate closely with data scientists and other software engineers to ensure that our data infrastructure is scalable, reliable, and cost-effective.

$/yr - $/yr

Annual Bonus, Sign‑on bonus, and RSUs

• 3–5 years of professional experience designing and operating production data pipelines at scale.
• Containerization & Orchestration:
  Expertise with Docker, Kubernetes, and Helm.
• Workflow Management:
  Hands‑on experience building DAG‑based pipelines in Apache Airflow.
• Programming:
  Strong proficiency in Python for data engineering tasks.
• Distributed Frameworks:
  Practical experience with Dask or Apache Spark for large‑scale data processing.
• Cloud Fundamentals:
  Familiarity with deploying and managing services in a cloud environment.
• Compiled
  
  Languages:
  
  Experience writing data services in Go or Rust.
• GCP Proficiency:
  Hands‑on with Google Cloud services (e.g., Pub/Sub, Big Query, Cloud Storage, GKE). Equivalent experience in other public cloud providers is fine.
• ML Pipelines:
  Exposure to deploying cross‑cluster model‑training workflows using Ray or similar frameworks. Infrastructure as Code:
  Familiarity with Terraform for deployment.
• Security & Compliance:
  Knowledge of data governance, encryption, and role‑based access control.

• Experience with Go programming language.
• Familiarity with acceleration frameworks such as RAPIDS or Spark.
• Knowledge of cloud platforms (AWS, GCP, Azure).
• Experience with data version control and MLOps practices.

• Medical insurance
• Vision insurance
• 401(k)
• Paid maternity leave
• Paid paternity leave

Mid‑Senior level

Full‑time

Computer and Network Security and Technology, Information and Media

Referrals increase your chances of interviewing at Insight Global by 2x.