Senior Data Platform Engineer

Senior Data Platform Engineer – Weights & Biases

Join to apply for the Senior Data Platform Engineer – Weights & Biases role at Weights & Biases.

Core Weave, the AI Hyperscaler™, acquired Weights & Biases to create the most powerful end‑to‑end platform to develop, deploy, and iterate AI faster. Since 2017, Core Weave has operated a growing footprint of data centers covering every region of the US and across Europe, and was ranked as one of the TIME
100 most influential companies of 2024. By bringing together Core Weave’s industry‑leading cloud infrastructure with the best‑in‑class tools AI practitioners know and love from Weights & Biases, we’re setting a new standard for how AI is built, trained, and scaled.

The integration of our teams and technologies is accelerating our shared mission: to empower developers with the tools and infrastructure they need to push the boundaries of what AI can do. From experiment tracking and model optimization to high‑performance training clusters, agent building, and inference at scale, we’re combining forces to serve the full AI lifecycle – all in one seamless platform.

Weights & Biases has long been trusted by over 1,500 organizations – including AstraZeneca, Canva, Cohere, OpenAI, Meta, Snowflake, Square, Toyota, and Wayve – to build better models, AI agents and applications. Now, as part of Core Weave, that impact is amplified across a broader ecosystem of AI innovators, researchers, and enterprises.

As we unite under one vision, we’re looking for bold thinkers and agile builders who are excited to shape the future of AI alongside us. If you're passionate about solving complex problems at the intersection of software, hardware, and AI, there’s never been a more exciting time to join our team.

• Help business partners set goals, make decisions, and understand the levers to achieve their goals.
• Build reporting to keep the business attuned and aligned.
• Build datasets and pipelines to support self‑service analysis.
• Train models to understand our customer growth, churn risk, and detect spam and abuse.
• Explore novel benchmarks and recommendations for model training.
• Build and maintain a massive data platform to power it all.

• Partner with other Data Platform Engineers and Data Scientists to expand and maintain our data platform.
• Partner with core engineering to improve our product telemetry.
• Eventually, join our on‑call rotation for the data platform.
• Strategic goals for the team over the next 12 months:
  • Migrate data build tools to improve efficiency and performance.
  • Build a robust internal data catalog and semantic layer to support self‑service analytics.
  • Build an internal AI agent for addressing common data workflows.
  • Lay the foundations for internal AI applications built on top of our operational data.

• Deep knowledge (practical and theoretical) of data engineering and the accompanying workflows.
• History of writing easy‑to‑follow code and effective documentation for your projects.
• Expert knowledge of data orchestration/data pipeline tools (dbt, dagster, airflow, etc).
• Experience working with large and high‑demand data warehouses/platforms, multi‑PB scale, and extreme business demand for the systems.
• Expert knowledge and understanding of web apps and best practices for logging and event instrumentation.
• Ability to clearly communicate your ideas to folks across a range of backgrounds and levels of technical knowledge.

• Work well in a self‑directed environment and proactively find ways to improve processes and collaborate with team members or engaged users.
• Enjoy connecting with real users daily, helping them solve issues, and understanding good patterns for using our tools.
• Show a kind, thoughtful tone that makes users feel appreciated and connected to our team.
• Theoretical or practical knowledge of machine learning workflows and terminology.

We work hard, have fun, and move fast! We’re in an exciting stage of hyper‑growth that you will not want to miss out on. We’re not afraid of a little chaos, and we’re constantly learning. Our team cares deeply about how we build our product and how we work together, which is represented through our…