Founding Engineer, ML Inference

We're looking for a Founding Engineer, ML Inference with deep expertise in high-performance ML engineering. This is a highly technical, high-impact role focused on squeezing every drop of performance from real-time generative media models.

You'll work across the model-serving stack, designing novel inference frameworks, optimizing inference performance, and shaping Reactor's competitive edge in ultra-low-latency, high-throughput environments. We want to establish new inference frameworks in this domain and you will be able to own this part of our stack.

• • Drive our frontier position on real-time model performance for diffusion models
• • Design and implement a high-performance in-house inference runtime
• • Implement optimizations using torch.compile, custom CUDA kernels, and specialized inference frameworks
• • Optimize neural network models for inference through quantization, pruning, and architectural modifications while maintaining accuracy
• • Profile and benchmark model performance to identify computational bottlenecks
• • Collaborate directly with model partner teams to directly integrate their models into our platform

• • Strong foundation in systems programming, with a track record of identifying and resolving bottlenecks
• • Deep expertise in the ML infrastructure stack:
  • ◦ PyTorch, Tensor
    
    RT, Transformer Engine, Nsight, ONNX Runtime
  • ◦ Model compilation, quantization (INT8/FP16), and advanced serving architectures
• • Working knowledge of GPU hardware (NVIDIA) and the ability to dive deep into the stack as needed
• • Strong understanding of transformer architectures and modern ML model optimization techniques

We are based in-person in San Francisco. We believe the best ideas and work come from being together.

• • Competitive San Francisco salary and meaningful early equity.
• • We sponsor visas. We are committed to working through the process together for the right candidates. If you're currently outside the US, we're also committed to helping you relocate to the US throughout this process.
• • We offer generous health, dental, and vision coverage, and relocation support as needed.

If this sounds like you, we'd love to hear from you.