Sr​/Machine Learning Engineer, Perception

About Rivian

Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.

As a company, we constantly challenge what's possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.

As a Sr./Staff ML Engineer within Rivian's Perception Team, you will be a core contributor to the architecture, development, deployment, and optimization of advanced machine learning algorithms driving safety-critical, customer-facing features for Rivian's autonomous vehicles. With a focus on onboard perception (including areas like object detection, sensor fusion, cabin or driver monitoring, and multi-modal state understanding), you will have full ownership over the lifecycle of key perception projects, collaborating closely with cross-disciplinary teams spanning autonomy, planning, simulation, and ML infrastructure.

This role is based in Palo Alto, CA.

• Independently own the design, development, testing, deployment, and maintenance of perception ML models and supporting software for autonomous vehicle applications-including both onboard and cloud environments.
• Drive the creation and continuous improvement of production-ready perception models for real-time embedded deployment (object detection, tracking, segmentation, pose estimation, scene understanding, etc.), ensuring robustness, performance, and resilience.
• Architect and build scalable data pipelines and training infrastructure to support ML model iteration with large, complex multi-modal datasets, including auto-labeling and data augmentation capabilities.
• Develop tools and processes to evaluate and measure the performance and health of perception and/or cabin-monitoring systems, and ensure integration with downstream autonomy modules.
• Analyze, debug, and optimize perception system performance, from offline metrics and simulation validation to live, in-vehicle operation, addressing limitations like manual labeling bandwidth, ground truth availability, and real-world heterogeneity.
• Collaborate tightly with teams across machine learning, sensor systems, embedded platform, planning, infrastructure, and data engineering to deliver integrated, customer-impacting autonomous features.
• Share technical direction, mentor junior engineers, publish internal guidance, and help shape Rivian's technical roadmap in perception.
• Stay abreast of state-of-the-art research in machine learning, computer vision, and autonomous driving; drive adoption of best practices and pioneer new approaches where appropriate.

• BS, MS, or PhD in Computer Science, Robotics, Electrical/Mechanical/Aerospace Engineering, or a related technical field.
• 5+ years of experience (Sr.), or 7+ years (Staff), developing and deploying deep learning models for autonomous vehicles, robotics, or other safety-critical, real-time embedded systems.
• Expert proficiency with Python and one or more deep learning frameworks (e.g., PyTorch, Tensor Flow); strong C++ skills for performance-critical, production code.
• Demonstrated experience architecting, training, and evaluating perception models (2D or 3D, including sequential models), with exposure to deployment on real vehicles and/or production robotic systems.
• Track record in building or leveraging complex training infrastructure (cloud and/or cluster-based) and working with large-scale datasets in distributed environments.
• Hands-on experience with several of the following:
  • Vision foundation models, temporal/spatial modeling, attention/transformer architectures, auto-labeling systems, data augmentation for diverse sensor configurations.
  • Sensor signal decoding (camera, radar, lidar), multi-modal sensor fusion, pose/trajectory estimation, action or intent recognition, and state-of-the-art driver/passenger monitoring.
  • System and algorithmic optimization, robust software engineering best practices, and empirical performance analysis.
• Highly effective communicator and team collaborator; demonstrated ability to partner across technical specialties and organizational boundaries to deliver end-to-end solutions.
• Bonus:
  Prior work in cabin monitoring (e.g., gaze estimation, facial expression analysis, action recognition), experience building auto-labeling tools, cloud-based ML ops, or open-source contributions to perception research.

Salary Range for California Based Applicants: $179,000 - $285,000 (actual compensation will be determined based on experience, location, and other factors permitted by law).

Benefits

Summary:

Rivian provides robust medical/Rx, dental and vision insurance packages for full-time employees, their spouse or domestic partner, and children up to age 26. Coverage is effective on the first day of…