Research Engineer, Pre-training Science

Overview

Employer Industry: Social Media and Online Communities

• Salary up to $322,000
• Opportunity to receive equity in the form of restricted stock units
• Comprehensive healthcare benefits and income replacement programs
• Flexible vacation and paid volunteer time off
• Generous paid parental leave and family planning support
• Fully remote work opportunity with access to physical office locations if desired

• Architect and validate Continual Pre-Training (CPT) frameworks for domain adaptation in models
• Lead research into fusing vision and language encoders to process multimodal data
• Formulate data curriculum strategies to optimize community understanding and safety
• Design and scale continuous evaluation pipelines to monitor model capabilities in real-time
• Drive architectural decisions regarding compute allocation and distributed training strategies

• 7+ years of experience in machine learning engineering or research, focusing on LLM pre-training and domain adaptation
• Expert-level proficiency in Python and deep learning frameworks such as PyTorch or JAX
• Deep theoretical understanding of transformer architectures and pre-training dynamics
• Experience with multimodal models and aligning image/video encoders with language decoders
• Demonstrated ability to communicate complex technical concepts to leadership and coordinate across teams

• Published research or open-source contributions in continual learning or efficient fine-tuning
• Experience with graph neural networks or processing tree-structured data
• Proficiency in low-level optimization or distributed training frameworks
• Familiarity with safety alignment techniques and their impact on pre-training objectives

#Social Media #Machine Learning #Career Opportunity #Remote Work #AI Research #Competitive Pay

We prioritize candidate privacy and champion equal-opportunity employment. Central to our mission is our partnership with companies that share this commitment. We aim to foster a fair, transparent, and secure hiring environment for all. If you encounter any employer not adhering to these principles, please bring it to our attention immediately.

We are not the EOR (Employer of Record) for this position. Our role in this specific opportunity is to connect outstanding candidates with a top-tier employer.