Software Engineer - Model Serving Infrastructure - USDS

Software Engineer - Model Serving Infrastructure - USDS

Responsibilities

• Responsible for the design and implementation of distributed inference infrastructure for feeds, ads and search ranking models.
• Responsible for building monitoring/managing tools to oversee the reliability and scalability of online inference servers.
• Responsible for triaging system inefficiency and bottlenecks and improving system performance.
• Responsible for building tools to analyze bottlenecks and sources of instability and then design and implement solutions.
• Responsible for collaboration with product teams and providing general solutions to meet their requirements.

Qualifications

Minimum Qualifications:

• Bachelor's/Master's degree in Computer Science, Computer Engineering, or related fields or equivalent years of experience in a software engineering role.
• Proficient in C/C++/CUDA, and have solid programming skills.
• Familiar with deep learning serving frameworks (Tensor Flow Serving/TorchScript).
• Experience in GPU performance optimization.

Preferred Qualifications:

• Experience contributing to an open sourced machine learning framework (Tensor Flow / Jax / PyTorch / TorchScript / MXNet / Tensor
  
  RT).
• Experience in developing and deploying large-scale systems.
• Strong background in one of the following fields:
  Hardware-Software Co-Design, High Performance Computing, ML Hardware Acceleration (e.g., GPU/RDMA) or ML for Systems.
• Ability to work independently and complete projects from beginning to end and in a timely manner.
• Good communication and teamwork skills to clearly communicate technical concepts with other teammates.

As a condition of employment, all successful candidates must be able to establish authorization to work in the United States. For this position, the Company does not provide sponsorship or any immigration-related benefits.

Tik Tok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security (“USDS”) is a subsidiary of Tik Tok in the U.S. This new, security‑first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep U.S. users safe. Our focus is on providing oversight and protection of the Tik Tok platform and U.S. user data, so millions of Americans can continue turning to Tik Tok to learn something new, earn a living, express themselves creatively, or be entertained.

The teams within USDS that deliver on this commitment daily span across Trust & Safety, Security & Privacy, Engineering, User & Product Ops, Corporate Functions and more.

On‑site presence across teams allows the company to operate with greater speed, alignment, and agility — especially in areas like real‑time decision‑making, team development, and integrated execution. As such, the company is shifting from a hybrid work model to a fully in‑person schedule up to 5 days a week.

Inspiring creativity is at the core of Tik Tok’s mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We’re resilient and embrace challenges as they come. By constantly iterating and fostering an “Always Day 1” mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users.

When we create and grow together, the possibilities are limitless. Join us.

Tik Tok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At Tik Tok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many…