More jobs:
Senior AI Infrastructure Engineer
Job in
Boston, Suffolk County, Massachusetts, 02298, USA
Listed on 2026-03-01
Listing for:
Assail
Full Time
position Listed on 2026-03-01
Job specializations:
-
IT/Tech
Systems Engineer
Job Description & How to Apply Below
Focus: Reliability, Performance, Cost Control, and Secure AI Operations
Level: Senior
Experience
- 7+ years in Dev Ops, SRE, or Infrastructure Engineering
- 1–2+ years owning production AI workloads, including GPU-backed inference or large-scale model serving
- Demonstrated ownership of production systems under load, not just "set it up once and move on"
Responsibilities
Scalable Inference & Serving
- Deploy and operate our vLLM-based inference stack serving a custom fine-tuned 14B+ parameter security model
- Optimize Time to First Token (TTFT) and tail latency under concurrent load from our 145-agent swarm
- Manage multi-model routing across specialized functions (code analysis, deobfuscation, reasoning)
- Ensure OpenAI-compatible API availability with
Position Requirements
10+ Years
work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×