Senior AI​/ML Infrastructure Engineer

At Mitratech, we are a team of technocrats focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions. We are a close-knit, globally dispersed team that thrives in an ecosystem that supports individual excellence and takes pride in its diverse and inclusive work culture centered around great people practices, learning opportunities, and having fun! Our culture is the ideal blend of entrepreneurial spirit and enterprise investment, enabling the chance to move at a rapid pace with some of the most complex, leading-edge technologies available.

For over 35 years, the experts at Mitratech have been focused on solving the complex needs. Today, we serve 20,000 client companies of all sizes globally, representing 30% of the Fortune 500 and over 500,000 users in over 160 countries.

As we continue to grow, we’re always looking for resourceful, enthusiastic, and fresh perspectives. Join our global team and see what makes Mitratech a truly exceptional place to work!

Given our continued growth, we always have room for more intellect, energy, and enthusiasm - join our global team and see why it's so special to be a part of Mitratech!

Job Overview

Responsibilities

• Design, deploy, and maintainscalable and secure infrastructuresupporting AI and ML workloads.

• Build and maintainAWS cloud environmentsfor compute (EC2, ECS/EKS, Lambda), storage (S3, EFS, FSx), and networking (VPC, Transit Gateway, Private Link, Route 53, load balancers).

• Implementsecurity best practicesusing IAM, KMS, Secrets Manager, Guard Duty, and Security Hub.

• Support and optimizeAI/ML workloadsacross AWS services (Sage Maker, Bedrock, Batch, Step Functions).

• Develop and maintainInfrastructure as Code (IaC)using Terraform, AWS CDK, and Cloud Formation.

• Managecontainerized workloadsand orchestration platforms (Docker, EKS, Fargate), including GPU scheduling and scaling.

• Set up and maintainmonitoring and observabilityframeworks using Cloud Watch and Open Telemetry.

• Build and manageCI/CD pipelines(Circle
  
  CI, Git Hub Actions, Git Lab CI) for infrastructure automation and ML/Gen AI deployments.

• Collaborate withML and Generative AI teamsto scale models, optimize performance, and design efficient prompt or inference pipelines.

• DeveloprunbooksandSOPsfor AI service deployment, troubleshooting, and performance optimization.

• Ensuresecurity, compliance, and data protectionacross AI datasets and environments.

Required Skills & Experience

• Strong proficiency inLinux administrationand systems-level troubleshooting.

• Deep expertise inAWS cloud services, with experience in compute, storage, networking, and security domains.

• Proficiency incontainer orchestration(Kubernetes/EKS) andinfrastructure automationtools.

• Hands-on experience withIaC toolssuch as Terraform, AWS CDK, or Cloud Formation.

• Familiarity withmonitoring, logging, and observabilitystacks (Prometheus, Grafana, Open Telemetry).

• Experience implementingCI/CD pipelinesfor automated deployment and testing.

• Understanding ofAI/ML concepts, including model deployment, inference scaling, and LLM performance tuning.

• Working knowledge ofsecurity best practices, IAM roles, encryption, and compliance controls.

• Excellentcollaboration and communicationskills to partner with ML engineers, data scientists, and product teams.

Education:

• A Master’s degree in Machine Learning, Computer Science with a preference for specialization in the NLP domain.

We are an equal-opportunity employer that values diversity at all levels. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity, disability, or veteran status.