LLM Integration & CI​/CD Engineer

Location: Bengaluru

Role: LLM Integration & CICD Engineer

Level: Senior Associate

Tower: AI Operations & Platform Support (AI Managed Services)

Experience:

5-10 Years

Key

Skills:

Integration Engineering; APIs/Connectors; CI/CD Pipelines;
Dev Ops;
Secrets/IAM;
Release Management;
Cloud (AWS)

Educational

Qualification:

Bachelor’s degree in Computer Science/IT or relevant field (Master’s or relevant certifications preferred)

Work Location:

Bangalore / Hyderabad

Job Description

As an AC - Senior LLM Integration & CICD Engineer, you will build, operate, and improve integrations and CI/CD pipelines supporting in-scope AI platforms and AI-enabled use cases. You will troubleshoot integration and deployment issues, implement secure and repeatable deployment patterns, coordinate release readiness with change governance, and drive operational improvements to increase reliability and speed.

Key Responsibilities:

1.Integration & Connector Engineering:

- Design, build, and support API-based integrations and connectors across in-scope AI platforms and enterprise systems.
- Troubleshoot integration failures and implement resilient patterns (retries, idempotency, error handling) with appropriate operational telemetry.

2.CI/CD Pipeline Engineering & Operations:

- Build and maintain CI/CD pipelines for in-scope AI workloads and supporting services, ensuring repeatable build, test, and deploy processes.
- Operate deployment pipelines in alignment with client change governance, ensuring safe promotion through environments and strong rollback readiness.
- Improve pipeline reliability and performance by reducing build failures, standardizing templates, and automating validation checks.

3.Release Management & Operational Readiness:

- Coordinate release readiness activities (deployment plans, rollback steps, runbooks, monitoring readiness) to reduce production risk.
- Support change execution and post-release verification to confirm expected behavior, stability, and integration health.
- Partner with incident command leadership during major events to restore service quickly for integration and deployment-related incidents.

4.Secrets Management, IAM & Secure Delivery:

- Implement and support secure secrets handling and access controls (least privilege) for pipelines, integrations, and service accounts.
- Ensure deployment and integration patterns align to applicable security, privacy, and compliance requirements and approvals.

5.Troubleshooting, Diagnostics & Incident Support:

- Provide L2/L3 troubleshooting for pipeline and integration incidents; analyze logs, traces, and configuration to identify root causes.
- Drive corrective actions to prevent recurrence, including changes to pipeline steps, configuration, monitoring, and documentation.

6.Automation & Standardization:

- Automate routine deployment and operational tasks to reduce manual effort and improve consistency (templates, reusable workflows, automated checks).
- Promote standardized integration and deployment patterns to improve maintainability and reduce operational risk across supported workloads.

7.Documentation & Knowledge Management:

- Maintain integration documentation, pipeline runbooks, and troubleshooting guides; ensure knowledge assets stay current as platforms evolve.
- Document operational boundaries, escalation paths, and common failure modes to improve support efficiency and onboarding.

8.Stakeholder Collaboration & Governance Support:

- Collaborate with platform owners, security teams, and service leadership to prioritize improvements and resolve cross-team issues.
- Provide inputs to service reporting on pipeline health, integration incidents, recurring issues, and improvement progress.

9.Quality, Controls & Operational Discipline:

- Follow defined operational processes (incident, request, change) and maintain high-quality ticket hygiene and documentation discipline.
- Proactively identify risks and control gaps in delivery processes and propose mitigations to improve safety and reliability.

10.Continuous Improvement:

- Identify opportunities to improve developer experience and time-to-release while maintaining strong controls and operational reliability.
- Contribute to continuous improvement planning…