Lead Generative AI Architect; Agentic AI & LLM Systems

Job Title:

Lead Generative AI Architect (Agentic AI & LLM Systems)

Location:

New York, New York, United States

Job Type: Long Term Contract

We are seeking a highly skilled Lead Generative AI Architect with deep expertise in Lang Chain, Lang Graph (1.2.x), and agentic AI design patterns to lead the end-to-end development of intelligent AI agents and multi-agent workflows.

This role combines hands‑on engineering, architecture design, AI evaluation strategy, Dev Ops implementation, and business solutioning. The ideal candidate will act as a subject matter expert and drive AI adoption across the organization.

• Lead end-to-end solutioning of AI agents and multi-agent workflows (Supervisor, Sub-agents, Swarm patterns).
• Design and develop agentic systems using Lang Chain & Lang Graph (1.2.x).
• Implement and manage MCP servers and MCP clients.
• Apply prompt engineering and context engineering techniques to optimize model performance.
• Conduct metric-based and LLM-as-a-judge evaluations of agentic systems.
• Work with advanced Generative AI models including OpenAI (ChatGPT), Anthropic, Microsoft, and Meta (LLaMA).
• Integrate LLMs via APIs and deploy scalable AI solutions using Python and Java.
• Develop AI services using frameworks such as FastAPI and integrate with enterprise platforms.

• Experience with Azure AI Foundry stack.

• Implement multi-threading and asynchronous programming in Python (Async
  
  IO, non-blocking architecture).
• Ensure reliability, scalability, and high performance of AI systems.
• Conduct thorough testing of agents and workflows for accuracy and robustness.

• Manage version control and collaboration using Git Hub.
• Ensure secure handling of API keys, tokens, and credentials.
• Experience with Infrastructure as Code tools (Ansible, Terraform).

• Build business cases and perform process reviews.
• Conduct data analysis and document business requirements.
• Collaborate with cross-functional teams to solve business problems using AI.
• Mentor teams on AI solutioning and prompt design best practices.
• Drive AI enablement sessions, bootcamps, and strategic AI initiatives.
• Execute rapid-response AI projects with measurable business impact.

• 10+ years of overall software development/engineering experience.
• Strong hands‑on experience in:
  • Lang Chain & Lang Graph (1.2.x)
  • MCP servers and clients
  • Agent evaluation frameworks (metric-based & LLM-as-judge)
• Expertise in Python (mandatory);
  Java is a plus.
• Strong understanding of LLM integration and GenAI architecture.
• Experience with Docker, Git Hub, CI/CD pipelines.
• Strong communication and stakeholder management skills.

Thanks

Rakesh Pathak | Lead Recruiter

Phone:

|