×
Register Here to Apply for Jobs or Post Jobs. X

Senior Agentic AI Modeler

Job in Summit, Union County, New Jersey, 07902, USA
Listing for: Summit Strategic Search
Full Time position
Listed on 2026-02-28
Job specializations:
  • Software Development
    AI Engineer, Machine Learning/ ML Engineer
Salary/Wage Range or Industry Benchmark: 60000 - 80000 USD Yearly USD 60000.00 80000.00 YEAR
Job Description & How to Apply Below

The Senior Agentic AI Modeler is a hands‑on technical expert responsible for designing, building, evaluating, and deploying agentic AI systems that can reason, plan, interact with tools, orchestrate workflows, and autonomously solve complex business problems. This role blends deep LLM expertise, modern agent frameworks, prompt engineering, architectural design, and practical MLOps awareness to build safe, reliable, and high‑performing agentic pipelines. You will work closely with product, engineering, data, and governance teams to translate business needs into intelligent AI agents that deliver measurable outcomes at scale.

If you enjoy pushing the boundaries of what AI agents can do—multi‑step planning, tool use, memory, RAG orchestration, function calling, autonomous workflows, this role is for you.

About the Company:

Our client is a world‑renowned, commercial‑stage biotech powerhouse leveraging high‑scale AWS/Databricks ecosystems to build autonomous AI agents that will help accelerate life‑saving drug discovery and launches.

About the Role:

Agentic System Design & Development
  • Architect and implement autonomous and semi‑autonomous agent workflows using modern frameworks (Lang Chain, OpenAI Assistants, Semantic Kernel, Llama Index, CrewAI, DSPy, etc.)
  • Build agents capable of multi‑step reasoning, task decomposition, planning, and tool execution.
  • Develop tooling ecosystems—function APIs, retrieval endpoints, evaluators, monitoring hooks—for agent orchestration.
  • Prototype, fine‑tune, and optimize LLMs, RAG systems, and multi‑agent architectures for reliability and low hallucination rates.
Modeling & Prompt Engineering
  • Create robust prompt pipelines, templates, and routing strategies for diverse commercial/analytics use cases.
  • Optimize agent behaviors via prompt distillation, chain‑of‑thought design, system message tuning, guardrails, and evaluation frameworks.
  • Use datasets and logs to refine agent behavior through supervised fine‑tuning or RLAIF where applicable.
Solution Integration & Delivery
  • Integrate agents with enterprise systems, APIs, data stores, CRMs, search tooling, and business applications.
  • Implement observability for agent decision‑making: trace logs, tool call audits, success/failure rates, safety events, drift.
  • Partner with engineering and MLOps to deploy agentic systems in secure, scalable production environments.
Quality, Safety, & Governance
  • Ensure agents operate within approved safety, compliance, and privacy constraints.
  • Define repeatable patterns for safe agent behavior: policy enforcement, output validation, citation checking, guardrail triggers.
  • Collaborate with model risk, medical/reg, and product teams to ensure trustworthy outputs.
Collaboration & Thought Leadership
  • Work closely with Product, Data Engineering, MLOps, UX, and Governance teams to shape the roadmap.
  • Stay current with breakthroughs in agent architectures, reasoning models, tool use, and planning systems.
  • Mentor junior modelers and share best practices across the organization.
Qualifications
  • 5–8+ years of experience in ML/AI engineering, NLP/LLMs, or agentic system development.
  • 10+ years of SDLC experience a must.
  • Strong hands‑on experience with LLMs (OpenAI, Anthropic, Meta, Google, Mistral, etc.) and embeddings.
  • Experience applying AI/ML solutions within a Pharmaceutical Commercial or Business Analytics context is a plus.
  • Demonstrated ability to build agent workflows using frameworks such as Lang Chain/Lang Graph
    , Semantic Kernel, Llama Index, CrewAI, OpenAI Assistants API, and DSPy.
  • Proficiency in Python and modern API design.
  • Experience with RAG pipelines
    , retrieval tuning, and vector databases (Pinecone, Weaviate, Chroma, Elastic, etc.).
  • Familiarity with model deployment and cloud ecosystems (Azure, AWS, GCP).
  • Experience creating safety‑aware AI systems with guardrails, evaluation harnesses, and human‑in‑the‑loop reviews.
Equal Opportunity Statement

We are an equal opportunity employer and value diversity. They do not discriminate on the basis of race, religion, color, national origin, gender, gender identity or expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by applicable law.

#J-18808-Ljbffr
Position Requirements
10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)

Job Posting Language
Employment Category
Education (minimum level)
Filters
Education Level
Experience Level (years)
Posted in last:
Salary