Senior AI Coach; AI & LLM Enablement

3 weeks ago Be among the first 25 applicants

You are a highly skilled AI professional who thrives at the intersection of engineering, solution design, and team enablement. You excel at building real-world LLM-powered systems while also mentoring, coaching, and uplifting cross-functional teams. You are passionate about helping organizations adopt Generative AI responsibly and effectively, and you communicate complex AI behaviors in simple, actionable ways. You enjoy working with cutting‑edge models, designing scalable architectures, and empowering others through hands‑on training, paired programming, and internal playbooks.

• Bachelor’s Degree in Computer Science, Software Engineering, Data Science, or equivalent experience (preferred).
• 5+ years of software engineering experience, with 1–3+ years specifically working with Generative AI/LLMs.
• Strong Python engineering skills including API design, testing, CI/CD, and containerization.
• Practical hands‑on experience with LLMs such as OpenAI/Azure OpenAI, Anthropic, Google, and open-source models like Llama or Mistral.
• Proven experience building RAG systems, embeddings, vector stores, tool/function calling, and lightweight fine-tuning (LoRA/PEFT).
• Experience evaluating LLM systems using rubric-based evaluation, prompt regression tests, telemetry/tracing, and A/B testing.
• Familiarity with AI safety and guardrails, including content moderation, prompt injection mitigation, output validation, and PII protection.
• Strong facilitation skills such as leading workshops, training sessions, pair programming, and creating technical enablement materials.
• Excellent communication skills and the ability to explain probabilistic and non-deterministic system behavior.
• Experience with LLMOps/MLOps (experiment tracking, model versioning, monitoring, rollback strategies). (Nice to Have)
• Knowledge of retrieval and data design (chunking, indexing, metadata), vector observability tools (Langfuse, Open Telemetry), and privacy/security frameworks (GDPR, SOC
  2). (Nice to Have)
• Exposure to Azure Cloud, multimodal models, JSON schema outputs, agent orchestration, and product-first thinking. (Nice to Have)
• Advanced English level, as you will collaborate with teams and stakeholders across regions.

• Facilitate discovery workshops to identify, evaluate, and prioritize high-impact Generative AI use cases aligned with business objectives.
• Define technical architectures for LLM solutions, including RAG pipelines, agent/tool orchestration, and structured output workflows, ensuring compliance and security requirements are met.
• Build prototypes and production-grade AI services using LLM APIs and open-source models, applying best practices in scalability, reliability, and cost optimization.
• Implement retrieval pipelines, embeddings, prompt orchestration, function/tool calling, and validation layers to ensure high-quality outputs.
• Establish evaluation frameworks—including prompt tests, rubric scoring, telemetry, tracing, and A/B testing—to measure performance, reliability, and drift.
• Implement safety and governance controls such as content moderation, PII protection, prompt injection mitigation, and red‑teaming practices.
• Create model cards, documentation, usage guidelines, and responsible AI processes to support transparency and compliance.
• Lead training sessions, office hours, and pair‑programming activities to enable engineering teams and uplift internal AI capabilities.
• Develop internal playbooks covering prompting strategies, RAG workflows, evaluation harnesses, and deployment best practices.
• Advise on operating models, LLMOps processes, and organizational readiness for Generative AI adoption.
• Collaborate with product, engineering, data, and compliance teams to define success metrics, milestones, and delivery plans for AI initiatives.
• Document system architectures, runbooks, and technical handover materials to ensure sustainable, long‑term knowledge transfer.

Here at Applaudo Studios values trust, communication, respect, excellence and team work are our keys to success. We know we…