BCG Platinion | Principal Architect - AI

Join to apply for the BCG Platinion | Principal Architect - AI role at Boston Consulting Group (BCG).

Locations:
Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit | Houston | Miami | Minneapolis | Nashville | Summit | New York | Philadelphia | Pittsburgh | Durham | Washington

Bose Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. BCG Platinion is a global tech practice that aims to change the game through Architecture, Cybersecurity, Digital Transformation, Enterprise Application, and Risk functions.

• Collaborate across cross‑functional stakeholder groups and existing teams.
• Design sophisticated and robust AI solutions for common business problems.
• Apply deep technologist and AI expertise to drive new solutions.
• Navigate ambiguity and drive decision‑making through unknowns.
• Champion change, onboard teams, and optimize technology best practices.
• Leverage agile methodologies to tackle challenges and implement change.
• Innovate by envisioning novel design patterns for next‑generation AI systems.
• Serve as a subject matter expert in Technology Architecture and AI Platforms.
• Partner with senior client stakeholders, including C‑level executives, to align technology strategy with business goals.

• Bachelor's degree in IT, business administration, computer science, information systems, or a related field (Master’s degree is a plus).
• 10+ years of technology consulting or software engineering experience with >5 years in architecture discipline.
• Strong foundation in software architecture and distributed systems design.
• Experience designing or scaling AI/ML or LLM‑based applications.
• Proficiency in Python, JavaScript, Tensor Flow, Keras, PyTorch, Type Script, or Node.js.
• Knowledge of modern AI frameworks:
  Lang Chain, Lang Graph, Google ADK, Strands, Semantic Kernel, Auto Gen, CrewAI, Llama Index.
• Understanding of Agentic AI capabilities:
  Lang Chain agents, RAG, memory modules, vector DBs, function‑calling, observability, safety, deployment strategies, governance.
• Experience with cloud architecture, data management, API‑based system integration and multi‑cloud containerization (Docker, Kubernetes, Helm, Istio).
• Experience with AI coding tools such as Cursor, Replit, Claude Code, Codex.
• Familiarity with vector databases (Pinecone, QDrant, Cosmos DB, Azure Search) and knowledge graphs (Neo4j).
• Exceptional problem‑solving, communication, and customer orientation.
• Strong technical knowledge, engineering rigor, creative problem‑solving.
• Ability to explain complex tech topics to senior executives.
• Agile mindset, project planning, and execution skills.
• Willingness to travel to client sites as needed.

• Define scalable, low‑latency AI and LLM architectures.
• Design Agentic AI solutions for workflow automation.
• Establish architectural blueprints, governance frameworks, and responsible AI practices.
• Architect hybrid pipelines (batch training + streaming inference) with cost, latency, and risk considerations.

• Develop MVPs or PoCs to test model architectures, RAG flows, and agent orchestration.
• Evaluate emerging frameworks (Lang Chain, Llama Index, Lang Graph, etc.).
• Build solutions using orchestration engines such as n8n, Retool, OpenAI Agent Kit, Microsoft Copilot Studio, AWS Flows.

• Support IT process restructuring and organization change.
• Oversee system performance, observability, and governance during production transition using Lang Smith, Prometheus, Grafana, Evidently, Why Logs, Open Telemetry.
• Define standards for LLMOps (versioning, testing, monitoring).

• Deliver compelling narratives and presentations to both technical and non‑technical audiences.
• Lead workshops with clients and internal teams; provide technical direction to engineering teams.
• Offer mentorship and quality oversight to junior team members.