Generative AI Software Engineer Global Investment Firm

Overview

GENERATIVE AI SOFTWARE ENGINEER - Global Investment Firm

J Harlan Group is currently conducting a search for a GENERATITIVE AI SOFTWARE ENGINEER at a prominent Global Investment Firm in NYC.

Technology is foundational to everything this firm does. They are seeking exceptional engineers with a strong computer science background and hands-on experience building Generative AI systems
. As a Software Developer specializing in GenAI, you will design and develop the firm’s next generation of generative AI applications and underlying infrastructure—helping make AI accessible, reliable, and impactful for both technical and non-technical users across the organization.

You will work alongside highly talented engineers, quants, and domain experts to create advanced, data-intensive AI systems. This is a role for individuals who enjoy building real, production-grade AI/ML systems, experimenting with cutting-edge technologies, and influencing the adoption of generative AI at scale.

The firm values individuals who are agile, intellectually curious, creative, and hands-on
, and who thrive in a fast-paced, collaborative environment.

As a Generative AI Software Engineer, you will help design, build, and scale the firm’s GAI capabilities.

Responsibilities include:

Core GenAI Engineering

• Develop and maintain shared generative AI infrastructure
  , including internal LLM platforms, AI orchestration layers, and firm-wide tools enabling safe, scalable model usage.
• Build foundational components such as vector databases, embedding pipelines, LLM gateways, evaluation frameworks, and retrieval systems to support AI-powered applications across the firm.
• Leverage state-of-the-art cloud models (OpenAI, Anthropic, AWS Bedrock, etc.) to build scalable, high-availability AI services.

AI Product Development

• Work on greenfield GenAI applications
  , from concept to prototype to production deployment, tailored to internal users such as researchers, technologists, investment teams, and operations groups.
• Integrate LLMs with internal knowledge sources, data stores, ontologies, and documentation systems to create intelligent, context-aware tools.

Experimentation & Innovation

• Prototype and evaluate new models, techniques, and frameworks—such as RAG, multi-agent systems, and model-to-model orchestration—and collaborate with colleagues to determine where they can create real business value.
• Conduct experimentation, benchmarking, and quantitative evaluation of GenAI solutions to guide design decisions and ensure reliability and accuracy.

Cross-Functional Collaboration

• Partner closely with engineering teams, quants, operations, and business stakeholders to understand workflows and design AI solutions aligned with firm needs.
• Make AI approachable for diverse user groups by building intuitive, high-quality interfaces and abstractions for using LLMs safely and effectively.

IDEAL CANDIDATE PROFILE:

The ideal candidate combines excellence in software engineering with a deep interest in AI/ML and a practical, experimental approach to generative AI.

Technical Qualifications

• Strong computer science fundamentals, including algorithms, systems, and data structures.
• Hands-on experience with LLMs, embeddings, RAG pipelines, vector databases, or related GenAI systems
  .
• Deep comfort building production-quality software in Python or other high-level languages.
• Experience with cloud AI providers, model APIs, or distributed / scalable architectures.

Academic & Cognitive Strength

• Historically, successful developers at the firm have been top performers in their academic programs (CS, EE, Math, Physics, etc.).
• Ability to reason quantitatively and analytically in unfamiliar domains.

Mindset & Cultural Alignment

• A “tinkerer’s mindset”—curious, hands-on, eager to experiment with new models and techniques.
• Thrives in a collegial, collaborative, fast-paced environment.
• Strong ownership mentality: desire to build systems that matter, not just prototypes.
• Excellent communication skills and the ability to work with diverse users—including traders, researchers, engineers, and investment professionals.

An individual who loves solving deep and complex technical and…