Databricks AI Engineer

This person will be responsible for training and enabling the use of the Databricks Genie AI Agent (Prompt-To-SQL tool)

• Genie AI Agent Configuration & Training
  - Experience with Databricks
• Genie AI Agent setup and workspace creation, Ability to configure Genie using system prompts, instructions and sample queries.
• Text to SQL and Text to Code skills
• Train and support stakeholders across departments in adopting and effectively utilizing the Genie agent.
• Collaborate with business users to understand domain-specific data and ensure Genie delivers meaningful insights.
• Fine-tune and optimize the Databricks Genie AI Agent to improve its performance for diverse business scenarios.
• Unity Catalog Integration & Governance
  - Deep understanding of Unity Catalog for managing Data assets, Access policies, and Lineage tracking.
• Ability to link Genie with Unity Catalog to ensure secure, governed access to tables, views, and models.
• Integrate Genie with the organizations utility catalog and ensure its consistent use as a knowledge base.
• Develop documentation, playbooks, and training materials to enable self-service Genie adoption.
• Act as the bridge between technical teams and business stakeholders, translating requirements and feedback into improvements for the AI agent.
• Monitor performance and iterate on agent capabilities to align with evolving business needs. Utilize user feedback loop to improve Genie.

• 3+ years of experience working with Databricks and large-scale data platforms.
• Hands on experience with SQL, RDBMS, programming language including Python, user defined functions (UDFs) and data visualization tools.
• Familiarity with Databricks Genie, MLflow, Unity Catalog, or other Databricks-native tooling , and how they interface with AI agents.
• Familiarity with Prompt engineering and LLMs (Large Language Models) and their application within enterprise environments.
• Excellent communication and collaboration skills able to guide non-technical stakeholders and lead workshops.
• Comfortable working in fast-paced, cross-functional teams.