Senior AI Engineer (Databricks)

Overview

We are looking for a Senior AI Engineer with deep hands-on Databricks experience to design, build, and deploy AI solutions on the Databricks platform. You will develop LLM-based applications and agents, take them from prototype to production, and deliver reliable, well-governed AI capabilities within an agile team.

Job Description

Key Responsibilities

Design, develop, and deploy AI solutions on Databricks, including LLM-based applications, RAG pipelines, and AI agents

Build and orchestrate agent workflows using frameworks such as LangChain/LangGraph or Databricks Mosaic AI Agent Framewor

Implement retrieval solutions using Databricks Vector Search, embeddings, and well-structured knowledge sources

Deploy and serve models and agents using Databricks Model Serving, with MLflow for tracking, versioning, and registry

Evaluate and monitor AI solutions for quality, accuracy, latency, cost, and safety

Apply governance, access control, and lineage to AI assets using Unity Catalog

Integrate AI solutions with applications and APIs, including apps hosted as Databricks Apps

Manage code in GitHub and follow CI/CD, MLOps/LLMOps, and documentation best practices

Collaborate with data engineers, data scientists, and stakeholders to translate business needs into AI solutions

Required Skills

6–8 years of software, data, or ML engineering experience, with at least 2–3 years of hands-on Databricks experience

Strong Python and good SQL; working knowledge of PySpark

Hands-on experience building LLM applications, RAG, and agents in production

Experience with at least one agent/orchestration framework (e.g., LangChain/LangGraph, Mosaic AI Agent Framework)

Hands-on MLflow, Unity Catalog, Databricks Vector Search, and Model Serving

Experience with REST APIs and Git/GitHub with CI/CD workflows

Strong communication skills and ability to work with international clients

Good to Have

• Databricks Certified Generative AI Engineer Associate or Machine Learning Professional

• Experience with prompt engineering, LLM fine-tuning, and evaluation frameworks

• Experience deploying applications as Databricks Apps (Python, Vue.js)

• Azure services (Azure OpenAI, ADLS Gen2, Key Vault)

• Exposure to Delta Lake and Lakeflow Jobs

Qualifications

• Bachelor's or Master's degree in Computer Science, IT, or a related field.

Skills & Requirements

Databricks, Mosaic AI, Mosaic AI Agent Framework, Unity Catalog, Python, SQL, PySpark, Generative AI, Artificial Intelligence (AI), Large Language Models (LLMs), LLM Application Development, Retrieval-Augmented Generation (RAG), AI Agents, Agentic AI, Agent Workflow Orchestration, LangChain, LangGraph, Databricks Vector Search, Vector Search, Embeddings, Knowledge Base Integration, MLflow, Databricks Model Serving, Model Deployment, Model Tracking, Model Versioning, Model Registry, AI Model Evaluation, AI Monitoring, Model Quality Evaluation, Accuracy Optimization, Latency Optimization, Cost Optimization, AI Safety, Prompt Engineering, LLM Fine-Tuning, Evaluation Frameworks, REST APIs, API Integration, Git, GitHub, CI/CD, MLOps, LLMOps, Databricks Apps, Vue.js, Delta Lake, Lakeflow Jobs, Azure OpenAI, Azure Data Lake Storage Gen2 (ADLS Gen2), Azure Key Vault, Data Governance, Access Control, Data Lineage, Software Engineering, Data Engineering, ML Engineering, Collaboration with Data Scientists, Stakeholder Management, Business Requirements Analysis, Technical Documentation, Agile Methodology, International Client Communication, Databricks Certified Generative AI Engineer Associate, Databricks Certified Machine Learning Professional.

Apply Now

Join Our Community

Let us know the skills you need and we'll find the best talent for you