DATA & AI ENGINEER · DATABRICKS LAKEHOUSE

End-to-end data & AI, engineered on the lakehouse.

I build the entire stack on Databricks — streaming pipelines, production ML, and LLM-powered agents. From raw data to governed intelligence, in one platform.

Muteeullah Baig, Data and AI Engineer specializing in Databricks Databricks · Data & AI
DatabricksDelta LakeUnity CatalogMLflowMosaic AIVector SearchPySparkLangChainMicrosoft FabricPower BIAzure DatabricksDelta LakeUnity CatalogMLflowMosaic AIVector SearchPySparkLangChainMicrosoft FabricPower BIAzure
01 — How I work

One platform. Every stage.

Most engineers own one slice of the data lifecycle. I own the whole medallion architecture — from ingestion through to the AI layer — so a project doesn't need five specialists to ship.

STEP 01
Ingest
Auto LoaderStreaming + batchData Factory
→
STEP 02
Bronze
Raw DeltaSchema captureLineage
→
STEP 03
Silver
Cleaned · conformedDLT expectationsPySpark
→
STEP 04
Gold
Analytics-readyDatabricks SQLPower BI
→
STEP 05
ML
Feature StoreMLflowModel Serving
→
STEP 06
AI
Vector SearchRAG · AgentsMosaic AI
Bronze → Silver → Gold → Intelligence — designed, built, and governed under Unity Catalog.
5+
years · data & AI
5
platform certifications
82%
best model mIoU
Live
systems in production
Muteeullah Baig portrait
02 — About

I'm a Data & AI Engineer who treats Databricks as home. Over five years I've shipped production statistical models, built enterprise-scale data platforms, and now engineer the full lakehouse — data, ML, and generative AI as one continuous system.

My edge is range with depth: I can stand up a streaming Delta pipeline, register and serve a model with MLflow, and wire an LLM agent over governed data — without handing off between four different roles.

I'm certified across the Databricks and Microsoft Fabric stacks, hold an MS in Artificial Intelligence from LUMS, and care about systems measured on real latency, real cost, and real users.

03 — Selected work

Systems across the data & AI lifecycle.

Lakehouse Text-to-SQL Agent
Agentic AI

A conversational analytics agent that turns natural-language questions into governed SQL over Unity Catalog tables. Built on Databricks with a retrieval layer for schema grounding, a tool-calling agent for query planning, and Model Serving for deployment — so business users query the lakehouse in plain language.

NL → SQL
governed querying
Unity Catalog
schema-grounded
Served
model endpoint
DatabricksMosaic AIUnity CatalogLangChainModel ServingPython
Enterprise RAG Knowledge Assistant
Generative AI · RAG

A retrieval-augmented assistant over an enterprise document corpus, built on Databricks Vector Search and the Foundation Model APIs. Delivers grounded, cited answers with an MLflow-based evaluation harness measuring retrieval quality and answer faithfulness before anything ships.

Grounded
cited answers
Vector Search
semantic retrieval
Evaluated
MLflow harness
Databricks Vector SearchFoundation Model APIsRAGMLflowDelta Lake
Production ML Platform — Train to Serve
ML Engineering · MLOps

An end-to-end MLOps pipeline on Databricks: features engineered into the Feature Store, training tracked in MLflow, models promoted through the Model Registry, and deployed to a serving endpoint with drift monitoring — retraining orchestrated by Databricks Workflows.

Registry
versioned models
Automated
retraining
Monitored
drift detection
MLflowFeature StoreModel ServingDatabricks Workflowsscikit-learn
Medallion Lakehouse Pipeline
Data Engineering

A production ingestion-to-gold pipeline using Delta Lake and Lakeflow declarative pipelines — streaming and batch through bronze, silver, and gold layers with data-quality expectations enforced at each hop.

Delta LakeLakeflow / DLTStructured StreamingAuto Loader
Real-Time Semantic Segmentation
Computer Vision

Benchmarked six segmentation architectures for autonomous navigation and built a Bird's-Eye-View heading controller on the road mask — 82% mIoU at 88 FPS, with a real-time safety decision system.

PyTorchPIDNetLRASPP-MobileNetV3YOLOv8
Cross-Lingual Hate Speech Detection
NLP · Transformers

Fine-tuned XLM-R and mBERT for English-to-Urdu transfer on a 21.7K-tweet corpus, with a fairness analysis exposing a 20× recall disparity across hate sub-categories.

PyTorchXLM-RoBERTamBERTHuggingFace
Minaab — AI Delivery Platform
Full-Stack · LLM

A live delivery platform with a WhatsApp ordering bot powered by an LLM — a rule-based-first, AI-fallback design for reliable natural-language ordering, deployed and running for a real business.

ReactNode.jsGroq · LlamaFirebase
04 — Stack

The tools I build with, day to day.

DATABRICKS & LAKEHOUSE

  • Delta Lake
  • Unity Catalog
  • Lakeflow / DLT
  • Structured Streaming
  • Auto Loader
  • Databricks SQL
  • Workflows

ML & MLOps

  • MLflow
  • Feature Store
  • Model Serving
  • PyTorch
  • scikit-learn
  • Model Monitoring

GENERATIVE AI & AGENTS

  • Mosaic AI
  • Vector Search
  • Foundation Model APIs
  • LangChain
  • RAG
  • LLM Fine-tuning

DATA & ANALYTICS

  • PySpark
  • SQL
  • ETL / ELT
  • Dimensional Modeling
  • Microsoft Fabric
  • Power BI

CLOUD & PLATFORM

  • Azure
  • OneLake
  • Data Factory
  • Git
  • CI / CD

LANGUAGES

  • Python
  • SQL
  • PySpark
  • R
  • DAX
05 — Certifications

Credentialed across both platforms.

DB
Certified Generative AI Engineer — Associate
Databricks
DB
Certified Data Engineer — Associate
Databricks
MS
Fabric Data Engineer Associate — DP-700
Microsoft
MS
Fabric Analytics Engineer Associate — DP-600
Microsoft
MS
Power BI Data Analyst Associate — PL-300
Microsoft
06 — Experience

Production ML, and enterprise data at scale.

MACHINE LEARNING & AI · ~2 years
Sep 2025 — Present
MS in Artificial Intelligence
LUMS
Graduate research across computer vision and NLP — real-time semantic segmentation and cross-lingual transformers. Coursework in deep learning, AI for robotics, and reinforcement learning.
Jun 2021 — Jun 2023
Data Scientist
Afiniti
Built and maintained production statistical models for real-time behavioral pairing at scale; feature engineering, model validation, and live KPI monitoring in Python and R.
DATA PLATFORM & ANALYTICS ENGINEERING · ~3 years
Oct 2025 — Present
Business Intelligence Developer
Systems Limited
Building end-to-end data and analytics solutions for enterprise clients on the Microsoft Fabric stack; automating transformation pipelines and delivering production reporting.
Jul 2024 — Nov 2025
Business Intelligence Developer
British American Tobacco (BAT)
Led a team on a BAT-wide analytics initiative; built and deployed cloud-scale data solutions on Azure across multiple regions and departments.
Sep 2023 — May 2024
Business Intelligence Analyst
Great Computer Solutions
Built ETL pipelines and dimensional data models; managed data security, row-level access, and automated reporting workflows.
07 — FAQ

Quick answers.

What does Muteeullah Baig do?

He's a Data & AI Engineer specializing in the Databricks Lakehouse, building end-to-end systems across data engineering (Delta Lake pipelines), production machine learning (MLflow, Feature Store), and generative AI (RAG and LLM-powered agents) — backed by 5+ years across production data science and enterprise analytics.

Which platforms does he specialize in?

Databricks is the primary platform — Delta Lake, Unity Catalog, MLflow, Mosaic AI, Vector Search, and Lakeflow pipelines. He also brings deep Microsoft data-platform experience with Fabric and Power BI, plus Azure, and works day to day in Python, PySpark, and SQL.

Is he available for hire?

Yes — open to senior Data & AI and ML Engineering roles, including remote and Europe-based opportunities in energy, manufacturing, and industrial data. The fastest way to reach him is by email or LinkedIn, both linked below.

Let's build something intelligent.

Open to senior Data & AI / ML Engineering roles — remote and across Europe. If you're building on the lakehouse, let's talk.