Jay Shah

Senior Data Scientist • 6sense • AI Applications & Foundational Models

About Me

Senior Data Scientist at 6sense. I train foundational models with custom embeddings to power high-scale intent intelligence, deploy model explainability in production, and build contextual knowledge graphs linking buyer personas and intent signals. I also architect LLM agent evaluation frameworks used across the engineering and product organizations.

Previously at Avathon, I shipped LLM/RAG systems, MCP-powered agent platforms, and anomaly detection products across energy domains. Led foundation-model MLOps, cut release cycles by 45%, and built an agent platform with MCP tools powering 20+ workflows. Before that: RAG compliance agents, solar-storage anomaly detection saving $500k+, and forecasting systems.

I did my graduate research at Texas A&M under Dr. Yu Ding, working on wind energy failure prediction. That is where I learned that models in production behave very differently from models in notebooks.

Outside work: DataKind Ambassador (student dropout prediction with John Jay College), Gujarati Llama (fine-tuned Llama-2 for a language with almost no open datasets), and too many side projects to list cleanly.

I write about what I build. If something is on this site, it actually shipped.

Outside the Terminal

Cricket over everything else. Tea, not coffee, always. I follow Sadhguru's work and have a consistent yoga practice; it is the one thing that survives a newborn's sleep schedule.

Deeply interested in Indic languages and culture. Gujarati Llama started as a personal obsession before it became a project. I believe the next wave of AI needs to work for the billion people whose first language is not English.

I read across domains: systems thinking, philosophy, energy policy. The best ML insights I have had came from outside ML entirely.

Skills

Data Science & Machine Learning

Predictive Modeling Time Series Forecasting Anomaly Detection Deep Learning CNN RNN LSTM Transformers LLM Fine-tuning RAG Agentic Systems Agent Evaluation Hyperparameter Tuning Feature Engineering

Libraries & Frameworks

PyTorch TensorFlow Scikit-learn XGBoost DSPy Transformers LangChain LlamaIndex ColBERT MCP

Cloud & Data Engineering

AWS GCP Azure Apache Airflow Dask Pandas Spark ETL Pipelines

MLOps & Development

MLflow BentoML Modal Docker Kubernetes Git FastAPI Flask CI/CD Python SQL Bash JavaScript

Honors & Awards

Winner at Ragathon by LlamaIndex (Feb 2024)
Outstanding Master's of Science Student (Apr 2019)
2nd Runner-up at Texas Datathon by Citadel (Feb 2018)

Experience

6sense — Senior Data Scientist (Feb 2026–Present). Trained foundational models with custom embeddings for intent intelligence, shipped model explainability in production, built contextual knowledge graphs, and architected an org-wide LLM agent evaluation framework.
Avathon — Data Scientist III (Jan 2022–Jan 2026), Data Scientist II (May 2021–Dec 2021), Data Scientist (June 2019–May 2021)
DataKind — Data Ambassador (Jan 2022–Sep 2022)
Texas A&M University — Graduate Research Assistant (Jan 2019–May 2019)
Utilities and Energy Services — Graduate Student Analyst (Dec 2017–Jun 2018)

Education

Texas A&M University — M.S. in Industrial and Systems Engineering, minor in Applied Statistics (2017–2019)
Gujarat Technological University — B.E. in Mechanical Engineering (2013–2017)

Patents

Calculating energy loss during an outage — US20230213560A1, Filed Dec 30, 2021
Predicting energy production for energy generating assets — US20230214703A1, Filed Dec 30, 2021
Dimension Measurement Using Image Processing — IN 201721044402, Filed Dec 11, 2017

Languages

English, Hindi, Gujarati, German (elementary)

GitHub LinkedIn Hugging Face Resume