How does a text watermark work?
A first-principles investigation of how generation-time text watermarks work, from a weighted coin to Gemma, and where the evidence stops.
I build machine learning systems, from model training and evaluation to applications people use. I write about what I build, break, and learn along the way.
A first-principles investigation of how generation-time text watermarks work, from a weighted coin to Gemma, and where the evidence stops.
Testing if applying Matryoshka Representation Learning (MRL) to tabular entity data could bridge the cost gap, compressing embeddings enough to remain operational while still beating BM25 on corrupted queries.

A production diary of tiered episodic memory in AI agents. Three markdown files, an SQLite database, and a lobster that somehow remembers what you said three days ago.

Four tools, a settings file, and full control - how I built my own AI coding agent with Pi instead of paying $200/month for a CLI that keeps changing.

Practical way of using colbert with ragatouille on modal labs

Practical strategies for implementing and optimizing Retrieval Augmented Generation (RAG) in LLM systems.

Hackathon Experience at Mistral Hackathon in San Francisco



