Speculative decoding speeds up autoregressive LLM inference without changing the target model’s output distribution by using a faster draft model to propose tokens that the larger model verifies in parallel. The article explains the core draft-and-verify algorithm and surveys newer approaches that replace or improve the draft model, including Medusa, EAGLE, DFlash, and DSpark.

• A small draft model generates a candidate block, while the target model evaluates all proposed tokens in a batched forward pass; accepted tokens preserve exact sampling behavior through an adjusted rejection-sampling step.
• Speedups depend on draft quality, target-model latency, proposal length, and acceptance rate—the draft must be substantially cheaper while producing sufficiently likely continuations.
• Medusa adds multiple prediction heads to the target model, while EAGLE, DFlash, and DSpark explore feature-level or more specialized predictors to improve proposals without maintaining a separate full language model.

Cursor explains how to make Git performant and reliable across very large repositories and high-concurrency workloads. The central lesson is to preserve Git’s content-addressed model while optimizing storage, object traversal, and operational hot paths rather than treating Git as an opaque command-line tool.

• Large-scale Git performance depends heavily on packfiles, commit-graph data, object traversal, and keeping repository maintenance off latency-sensitive paths.
• Separating immutable Git objects from mutable references enables efficient caching, replication, and horizontally scalable infrastructure.
• Production systems should profile real Git operations—clone, fetch, checkout, and history queries—and optimize the specific workloads instead of relying solely on default Git behavior.