#KV Cache

2026

• 07-04 EN

  MosaicKV: Dynamic Two-Dimensional KV Cache Compression for Long-Context LLM Serving — Technical Review

• 07-04 中

  MosaicKV：面向超长上下文LLM服务的动态二维KV缓存压缩——阅读笔记

• 06-27 EN

  JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting

• 06-27 中

  JetSpec：用并行树草稿突破推测解码的扩展上限

• 06-24 EN

  SparDA: Sparse Decoupled Attention for Efficient Long-Context LLM Inference

• 06-24 中

  SparDA：稀疏解耦注意力，让长上下文推理又快又准

• 06-21 EN

  Tutti: GPU-Centric SSD-Backed KV Cache That Finally Makes SSDs Practical for Long-Context LLM Serving

• 06-21 中

  Tutti 阅读笔记：GPU 原生 SSD KV 缓存，让 NVMe 固态硬盘真正可用于长上下文大模型推理

• 06-17 EN

  OScaR: Occam's Razor for Extreme KV Cache Quantization

• 06-17 中

  OScaR：极端 KV 缓存量化的奥卡姆剃刀

• 06-10 EN

  KeepKV: Lossless KV Cache Compression via Electoral Votes and ZIP-Merging

• 06-10 中

  KeepKV：用「选举票」机制和零扰动合并实现无损 KV 缓存压缩

• 06-07 EN

  SlidingServe: SLO-Aware Sliding-Window Scheduling for LLM Inference

• 06-07 中

  SlidingServe：面向LLM推理的SLO感知滑动窗口调度

• 06-03 EN

  KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization — Technical Review

• 06-03 中

  KVQuant：面向千万级上下文的 KV 缓存量化技术——阅读笔记

• 05-28 EN

  Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving

• 05-28 中

  Mooncake：以 KV Cache 为核心的大模型推理服务解耦架构

• 05-21 EN

  SGLang: Efficient Execution of Structured Language Model Programs — Technical Review

• 05-21 中

  SGLang:为 LM 程序而生的前端 DSL + 协同设计运行时 —— 阅读笔记

• 05-10 EN

  Tutti: Making SSD-Backed KV Cache Practical for Long-Context LLM Serving

• 05-10 中

  Tutti：让基于 SSD 的 KV Cache 真正适用于长上下文 LLM Serving

• 05-09 EN

  Queueing Stability for LLM Inference with KV Cache Memory Constraints

• 05-08 EN

  Swift-SVD: Activation-Aware Low-Rank Compression for LLM Weights and KV Cache

• 02-19 EN

  vLLM and PagedAttention: Efficient Memory Management for Large Language Model Serving — Technical Review

• 02-18 EN

  DeepSeek-V2: Multi-head Latent Attention and DeepSeekMoE — Technical Review