Tag compressed attention

DeepSeek has unveiled its latest model, DeepSeek-V4, featuring a remarkable one-million-token context window designed to enhance agentic workflows. This release introduces two checkpoints, each optimized for efficiency and performance in handling extensive contextual data.