MIT researchers developed Attention Matching, a KV cache compaction technique that compresses LLM memory by 50x in seconds — ...
AI is getting scary good at finding hidden software bugs - even in decades-old code ...