Nvidia shrinks LLM memory 20x without changing model weights

Nvidia's KV Cache Transform Coding (KVTC) compresses LLM key-value cache by 20x without model changes, cutting GPU memory costs and time-to-first-token by up to 8x for multi-turn AI applications.
IEEE

Population-Input Memristor Circuit Based on Matrix-Friendly Genetic Algorithm

Abstract: This paper presents the design and implementation of a novel matrix-friendly genetic algorithm (MGA) based population input memristor circuit. Selection, crossover and mutation operations ...
IEEE

Thor: A Non-Speculative Value Dependent Timing Side Channel Attack Exploiting Intel AMX

Abstract: The rise of on-chip accelerators signifies a major shift in computing, driven by the growing demands of artificial intelligence (AI) and specialized applications. These accelerators have ...