Pythons are moving north in Florida. Is Brevard County next?

Pythons are spreading north in Florida, adapting to cold by using burrows. Scientists warn Brevard County is at risk.
The New York Times

This Is What Will Ruin Public Opinion Polling for Good

Dr. Weatherby is the director of the Digital Theory Lab at New York University. Dr. Recht is a professor of electrical engineering and computer sciences at the University of California, Berkeley. See ...
GitHub

Near-optimal vector quantization for LLM KV cache compression.

Random rotation: Multiply the input vector by a fixed random orthogonal matrix. This makes each coordinate follow a known Beta(d/2, d/2) distribution. Lloyd-Max scalar quantization: Quantize each ...
GitHub

Python implementation of the TurboQuant and QJL vector quantization algorithms.

turboquant-py implements the TurboQuant and QJL vector quantization algorithms from Google Research (ICLR 2026 / AISTATS 2026). It compresses high-dimensional floating-point vectors to 1-4 bits per ...
VentureBeat

Google's new TurboQuant algorithm speeds up AI memory 8x, cutting costs by 50% or more

As Large Language Models (LLMs) expand their context windows to process massive documents and intricate conversations, they encounter a brutal hardware reality known as the "Key-Value (KV) cache ...
IEEE

Learnable Non-Uniform Quantization With Sampling-Based Optimization for Variable-Rate Learned Image Compression

Abstract: Variable-rate coding is challenging but indispensable for learned image compression (LIC) that is in nature characterized by nonlinear transform coding (NTC). Existing methods for ...
Hackaday

Making The Smallest And Dumbest LLM With Extreme Quantization

The reason why large language models are called ‘large’ is not because of how smart they are, but as a factor of their sheer size in bytes. At billions of parameters at four bytes each, they pose a ...
marktechpost

Meet oLLM: A Lightweight Python Library that brings 100K-Context LLM Inference to 8 GB Consumer GPUs via SSD Offload—No Quantization Required

oLLM is a lightweight Python library built on top of Huggingface Transformers and PyTorch and runs large-context Transformers on NVIDIA GPUs by aggressively offloading weights and KV-cache to fast ...
Semiconductor Engineering

How Neural Super Sampling Works: Architecture, Training, And Inference

This blog post is the second in our Neural Super Sampling (NSS) series. The post explores why we introduced NSS and explains its architecture, training, and inference components. In August 2025, we ...