FriendliAI — founded by the researcher behind continuous batching, the technique at the core of vLLM — is launching InferenceSense, a platform that fills idle neocloud GPU capacity with paid AI ...
Meara covers streaming service news for CNET. She graduated from the University of Texas at Austin with a degree in journalism. When she's not writing, she likes to dote over her cat, sip black coffee ...