Cohere Introduces Hardware-Aware Dynamic Speculative Decoding
Cohere's new technique improves large language model inference speed by adapting to hardware constraints, achieving up to 23% faster performance at high batch sizes.
98 articles
In-depth coverage of new AI research — papers, benchmarks, and breakthroughs from leading labs and academia, summarized for fast reading and grounded in the methods that matter.
Cohere's new technique improves large language model inference speed by adapting to hardware constraints, achieving up to 23% faster performance at high batch sizes.
Anthropic has identified a hidden area within its Claude Opus 4.6 model called J-space, offering new insights into how the AI processes information.
OpenAI has pulled its endorsement of SWE-Bench Pro after finding 30 percent of its tasks flawed, impacting AI performance assessments.
IBM researchers have developed CofrGenets, a new framework that reduces training errors in transformer-based models by 40%.
OpenAI found that about 30% of tasks in SWE-Bench Pro are broken, according to a recent audit of coding benchmarks.
AWS introduces BYOKG and GraphRAG to address fragmented data in pharmaceutical research, with a 5 percent success rate in early-stage drug discovery.
Anthropic's Claude Fable 5 topped all six new industry-specific performance indices from Artificial Analysis, despite being significantly more expensive than alternatives.
HuggingFace's Atom2.7m model outperforms GPT-2 XL on ArithMark2.0, scoring 29.92% on one-operation expressions.
Anthropic's Jacobian Lens allows researchers to examine Claude's internal working memory, revealing how it processes concepts without explicitly stating them. The tool shows Claude can modify conclusions based on internal changes.
Mass Balance launched a grapefruit-sized lab into orbit on Tuesday to study disease-causing proteins in microgravity, aiming to improve drug development for age-related conditions.
Amazon announced Amazon Nova, a customizable content moderation tool that reduces over-deflection by 53.74 percentage points on safety-related requests.
Hugging Face researchers developed a 15M parameter French LLM that improves perplexity through entropy-based halting and looping, with results from a single training run.