Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coin

Attention ISN'T all you need?! New Qwen3 variant Brumby-14B-Base leverages Power Retention technique

The beginning of the end of the transformer era? Neuro-symbolic AI startup AUI announces new funding at $750M valuation

Beyond CNNs: Efficient Fine-Tuning of Multi-Modal LLMs for Object Detection on Low-Data Regimes

Litespark Technical Report: High-Throughput, Energy-Efficient LLM Training Framework

Dissecting Transformers: A CLEAR Perspective towards Green AI

IBM Released new Granite 4.0 Models with a Novel Hybrid Mamba-2/Transformer Architecture: Drastically Reducing Memory Use without Sacrificing Performance