HuggingFace released VKORE-46M-NPU on October 14, 2026, saying it demonstrates real backpropagation on an inference-only NPU. It is the company's first hardware-related update since the release of FINAL-Bench in 2025.

HuggingFace reported 0.99 correlation between NPU and GPU loss trajectories, measured on a controlled comparison protocol. That compares with no prior benchmark scores provided by the source.

VKORE-46M-NPU is built on a decoder-only transformer architecture with RoPE positional encoding and targets causal language modeling. Availability begins with the model release on the Hub, initially for researchers and developers.

"Backpropagation on an inference-only NPU is a real wall," said VIDRAFT_LAB SeaWolf-AI. The team emphasized the need for a reproducible validation protocol to confirm the training path.

The announcement follows the release of FINAL-Bench, which aims to provide a benchmark for NPU training. HuggingFace framed the significance as a step toward redefining the role of inference accelerators in training workflows.

HuggingFace did not say the method is open-source, and the core training technique remains patent-pending. Scaling to larger models and real-world data is explicitly the next step, not something claimed here.

Source: huggingface