Researchers say they trained a foundation model from scratch for about $1,500
Source:
ventureBeat
June 10, 2026 · 14:52
Training a foundation LLM from scratch costs millions and requires internet-scale data — which is why most enterprises don't bother. Sapient thinks it has a cheaper path.To overcome this brute-force scaling dogma, researchers at Sapient developed HRM-Text, which replaces standard Transformers with a highly sample-efficient Hierarchical Recurrent Model (HRM), an architecture they first introduced last year.HRM decouples computation into slow-evolving strategic and fast-evolving execution layers. Instead of brute-force autoregressive prediction on raw text, HRM-Text trains exclusively on instruction-response pairs. This is close to real-world enterprise settings, where users usually expect a targeted answer to a specific task.The researchers were able to train a 1B-parameter HRM-Text from sc…
The original article opens on the publisher's website.
More from Automotive
View topic →Larry Page’s flying car company Pivotal loses its CEO
techcrunch
Sep 1, 2026 · 16:59
SEC proposes transfer agent rule, sets event to figure out round-the-clock U.S. trading
coinDesk
Sep 1, 2026 · 16:55
China dissented from G20 statement opposing 'cheap exports' flooding market, Bessent says
cnbc
Sep 1, 2026 · 16:52
The Range Rover Electric: Specs, Price, Availability
wired
Sep 1, 2026 · 16:01
Android stuck in Safe Mode? Here's how to turn it off
engadget
Sep 1, 2026 · 16:00