Astra can read and write weights to improve Qwen(rikiyat.github.io)
2790 points by dbreunig 18 hours ago | 853 comments
tl;dr: Researchers show that frontier LLMs (specifically "GPT-6 Astra") can directly read and write neural network weights in natural language, without gradient descent—identifying what games small policy networks were trained to play, locating copying heads in transformers, and writing playable Go networks from scratch. Most notably, Astra edited just 0.016% of Qwen3.5-0.8B's weights to fix a reasoning-loop failure, boosting MATH-500 from 7.9% to 48.1% and tripling IFEval. The authors call this "Weight-Space Programming" and argue it could enable auditing, unlearning, and model merging without retraining, though it couldn't add genuinely missing capabilities (e.g., to Gemma 3 270M).
HN Discussion:
  • ↓Results are overstated; weight editing and generation have existed in the subfield for years
  • ↑Genuinely shocked and amazed; this represents a stunning emergent capability of frontier LLMs
  • ~Impressive but unsurprising given LLMs' demonstrated ability to rapidly grasp complex systems
  • ↓Not emergent—likely result of deliberate training on weights data by OpenAI for recursive self-improvement
  • ↓The article conflates separate results and misleadingly frames the capability claims