← Nov 2 · Mon, Nov 2

Researchers say LLMs can be good at natively reading and writing neural network weights; GPT-6 Astra edited Qwen3.5-0.8B's weights to make it better at math (Rikiya Takehi)

Rikiya Takehi : Researchers say LLMs can be good at natively reading and writing neural network weights; GPT-6 Astra edited Qwen3.5-0.8B's weights to make it better at math TL;DR If you were asked to

At a glance

  • techmeme.com: Researchers say LLMs can be good at natively reading and writing neural network weights; GPT-6 Astra edited Qwen3.5-0.8B's weights to make it better at math (Rikiya Takehi)
  • reddit.com: Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights [R]

The story

techmeme.com: Rikiya Takehi : Researchers say LLMs can be good at natively reading and writing neural network weights; GPT-6 Astra edited Qwen3.5-0.8B's weights to make it better at math TL;DR If you were asked to handcraft a neural network that plays Go, what would you do? If you were handed raw neural network weights

reddit.com: Link: https://rikiyat.github.io/blog/weight-space-programming/ Snippet: “We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights , well past what we’d expect from humans or conventional algorithms. This might be a big deal for both optimization and interpretability. Just by looking at the raw weights, GPT-6 Astra can tell what a network was trained to do . And without any environment feedback, it has no trouble writing, from scratch, small game-playing networks that outplay networks trained with PPO for 100 million steps.” Very surprising result, I didn’t expect frontier models to have this capability that has not been optimized for, and it’s something humans cannot do either. submitted by /u/RobbinDeBank [link] [comments]

Get tomorrow's scan at 7am

The same ranked list, in your inbox. Nothing else, ever.

← Back to Nov 2