LLMs can program neural networks by editing weights directly
Weight-Space Programming lets a frontier LLM inspect, write, and improve neural-network weights without gradient descent or a training loop, opening a new way to probe models that developers still treat as black boxes. In the author’s harness, the agent edits NumPy arrays inside an offline Docker container, sees limited examples, and gets validation scores while the test set stays hidden. The post reports GPT-6 Astra identifying a network’s task, writing a game policy from scratch, and improving Qwen3.5-0.8B’s math reasoning this way.