Hacker News AI· abstractcontrol·· 2 days agoAI score58
AI Can Read Neural Network Weights. I Wasn't Ready for That
AI Can Read Neural Network Weights. I Wasn't Ready for That
AI summary
The author describes a study in which frontier models read neural network weights presented as plain text and reason about the behavior they encode, such as identifying a Pac-Man-playing network from its architecture and weights alone. He argues this is surprising because LLMs have no native channel for weights and no training data of this kind, and suggests it may reflect extreme generalization from program tracing and reinforcement learning. He notes that GPT-6 Astra, Opus 5.5 and Muse Spark 1.3 all identified Pac-Man, with Astra reporting 93% confidence.
Source: Hacker News AI · arcturus-labs.com