TheaterFire

https://www.nature.com/articles/s41467-025-58848-6

Posted by False_Grit@reddit | LocalLLaMA | View on Reddit | 10 comments

Efficient coding for humans to create principles of generalization; seems to work when applied to RL as well. Thots?

Reply to Post

10 Comments

roofitor@reddit

You put the link as the title.. it’s not clickable
View on Reddit #55089991

False_Grit@reddit (OP)

I need to be replaced with an AI asap :(. Thank you for the correction! :)
View on Reddit #55293542

roofitor@reddit

O it’s okay I googled it. Thanks for posting :)
View on Reddit #55295083

roofitor@reddit

https://www.nature.com/articles/s41467-025-58848-6
View on Reddit #55098685

roofitor@reddit

You didn’t name the paper or the authors. My curiosity is piqued lol. Gimme something to go on here I’m on mobile.
View on Reddit #55095965

Remote_Cap_@reddit

Tldr?
View on Reddit #55089549

Due_Entertainment947@reddit

By integrating the principle of efficient coding into reinforcement learning (RL), the authors propose that humans generalize by forming compact, abstract representations that prioritize reward-relevant features. This approach aligns with the brain's tendency to compress information, facilitating transfer learning and adaptability. Empirical results demonstrate that models incorporating efficient coding outperform traditional RL models in generalization tasks, suggesting a more accurate computational framework for understanding human learning and decision-making.​ This work bridges cognitive science and machine learning, offering insights into how efficient representation learning can enhance generalization in artificial agents
View on Reddit #55089970

Due_Entertainment947@reddit

This could influence future AI model development in a few key ways: 1. **Better generalization**: By mimicking how humans compress and prioritize reward-relevant information, models could generalize across tasks with fewer examples. 2. **Sample efficiency**: Learning with compact, abstract representations could reduce training data needs—critical for real-world deployment. 3. **Transfer learning**: Efficient coding may improve transfer across domains by encouraging reusable internal structures. 4. **Alignment with human cognition**: Embedding human-like inductive biases might yield models that behave more intuitively or predictably.
View on Reddit #55090036

LagOps91@reddit

if this works out, then that would certainly be great! far too much data is needed to train ai and it doesn't feel like it generalizes all that well as of now. improved generalization is certainly something i'm hyped about!
View on Reddit #55094969

Remote_Cap_@reddit

Thank you!
View on Reddit #55090852