Classical Hopfield Nets

A simple model of associative memory/content-addressable memory with some cool information-theoretic and energy-based interpretations

• Basis of later connections to attention and diffusion (!!!)

Setup

Derivation (TODO)

Sources

Hopfield's original paper

Hopfield Networks is All You Need | hopfield-layers

mackay's info theory book @ pg 505 (518 in pdf)