Posts tagged with 'mlp'

From simple neurons to memory - the evolution of language models

From a single neuron in 1958, through MLP and RNN with the forgetting problem, to LSTM with memory gates. The evolution of architectures that led to Transformers. read more →