Hierarchical Predictive Coding

clark2013: Whatever next? Predictive brains, situated agents, and the future of cognitive science

This work by brown2011 generalizes the basic Hierarchical Predictive Coding model to include action. The fundamental attraction of these accounts lies in their ability to offer a deeply unified account of perception, cognition, and action.

The strategy of using top-down connections to try to generate, using high-level knowledge, a kind of “virtual version” of the sensory data via a deep multilevel cascade lies at the heart of Hierarchical Predictive Coding rao1999. These approaches combine the use of top-down probabilistic generative models with a specific vision of how the downward influence might operate. Specifically, Hierarchical Predictive Coding depicts the top-down flow as attempting to predict and fully “explain awa” the driving sensory signal, leaving only residual “prediction errors”.

The strategy of using top-down connections to try to generate, using high-level knowledge, a kind of “virtual version” of the sensory data via a deep multilevel cascade lies at the heart of Hierarchical Predictive Coding rao1999. These approaches combine the use of top-down probabilistic generative models with a specific vision of how the downward influence might operate. Specifically, Hierarchical Predictive Coding depicts the top-down flow as attempting to predict and fully “explain awa” the driving sensory signal, leaving only residual “prediction errors”.

huang2011: Predictive Coding

Finally, it was suggested by rao1999 that the visual cortex also implements a form of predictive coding (see Hierarchical Predictive Coding).

This paper surveys the Predictive Coding literature from the original rao1999 to work recent at original publication (i.e. 2011). As laid out by rao1999, predictive coding is a framework for describing several neural phenomenon in the visual cortex and other parts of the brain. The core idea is the use of top-down connections to predict incoming signals and only feed the residual information back through the feed-forward connections.

Predictive Processing, Hierarchical Predictive Coding