Hierarchical Predictive Coding
Theory
Unconscious Inference: Hermann von Helmholtz
(Rao and Ballard 1999; Huang and Rao 2011; Spratling 2017b, 2017a)
- Understanding Predictive coding in the context of Efficient and Sparse Coding: (Chalk, Marre, and Tkačik 2017)
- Problems with Predictive Coding and the Bayesian Brain: (Kwisthout and van Rooij 2013)
Evidence
(Heilbron and Chait 2018; Huang and Rao 2011)
Implementations in ML and RL
- Deep Predictive coding networks (PredNets) (Lotter, Kreiman, and Cox 2016)
Active Inference
References
Chalk, Matthew, Olivier Marre, and Gašper Tkačik. 2017. “Towards a Unified Theory of Efficient, Predictive and Sparse Coding.” Biorxiv.
Heilbron, Micha, and Maria Chait. 2018. “Great Expectations: Is There Evidence for Predictive Coding in Auditory Cortex?” Neuroscience, Sensory Sequence Processing in the Brain, .
Huang, Yanping, and Rajesh P. N. Rao. 2011. “Predictive Coding.” Wiley Interdisciplinary Reviews: Cognitive Science.
Kwisthout, Johan, and Iris van Rooij. 2013. “Predictive Coding and the Bayesian Brain: Intractability Hurdles That Are yet to Be Overcome.” In CogSci.
Lotter, William, Gabriel Kreiman, and David Cox. 2016. “Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning.” arXiv:1605.08104 [Cs, Q-Bio]. https://arxiv.org/abs/1605.08104.
Rao, Rajesh P. N., and Dana H. Ballard. 1999. “Predictive Coding in the Visual Cortex: A Functional Interpretation of Some Extra-Classical Receptive-Field Effects.” Nature Neuroscience.