Hebb's Rule

From GM-RKB
(Redirected from Hebb rule)
Jump to navigation Jump to search

A Hebb's Rule is a learning rule that describes synaptic plasticity.



References

2020

  • (Wikipedia, 2020) ⇒ https://en.wikipedia.org/wiki/Hebbian_theory Retrieved:2020-10-31.
    • Hebbian theory is a neuroscientific theory claiming that an increase in synaptic efficacy arises from a presynaptic cell's repeated and persistent stimulation of a postsynaptic cell. It is an attempt to explain synaptic plasticity, the adaptation of brain neurons during the learning process. It was introduced by Donald Hebb in his 1949 book The Organization of Behavior.[1] The theory is also called Hebb's rule, Hebb's postulate, and cell assembly theory. Hebb states it as follows:

      Let us assume that the persistence or repetition of a reverberatory activity (or "trace") tends to induce lasting cellular changes that add to its stability. ... When an axon of cell A is near enough to excite a cell B and repeatedly or persistently takes part in firing it, some growth process or metabolic change takes place in one or both cells such that As efficiency, as one of the cells firing B, is increased.

      The theory is often summarized as "Cells that fire together wire together." [2] However, Hebb emphasized that cell A needs to "take part in firing" cell B, and such causality can occur only if cell A fires just before, not at the same time as, cell B. This aspect of causation in Hebb's work foreshadowed what is now known about spike-timing-dependent plasticity, which requires temporal precedence.

      The theory attempts to explain associative or Hebbian learning, in which simultaneous activation of cells leads to pronounced increases in synaptic strength between those cells. It also provides a biological basis for errorless learning methods for education and memory rehabilitation. In the study of neural networks in cognitive function, it is often regarded as the neuronal basis of unsupervised learning.

  1. Hebb, D.O. (1949). The Organization of Behavior. New York: Wiley & Sons.
  2. Siegrid Löwel, Göttingen University; The exact sentence is: "neurons wire together if they fire together" (Löwel, S. and Singer, W. (1992) Science 255 (published January 10, 1992)

2020b

  1. Hebb D (1949) The Organization of Behavior. A Neuropsychological Theory. Wiley, New York, NY

2018

  • (Wang, 2018) ⇒ Ruye Wang (2018) http://fourier.eng.hmc.edu/e161/lectures/nn/node4.html Last Updated:2018-04-10
    • QUOTE: Donald Hebb (Canadian Psychologist) speculated in 1949 that

      When neuron A repeatedly and persistently takes part in exciting neuron B, the synaptic connection from A to B will be strengthened.

      Simultaneous activation of neurons leads to pronounced increases in synaptic strength between them. In other words, "Neurons that fire together, wire together. Neurons that fire out of sync, fail to link". So a Hebbian network can be used as an associator which will establish the association between two sets of patterns $\{{\bf x}_k,\;\;k=1,\cdots,K \}$ and $\{{\bf y}_k,\;\;k=1,\cdots,K\}$.

2017