Skip to main content
  • Poster presentation
  • Open access
  • Published:

Plasticity and stability in recurrent neural networks

Over the past 30 years, Bienenstock-Cooper-Munro (BCM) [1] type learning rules have shaped our understanding of synaptic plasticity. While they excel at explaining the emergence of receptive fields and stimulus selectivity in networks with feed-forward architecture, their impact on recurrent scenarios is less distinctive.

Here, we analyze general BCM-type synaptic plasticity rules with a homeostatic sliding threshold in the framework of recurrent networks of rate-based and spiking neurons. We begin by considering the effects of learning rate and homeostatic timescales on network stability in a non-linear firing rate model. We show how a sensible choice of timescales leads to stable weight dynamics, but other seemingly sensible parameter choices will inevitably lead to catastrophic run-away potentiation. We discuss under which conditions a stable fixed-point in a regime of Hebbian learning exists.

We then study the network's response to perturbations and quantify the critical point whereupon network stability is compromised. By viewing perturbation as a consequence of pattern storage in synaptic connections, we quantify the number of such patterns that can be learned safely in a given time.

Our model could provide simple explanations as to why memory intake capacity is limited and why learning becomes increasingly inefficient during intensive learning periods. We confirm these findings in numerical simulations of spiking neural networks and show that our analytical results apply to synapses subject to additive triplet-STDP [2].

References

  1. Bienenstock E, Cooper L, Munro P: Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. Journal of Neuroscience. 1982, 2 (1): 32-48.

    CAS  PubMed  Google Scholar 

  2. Pfister J-P, Gerstner W: Triplets of spikes in a model of spike timing-dependent plasticity. Journal of Neuroscience. 2006, 26 (38): 9673-82. 10.1523/JNEUROSCI.1425-06.2006.

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Friedemann Zenke.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Zenke, F., Hennequin, G., Sprekeler, H. et al. Plasticity and stability in recurrent neural networks. BMC Neurosci 12 (Suppl 1), P120 (2011). https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2202-12-S1-P120

Download citation

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2202-12-S1-P120

Keywords