BACK TO INDEX
Publications of Eduardo D. Sontag jointly with A. Zador
and A. Zador.
Processing of time series by neural circuits with biologically realistic synaptic dynamics.
In Todd K. Leen,
Thomas G. Dietterich,
and Volker Tresp, editors,
Advances in Neural Information Processing Systems 13 (NIPS2000),
MIT Press, Cambridge.
Keyword(s): neural networks,
Experimental data show that biological synapses are dynamic, i.e., their weight changes on a short time scale by several hundred percent in dependence of the past input to the synapse. In this article we explore the consequences that this synaptic dynamics entails for the computational power of feedforward neural networks. It turns out that even with just a single hidden layer such networks can approximate a surprisingly large large class of nonlinear filters: all filters that can be characterized by Volterra series. This result is robust with regard to various changes in the model for synaptic dynamics. Furthermore we show that simple gradient descent suffices to approximate a given quadratic filter by a rather small neural system with dynamic synapses.
BACK TO INDEX
This material is presented to ensure timely dissemination of
scholarly and technical work. Copyright and all rights therein
are retained by authors or by other copyright holders.
Last modified: Wed Aug 7 15:28:02 2019
This document was translated from BibTEX by