COMPUTATIONAL NEUROSCIENCE

If the lectures leave you curious or confused, checking here might help. This is NOT required reading, but we have been careful to match references to lectures to make them useful. Some of the references are book chapters. See the annotations which give some more detailed information about the books.

We will keep a folder of articles in the office of your T.A., which contains some of the references below. You may photocopy the articles, but you must return the original immediately. If an article we claim to have is not there, let us know, thanks.

• Lecture 1
  • Hertz, Krogh, and Palmer, chapter 1.
  • Shepherd, chapters 1 and 2.
  • R. J. Herrnstein, D. H. Loveland, and C. Cable, "Natural Concepts in Pigeons". J. Exp. Psy. Vol 2(4) pp 285--302 (1976)
  • A.D. DeGroot, "Thought and Choice in Chess", Mouton, pp. 322 2nd Edition (1978)

• Lecture 2
  • Hertz, Krogh, and Palmer, section 3.4.
  • Horowitz and Hill, chapters 1 and 3.
  • Koch and Segev, chapters 1 and 2.
  • Mead, chapters 2, 3, and 4.

• Lecture 3
  • Softky, W. and Koch, C., "Single cell models In The Handbook of Brain Theory and Neural Networks", Arbib, M., ed., pp. 879-884. (1995)
  • Brown, T.H. and Chattarji, S., "Hebbian Synaptic Plasticity. In The Handbook of Brain Theory and Neural Networks", Arbib, M., ed., pp. 454-459. (1995)
  • Hippocampus chapeter 11, Shepherd.

• Lecture 4
  • Poggio, T., Torre, V., Koch, C., "Computational Vision and Regularization Theory", Nature, v.317, p.314 (1985)

• Lectures 5, 6, 7
  • Hopfield, J.J. "Neural networks and physical systems with emergent collective computational abilities", Proc. Natl. Acad. Sci. USA 79 p. 2554 (1984)
  • Hopfield, J.J. "Neurons with graded response have collective computational computational properties like those of two-state neurons", Proc. Natl. Acad. Sci. USA 81 p. 3088 (1984)
  • Cohen, M. and Grossberg, S. "Absolute stability of global pattern formation and parallel memory storage by competitive neural networks", IEEE Trans. Systems, Man and Cybernetics SMC-12 (5) p. 815 (1983)

• Lecture 8
  • Hopfield, J.J. and Tank, D. "Neural computation of decisions in optimization problems", Biological Cybernetics 52 p. 141-152 (1985)
  • Aho, Hopcroft, Ullman, chapter 10.
  • Hertz, Krogh and Palmer, chapter 4.

• Lecture 9
  • Shepherd, ch 1.
  • Mel, Bartlett W. "Information Processing in Dendritic Trees", Neural Computation 6 pp. 1031-1085 (1994).
  • Mel, Bartlett W. "NMDA-Based Pattern Discrimination in a Modeled Cortical Neuron", Neural Computation 4 pp. 502-517 (1992).

• Lecture 10
  • Movshon and Newsome. "Neural Foundations of Visual Motion Perception", Current Directions in Psychological Science pp 35-39 (1992).

• Lecture 11
  • Bialek, W. "Optimal Signal Processing in the Nervous System", Princeton Lectures on Biophysics, World Scientific, (1992)
  • Bialek, W., Rieke, F., de Ruyter van Steveninck, R. R., Warland, D. "Reading a Neural Code", Science 252 pp. 1854-1857 (1991)
  • de Ruyter van Steveninck, R. R., Bialek, W. "Real-time performance of a movement-sensitive neuron in the blowfly visual system: coding and information transfer in short spike sequences", Proc. R. Soc. Lond. B 234 pp. 379-414 (1988)

• Lecture 12
  • Abbott LF, Varela JA, Sen K, Nelson SB, "Synaptic depression and cortical gain-control", Science, v275 (5297) pp220-224 (1997 Jan 10)
  • Chance FS, Nelson SB, Abbott LF, "Synaptic Depression and the Temporal Response Charactoeistics of V1 Cells", Journal of Neuroscience, v18 (12) : pp4785-4799 (1998 Jun 15)
  • Varela JA, Sen K, Gibson J, Fost J, Abbott LF, Nelson SB, "A quantitative description of short-term plasticity at excitatory synapses in layer-2/3 of rat primary visual-cortex", Journal of Neuroscience, v17 (20) : pp7926-7940 (1997 Oct 15)

• Lecture 13
  • Bialek W, Rieke F, Vansteveninck RRD, Warland D, "Reading a Neural Code", Science, v252 (5014): pp1854-1857 (1991)
  • Shannon, CE, Weaver W, "A mathematical theory of communication", Urbana. Univ. of Illinois Press (1949)
  • Vansteveninck RRD, Lewen GD, Strong SP, Koberle R, Bialek W, "Reproducibility and Variability in Neural Spike Trains", Science, v275 (5307): pp1805-1808 (1997 Mar 21)

• Lecture 14
  • Barlow HB, "Possible principles underlying the transformation of sensory messages", Sensory Communication (Rosenblith WA, ed.), Cambridge, MA: MIT Press, pp217-234 (1961)
  • Dong DW, Atick JJ, "Statistics of natural time varying images", Network: Computation in Neural Systems, v6(3): pp345-358 (1995)
  • Dong DW, Atick JJ, "Temporal Decorrelation: a Theory of Lagged and Nonlagged Responses in the Lateral Geniculate Nucleus", Network: Comput ation in Neural Systems, v6(2): pp159-178 (1995)

• Lecture 15
  • Linsker R, "An application of the principle of maximum information preservation to linear systems", In: Advances in Neural Information Processing Systems 1 (Touretzky DS, ed), San Mateo, CA: Morgan Kaufman, pp186-194 (1989)
  • Linsker R, "Local Synaptic Learning Rules Suffice to Maximize Mutual Information in a Linear Network", Neural Computation, 4, pp691-702 (1992)
  • Shannon CE, Weaver W, "A mathematical theory of communication", Urbana. Univ. of Illinois Press (1949)

• Lecture 16
  • Atick JJ, "Could information theory provide an ecological theory of sensory processing?", Network: Computations in Neural Systems, v3(2): pp213-251 (1992)
  • Barlow HB, "Possible principles underlying the transformation of sensory messages", Sensory Communication (Rosenblith WA, ed.), Cambridge, MA: MIT Press, pp217-234 (1961)
  • Shannon CE, Weaver W, "A mathematical theory of communication", Urbana. Univ. of Illinois Press (1949)

• Lecture 17
  • Dong DW, "Spatiotemporal coupling and scaling of natural images and human visual sensitivities", Advances in Neural Information Processing Systems (Mozer MC, Jordan MI, Petsche T, eds) MIT Press, Cambridge, MA, v9: pp 859-865 (1996)
  • Dong DW, Atick JJ, "Statistics of natural time varying images", Network: Computation in Neural Systems, v6(3): pp345-358 (1995)
  • Dong DW, Atick JJ, "Temporal Decorrelation: a Theory of Lagged and Nonlagged Responses in the Lateral Geniculate Nucleus", Network: Comput ation in Neural Systems, v6(2): pp159-178 (1995)

• Lecture 18
  • Oja E, "A Simplified Neuron Model as a Principal Component Analyzer", Journal of Mathematical Biology, v15(3): pp267-273 (1982)
  • Oja E, "Neural Networks, Principal Components, and Subspaces", International Journal of Neural Systems, 1: pp61-68 (1989)
  • Sanger TD, "Optimal Unsupervised Learning in a Single-Layer Linear Feedforward Neural Network", Neural Networks, 2: pp459-473 (1989)

• Lecture 19
  • Kohonen, T., "Clustering, taxonomy, and topological maps of patterns". Proceedings of the 6th international conference on pattern recognition (Piscataway, NJ: IEEE), p. 114-128 (1982)
  • Kohonen, T., "Self-organization and associative memory", Springer-Verlag (1984)

• Lecture 20
  • Dong DW, Hopfield JJ, "Dynamic properties of neural networks with adapting synapses", Network: Computation in Neural Systems, v3(3): pp267-283 (1992)
  • Jordan M., Jacobs R., "Hierarchical Mixtures of Experts and the EM Algorithm", Neural Computation v6 (2) : pp181-214 (1994 Mar)
  • Yuille A., Stolorz P., Utans J., "Statistical Physics, Mixtures of Distributions, and the EM Algorithm", Neural Computation v6 (2) : pp334-340 (1994 Mar)

• Lecture 21
  • Hertz J, Krogh A, and Palmer R, Introduction to the theory of neural computation, Santa Fe Institute studies in the sciences of complexity, Addison-Wesley, 1991.
  • Hinton G E, Sejnowski T J, Learning and Relearning in Boltzmann Machines, Parallel distributed processing, ch. 7, MIT Press, 1986.
  • Hopfield J J, Tank D W, Neural Computation of Decisions in Optimizations Problems, Biological Cybernetics, v.52, p.141, 1985.
  • Kirkpatrick S, Gelatt C D, Vecchi M P, Optimization by Simulated Annealing, Science, v.220, n.4598, p.671, 1983.

• Lecture 22
  • Dong DW, Hopfield JJ, "Dynamic properties of neural networks with adapting synapses", Network: Computation in Neural Systems, v3(3): pp267-283 (1992)
  • Linsker R, "From basic network principles to neural architecture ...", Proc. Natl. Acad. Sci. USA, v83: pp7508, pp8390, pp8779 (1986)
  • Miller KD, Keller JB, Stryker MP, "Ocular dominance column development - analysis and simulation", Science, v245: pp605-615 (1989)

• Lecture 23
  • Hopfield JF, Gelperin A, "Differential conditioning to a compound stimulus and its components in the terrestrial mollusk limax-maximus", Behavioral Neuroscience, v103(2), pp329-333 (1989)
  • Hopfield JJ, "Olfactory computation and object perception", PNAS, v88: pp6462-6466 (1991 Aug)
  • Hendin O, Horn D, Hopfield JJ, "Decomposition of a Mixture of Signals in a Model of the Olfactory Bulb", PNAS, v91: pp5942-5946 (1994 Jun)

• Lecture 24
  • Field DJ, "What is the goal of sensory coding", Neural Computation, v6(4): pp559-601 (1994 Jul)
  • Olshausen BA, Field DJ, "Emergence of simple-cell receptive-field properties by learning a sparse code for natural images", Nature, v381(6583): pp607-609 (1996)
  • Bell AJ, Sejnowski TJ, "The independent components of natural scenes are edge filters", Vision Research, v37(23): pp3327-3338 (1997)

Send comments to Dawei Dong:
************************************************************************
Dawei W. Dong                                         FAX: (561)297-3634
Center for Complex Systems & Brain Sciences         Phone: (561)297-2326
Florida Atlantic University                       dawei@dove.ccs.fau.edu
777 Glades Road, Boca Raton, FL33431      http://dove.ccs.fau.edu/~dawei
************************************************************************