Sonny S. Kothapally

Neural networks

Readings

Readings listed in this section are from the required textbook:

Rojas, R. (1996) Neural networks: a systematic introduction. (Berlin: Springer-Verlag, 1996) [ISBN 3540605053; 978354060508].

LEC# Topic Readings
1 Motivation for artificial neural networks Rojas 1.1, 1.2, and 1.3
Farabee, M. (2009) The nervous system. Available online at: www.estrellamountain.edu/faculty/farabee/biobk/BioBookNERV.html (Last accessed June 2009.)
Clabaugh, C., D. Myszewski and J. Pang (2009) Neural networks. Available online at: http://cse.stanford.edu/class/sophomore-college/projects-00/neural-networks/Files/presentation.html (Last accessed June 2009.)
Carnegie Mellon (2009) Center for the Neural Basis of Cognition. Available online at: www.cnbc.cmu.edu (Last accessed June 2009.)
2 The artificial neuron: Perceptrons Rojas, Chapter 3
3 Multi-layered feed-forward networks Rojas, Chapter 6
4 ANN as search Rojas, Chapter 4
5 Training networks Rojas, Chapter 7
6 Kohonen-Grossberg counterpropagation networks Rojas, Section 5.1 and Chapter 16.
Kohonen, T. (2009a) Kohonen network. Available online at www.scholarpedia.org/article/Kohonen_network (Last accessed June 2009.)
7 Boltzmann machines Rojas, Chapter 14
Hinton, G.E. (2007) Boltzmann machine. Available online at www.scholarpedia.org/article/Boltzmann_machine (Last accessed June 2009.)
8 Hopfield nets Rojas, Chapters 12 and 13
Chapter 42 of MacKay, D.J.C. Information theory, inference, and learning algorithms. (Cambridge: Cambridge University Press, 2005) [ISBN-13: 9780521642989; ISBN-10: 0521642981]. Available online at www. inference.phy.cam.ac.uk/mackay/itila/book.html (Last accessed June 2009.);
Hopfield, J.J. (2009a) Hopfield network. Available online at www.scholarpedia.org/article/Hopfield_network (Last accessed June 2009.)
9 Problems in ANN learning Rojas, Chapter 8.
10 Applications of neural networks Sejnowski, T.J. and C.R. Rosenberg (1987) Parallel networks that learn to pronounce English text. Complex Systems 1, pp.145–168. Available online at www.cnl.salk.edu/ParallelNetsPronounce/index.php (Last accessed June 2009.)

Exercises from Rojas

Chapter 1, exercise 1