CIS 8525: NEURAL COMPUTATION
Spring 2009
Time: Wednesday, 4:40-7:20pm; Place: Tuttleman 403 B
Instructor: Zoran Obradovic
303 Wachman Hall, zoran@ist.temple.edu, phone: 215 204 6094
Office hours: Wednesday 2-3pm and by appointment
Course materials: www.dabi.temple.edu/external/zoran/teaching/cis525.htm
Goals:
Neural networks provide powerful techniques to model and control nonlinear and complex systems. The course is designed to provide an introduction to this interdisciplinary topic. The course is structured such that students from computer science, engineering, physics, mathematics, statistics, cognitive sciences and elsewhere have an opportunity to explore promising research topics by a hands-on experience with neural network simulators applied to classi_cation and prediction problems ranging from bio-medical sciences to finance and business.
Prerequisites:
Stat503 or CIS511 and undergraduate understanding of probability, statistics and linear algebra.
Texts:
Haykin S. Neural Networks and Learning Machines (3nd Edition), Prentice Hall, 2009, ISBN 13: 978-0-13-147139-0 (required).
Bishop, C.M. Neural Networks for Pattern Recognition, Oxford University Press, 1996, ISBN 0-19-853864-2(optional).
Topics: will be tailored to interests of the participants. Content will include:
I. Supervised and Unsupervised Neural Networks
1. Rosenblatt’s Perceptron
2. Multilayer Perceptrons
3. Committee Machines
4. Kernel Methods and Radial-Basis Function Networks
5. Regularization Theory
6. Principles of Self-Organization
7. Self-Organizing Maps
II. Selected Advanced Topics
8. Information Theoretic Learning Models
9. Neurodynamics
10. Bayesian Filtering
11. Dynamically Driven Recurrent Networks
III. Reading and research projects presentations.
Grading: Homework (30%), midterm exam (20%), reading/presenting assignments (20%) and an individual research project (30%).
Late Policy and Academic Honesty: No late submissions will be accepted. Discussing materials with fellow students is acceptable, but programs, experiments and the reports must be done individually.