Introduction:
Biological Neuron- Artificial Neural Model- Types of activation functions-
Architecture:
Feedforward and Feedback, Convex Sets, Convex Hull and Linear Separability, Non-Linear Separable Problem. XOR Problem, Multilayer Networks.
Learning:
Learning Algorithms, Error correction and Gradient Descent Rules, Learning objective of TLNs, Perceptron Learning Algorithm, Perceptron Convergence Theorem.
Supervised Learning:
Perceptron learning and Non Separable sets, a.-Least Mean Square Learning, MSE Error surface, Steepest Descent Search, JL-LMS approximate to gradient descent, Application of LMS to Noise Cancelling, Multi-layered Network Architecture, Back propagation Learning Algorithm, Practical consideration of BP algorithm.
Support Vector Machines and Radial Basis Function:
Learning from Examples, Statistical Learning Theory, Support Vector Machines, SVM application to Image Classification, Radial Basis Function Regularization theory, Generalized RBF Networks, Learning in RBFNs, RBF application to face recognition.
Attractor Neural Networks:
Associative Learning Attractor Associative Memory, Linear Associative memory, Hopfield Network, application of Hopfield Network, Brain State in a Box neural Network, Simulated Annealing, Boltzmann Machine, Bidirectional Associative Memory.
Self-organization Feature Map:
Maximal Eigenvector Filtering, Extracting Principal Components, Generalized Learning Laws, Vector Quantization, Self organization Feature Maps, Application of SOM, Growing Neural Gas.
Course Outcomes:
At the end of the course, students will be able to:
1. Understand the role of neural networks in engineering, artificial intelligence, and cognitive modelling.
2 Understand the concepts and techniques of neural networks through the study ofimportant neural network models.
3. Evaluate whether neural networks are appropriate to a particular application.
4. Apply neural networks to particular application.
5. Analyze the steps needed to improve performance of the selected neural network.
Question paper pattern:
TextBook:
1. Neural Networks A Classroom Approach- Satish Kumar, McGraw Hill Education (India) Pvt. Ltd, Second Edition.
Reference Books:
1. Introduction to Artificial Neural Systems-J.M. Zurada, Jaico Publications 1994.
2. Artificial Neural Networks-B. Yegnanarayana, PHI, New Delhi 1998.