17EC653 Artificial Neural Networks syllabus for EC

Introduction:

Biological Neuron – Artificial Neural Model - Types of activation functions –

Architecture:

Feedforward and Feedback, Convex Sets, Convex Hull and Linear Separability, Non-Linear Separable Problem. XOR Problem, Multilayer Networks.

Learning:

Learning Algorithms, Error correction and Gradient Descent Rules, Learning objective of TLNs, Perceptron Learning Algorithm, Perceptron Convergence Theorem. L1, L2

Supervised Learning:

Perceptron learning and Non Separable sets, α-Least Mean Square Learning, MSE Error surface, Steepest Descent Search, μ-LMS approximate to gradient descent, Application of LMS to Noise Cancelling, Multi-layered Network Architecture, Backpropagation Learning Algorithm, Practical consideration of BP algorithm. L1, L2, L3

Support Vector Machines and Radial Basis Function:

Learning from Examples, Statistical Learning Theory, Support Vector Machines, SVM application to Image Classification, Radial Basis Function Regularization theory, Generalized RBF Networks, Learning in RBFNs, RBF application to face recognition. L1, L2, L3

Support Vector Machines and Radial Basis Function:

Learning from Examples, Statistical Learning Theory, Support Vector Machines, SVM application to Image Classification, Radial Basis Function Regularization theory, Generalized RBF Networks, Learning in RBFNs, RBF application to face recognition. L1, L2, L3

Self-organization Feature Map:

Maximal Eigenvector Filtering, Extracting Principal Components, Generalized Learning Laws, Vector Quantization, Self-organization Feature Maps, Application of SOM, Growing Neural Gas. L1, L2, L3

Course outcomes:

At the end of the course, students should be able to

• Understand the role of neural networks in engineering, artificial intelligence, and cognitive modelling.
• Understand the concepts and techniques of neural networks through the study of the most important neural network models.
• Evaluate whether neural networks are appropriate to a particular application.
• Apply neural networks to particular applications, and to know what steps to take to improve performance.

Text Book:

Neural Networks A Classroom Approach– Satish Kumar, McGraw Hill Education (India) Pvt. Ltd, Second Edition.

Reference Books:

1. Introduction to Artificial Neural Systems-J.M. Zurada, Jaico Publications 1994.

2. Artificial Neural Networks-B. Yegnanarayana, PHI, New Delhi 1998.