17EC753 Pattern Recognition syllabus for EC

Introduction:

Importance of pattern recognition, Features, Feature Vectors, and Classifiers, Supervised, Unsupervised, and Semi-supervised learning, Introduction to Bayes Decision Theory, Discriminant Functions and Decision Surfaces, Gaussian PDF and Bayesian Classification for Normal Distributions. L1, L2

Data Transformation and Dimensionality Reduction:

Introduction, Basis Vectors, The Karhunen Loeve (KL) Transformation, Singular Value Decomposition, Independent Component Analysis (Introduction only). Nonlinear Dimensionality Reduction, Kernel PCA. L1, L2

Estimation of Unknown Probability Density Functions:

Maximum Likelihood Parameter Estimation, Maximum a Posteriori Probability estimation, Bayesian Interference, Maximum Entropy Estimation, Mixture Models, Naive-Bayes Classifier, The Nearest Neighbor Rule. L1, L2, L3

Linear Classifiers:

Introduction, Linear Discriminant Functions and Decision Hyperplanes, The Perceptron Algorithm, Mean Square Error Estimate, Stochastic Approximation of LMS Algorithm, Sum of Error Estimate. L1, L2, L3

Nonlinear Classifiers:

The XOR Problem, The two Layer Perceptron, Three Layer Perceptron, Back propagation Algorithm, Basic Concepts of Clustering, Introduction to Clustering , Proximity Measures. L1, L2, L3

Course outcomes:

At the end of the course, students will be able to:

• Identify areas where Pattern Recognition and Machine Learning can offer a solution.
• Describe the strength and limitations of some techniques used in computational Machine Learning for classification, regression and density estimation problems
• Describe genetic algorithms, validation methods and sampling techniques
• Describe and model data to solve problems in regression and classification
• Implement learning algorithms for supervised tasks.

Text Book:

Pattern Recognition: Sergios Theodoridis, Konstantinos Koutroumbas, Elsevier India Pvt. Ltd (Paper Back), 4th edition.

Reference Books:

1. The Elements of Statistical Learning: Trevor Hastie, Springer-Verlag New York, LLC (Paper Back), 2009.

2. Pattern Classification: Richard O. Duda, Peter E. Hart, David G. Stork. John Wiley & Sons, 2012.

3. Pattern Recognition and Image Analysis Earl Gose: Richard Johnsonbaugh, Steve Jost, ePub eBook.