Pattern Recognition

Year
1
Academic year
2023-2024
Code
02023430
Subject Area
Intelligent Systems
Language of Instruction
Portuguese
Other Languages of Instruction
English
Mode of Delivery
Face-to-face
Duration
SEMESTRIAL
ECTS Credits
6.0
Type
Elective
Level
2nd Cycle Studies - Mestrado

Recommended Prerequisites

BSc in Informatics Engineering or equivalent.

Teaching Methods

Theoretical classes (T) with detailed presentation, using audiovisual means, of concepts, principles and fundamental theories and solving of basic practical exercises to illustrate the practical interest of the subject and exemplify its application to real cases. Practical Laboratorial classes (PL) where the students solve practical exercises, which require the combination of different theoretical concepts and promote critical reasoning. The evaluation, which covers all the taught matters, clearly is focused on both the basic theoretical concepts and the ability to solve complex problems.

Learning Outcomes

Pattern Recognition (PR) studies the design, development and implementation of systems that recognize patterns in data. This course teaches the algorithms that allow to explore applications of RP, formalizing them with analytic models of wide use in many fields. Basic concepts, models and tools for the understanding and design of a PRS. Through discussion involving the nature and difficulties inherent in a pattern classification problem, we discuss the discrimination of patterns, functions and decision regions, separability of classes and metrics. Study of extraction and feature selection, classification models parametric and non-parametric, dimensionality reduction and kernel methods, metrics for evaluating classifiers. Students should understand the phases of the PRS, choose the most appropriate classifier for solving a problem, complete their study based on the analysis of results and get knowledge from this analysis.

Work Placement(s)

No

Syllabus

1.Pattern Discrimination: decision functions and decision regions; class separability metrics; Linear Discriminants (Euclidian and Mahalanobis), and Fisher discriminant.

2.Feature extraction and feature selection; feature ranking; Kruskal Wallis. Data pre-processing (outliers removal, normalization and scaling, missing data) 

3.Dimensionality reduction; Principal Component Analysis (PCA); Linear Discriminant Analysis (LDA).

4.Parametric Methods: model selection, linear generalized models, mixture models, Bayes Classification, Parameter estimation: likelihood method; Bayes and risk estimation; Maxima A Posteriori (MAP); Kullback-Leibler divergence

5.Non-parametric methods: density estimation: Parzen windows and K-nearest neighbors.

6.Kernel Methods: Support Vector Machines (SVM)

7.Classifier assessment: sampling, confusion matrix and error probability; ROC curves;

8. Hybrid Classifiers: Ensembles, Bootstrapping, Boosting.

Head Lecturer(s)

César Alexandre Domingues Teixeira

Assessment Methods

Assessment
Project: 40.0%
Exam: 60.0%

Bibliography

1. Bishop, C.M., ―Pattern Recognition and Machine Learning‖, Springer Verlag, 2006

2. Duda, R. O., Hart, P.E., and Stork, D.G., ―Pattern Classification,‖ 2nd ed. Wiley Interscience (2001)

3. J.P. Marques de Sá, ―Pattern Recognition: Concepts, Methods and Applications‖, 2001, XIX, 318 p., 197 illus., Springer-Verlag (2001)

4. M. N. Murty and V. S. Devi, ―Pattern Recognition: An Algorithmic Approach, Springer, 1st Edition., XII, 263 p. (2011)

5. A. Vieira, B. Ribeiro, Introduction to Deep Learning Business Applications for Developers From Conversational Bots in Customer Service to Medical Image Processing, Apress, 2018.