Audiovisual Signals Processing

Recommended Prerequisites

Data analysis and transformation

Teaching Methods

Teaching methodologies: Lectures and computer-based laboratory classes. Laboratory classes consist of exepriments involving computers and specialized software and exercises to support and test the student's understanding of the material presented in the  lectures.

Evaluation method:
- Written exam                                                         12/20
- Project                                                      4.5/20
- Class assigments                                       3.5/20

Besides the usual criterion of obtaining a 9.5/20 grade, it is required obtaining 30% in the exam.

Learning Outcomes

This course intends to provide the attending students with a wide range of knowledge and information about the capture and processing of audio, image and video signals in the context of large scale systems, aimed at solving future problems with highly scalable media processing systems able to handle the increasing volume of audiovisual data. The course syllabus covers the fundamental techniques for capturing, representing, describing, and evaluating the quality of audio and video signals, as well as for their storage and transmission. Some important applications of these technologies like  smart-cities surveillance systems and environmental monitoring  will be exposed. The course will include some laboratorial work to acquaint the students with concrete or simulated audio and video processing and transmission systems.

Work Placement(s)

No

Syllabus

Part I - Audio signals processing

• Capture
• Compressed and non-compressed representaions
• Features for indexing, search and retrieval in large scale audiovisual data stores.
• Audio quality measures and applications.

Part II – Image and Video processing
• Image and video capture
• Image and video representation and storage with and without compression
• Image and video features for indexing, search and retrieval in large scale audiovisual data stores.
• Avaliação de qualidade de imagem e vídeo, métodos e normas

Part III -  Storage and transmission of audiovisual data

Parte IV - Aplications

Head Lecturer(s)

Luís Alberto da Silva Cruz

Assessment Methods

Assessment
Resolution Problems: 17.5%
Project: 22.5%
Exam: 60.0%

Bibliography

•Jens-Rainer Ohm, “Multimedia Communication Technology: Representation, Transmission and Identification of Multimedia Signals“, Springer 2004
•Kim, Moreau, Sikora, "MPEG-7 Audio and Beyond: Audio Content Indexing and Retrieval", Wiley 2005
•Salembier, Manjunath, Sikora, "Introduction to MPEG 7: Multimedia Content Description Language", Wiley, 2002
•Salembier, Manjunath, Sikora, "Introduction to MPEG 7: Multimedia Content Description Language", Wiley, 2002
•Murat Tekalp (2015) - Digital Video Processing,  Prentice Hall, 2017
•Stefanos Vrochidis, Benoit Huet, Edward Y. Chang, Ioannis Kompatsiaris, “Big Data Analytics for Large-Scale Multimedia Search”, Wiley 2019