Neural Networks and Deep Learning


IMPORTANT NOTICE:
This course will start on January 12, 2027, at 9:00.
Lectures will be opened to everybody and will be given online on the following channel.
Please, connect 10 minutes before 9:00 to avoid disturbing the lecture.

Registration

To access the channel of the lectures and receive notifications about any change on course lectures, please register here by December 15th.


Certification of attendance

If you need a certification of attendance, be aware that the number of hours that will be certified are those recorded by Teams.


Course Program and Lectures Schedule

This course includes four modules, which can also be taken independently:
  1. Theoretical Foundations: This module (40 hours) explains many fundamental concepts of neural networks, including unsupervised learning, clustering algorithms, supervised learning, autoencoders, convolutional networks, recurrent networks, transformers, semi-supervised learning, multi-object tracking, and generative networks. It is highly recommended to attend this module, even if you are familiar with some topics, since many concepts explained here will be used in the other modules.
    Responsible teacher: Giorgio Buttazzo.
  2. Reinforcement Learning: This module (20 hours) focuses on reinforcement learning (RL), including Q-learning, deep RL, policy gradient methods, actor-critic methods, stochastic RL, curiosity-based learning, imitation learning, and model-based RL.
    Responsible teacher: Giorgio Buttazzo.
  3. Trustworthy AI and Applications: This module (20 hours) focuses on how to make deep networks more trustworthy, interpretable, and secure.
    Responsible teacher: Giulio Rossolini.
  4. Hardware Acceleration: This module (20 hours) covers practical and implementation issues and hardware acceleration methods.
    Responsible teacher: Federico Aromolo.

Part I: Theoretical Foundations (Giorgio Buttazzo)

Course program (pdf)
  1. Basic concepts and learning paradigms
  2. Hopfield networks
  3. Unsupervised learning
  4. Clustering algorithms
  5. Supervised learning: From perceptron to Backpropagation
  6. Supervised learning: Important Remarks
  7. Supervised learning: Performance metrics
  8. Supervised learning: other approaches (RBF networks, PINNs)
  9. Towards Deep Neural Networks
  10. Convolutional Neural Networks (CNNs)
  11. Autoencoders
  12. CNNs for object classification
  13. CNNs for object detection
  14. CNNs for image segmentation
  15. Deformable Convolutions
  16. Anchor-free detection networks
  17. Recurrent neural networks
  18. Natural language processing
  19. Transformers
  20. Semi-supervised learning
  21. Neural networks for multi-object tracking
  22. Generative networks

Part II: Reinforcement Learning (Giorgio Buttazzo)

Course program (pdf)
  1. The reinforcement learning paradigm
  2. Value estimation methods
  3. Control methods: Q-learning and variants
  4. Examples of applications
  5. Implementing Q-learning in C
  6. Deep Reinforcement Learning
  7. Actor-Critic methods
  8. Policy gradient methods
  9. Stochastic reinforcement learning
  10. Curiosity-based learning
  11. Imitation learning: direct policy learning
  12. Imitation learning: inverse reinforcement learning
  13. Imitation learning: adversarial reinforcement learning
  14. Model-based reinforcement learning

Part III: Trustworthy AI and Applications (Giulio Rossolini)

Please visit the following link: Part III: Trustworthy AI

Part IV: Hardware Acceleration (Federico Aromolo)

Please visit the following link: Part IV: Implementation Issues

Exam

The exam (for those who need to take it) consists in a project development. The project is one for each module and must be agreed with the teacher responsible for the module. Be aware that the number of hours that will be certified are those recorded by Teams. The completion of the exam requires the project discussion and the delivery of the project code, including a report describing the work done. Please, read carefully the project rules in the link below.

Suggested readings

Books Introductory readings For those who like to look into the future