20-00-1047-iv Reinforcement Learning: From Foundations to Deep Approaches

Course offering details

Instructors: Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo

Event type: Integrated Course

Org-unit: Dept. 20 - Computer Science

Displayed in timetable as: RL

Subject:

Crediting for:

Hours per week: 4

Language of instruction: German and English

Min. | Max. participants: - | -

Course Contents:
• Markov Decision Process
• Value Functions, Bellman Operator, Policies
• Dynamic Programming
• Monte-Carlo Reinforcement Learning
• Temporal Difference Learning
• Tabular Reinforcement Learning
• Reinforcement Learning with Function Approximation
• Deep Q-Learning
• On-policy and off-policy deep actor-critic
• Model-based Reinforcement Learning
• Intrinsic Motivation
 

Literature:
Reinforcement Learning: An Introduction, Sutton and Barto, 2nd Edition: http://incompleteideas.net/book/RLbook2018.pdf

Preconditions:
Good programming in Python.
Lecture Statistical Machine Learning is helpful but not mandatory.

Official Course Description:
Motivation:

"The fundamental challenge in artificial intelligence and machine learning is learning to make good decisions under uncertainty," -- Emma Brunskill. 

Reinforcement learning (RL) is an area of machine learning concerned with how intelligent agents should take actions in an environment to maximize the cumulative rewards. Reinforcement learning is one of three basic machine learning paradigms, alongside supervised learning and unsupervised learning. RL differs from supervised learning in not needing labeled input/output pairs to be presented and not needing sub-optimal actions to be explicitly corrected. Instead, the focus is on finding a balance between exploration (uncharted territory) and exploitation (of current knowledge).

About this course:

This course will take you through the foundation of reinforcement learning methods till recent deep reinforcement learning advances. By the end of this course, you will have a solid knowledge of the field, and you will be able to solve problems with different reinforcement learning algorithms. This course serves as an excellent background for people wanting to carry out reinforcement learning research independently,  e.g., within the scope of a Bachelor's or Master's thesis. 

Additional Information:
The in-person lecture will be accompanied by an online problem-solving solving session (coding exercises) and Q&A session. 

Online Offerings:
moodle

Literature
Appointments
Date From To Room Instructors
1 Mon, 17. Apr. 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
2 Mon, 24. Apr. 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
3 Mon, 8. May 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
4 Mon, 15. May 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
5 Mon, 22. May 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
6 Mon, 5. Jun. 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
7 Mon, 12. Jun. 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
8 Mon, 19. Jun. 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
9 Mon, 26. Jun. 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
10 Mon, 3. Jul. 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
11 Mon, 10. Jul. 2023 11:30 13:30 S202/C205 ROOM CLOSED Prof. Ph.D. Georgia Chalvatzaki; Ph.D. Davide Tateo
Class session overview
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
Instructors
Prof. Ph.D. Georgia Chalvatzaki
Ph.D. Davide Tateo