101.789 AKNUM Reinforcement Learning
This course is in all assigned curricula part of the STEOP.
This course is in at least 1 assigned curriculum part of the STEOP.

2023S, VU, 4.0h, 6.0EC

Properties

  • Semester hours: 4.0
  • Credits: 6.0
  • Type: VU Lecture and Exercise
  • Format: Hybrid

Learning outcomes

After successful completion of the course, students are able to not only understand, to explain and to apply the theory and the methods of reinforcement learning including the latest developments, but also to implement the most important algorithms.

Subject of course

This year (2022) with updated lecture notes!

Reinforcement learning is a field of artificial intelligence and is concerned with the development of strategies that an agent uses to maximize its reward in a random environment in a model-free manner.

Applications include robotics (OpenAI gym), computer vision, games (such as Go, chess, Atari 2600, or Dota 2) at the human level or above and many more.  Furthermore, RL is instrumental for the working of ChatGPT.

Theory and algorithms of reinforcement learning:

  • Introduction
  • Bandit problems
  • Markov decision problems
  • Bellman equations
  • Hamilton-Jacobi-Bellman equation
  • Dynamic programming
  • Monte-Carlo learning
  • Temporal-difference learning
  • Tabular methods
  • Function approximation and deep learning
  • On-policy vs. off-policy
  • Eligibility traces
  • Policy gradients and actor-critic
  • RL with human feedback: InstructGPT and ChatGPT
  • Applications

In the tutorial, the theory will be repeated and extended and the algorithms will be implemented.

Teaching methods

Presentation, lecture notes, tutorial.

Mode of examination

Written

Additional information

Time for first meeting will be announced.

The class will be taught in presence, streamed, and recorded.

Lecturers

Institute

Course dates

DayTimeDateLocationDescription
Tue11:00 - 13:0007.03.2023 - 27.06.2023Sem.R. DB gelb 10 Reinforcement Learning VU
Thu11:00 - 13:0009.03.2023 - 29.06.2023Sem.R. DB gelb 03 Reinforcement Learning VU
AKNUM Reinforcement Learning - Single appointments
DayDateTimeLocationDescription
Tue07.03.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Thu09.03.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU
Tue14.03.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Thu16.03.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU
Tue21.03.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Thu23.03.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU
Tue28.03.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Thu30.03.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU
Tue18.04.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Thu20.04.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU
Tue25.04.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Thu27.04.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU
Tue02.05.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Thu04.05.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU
Tue09.05.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Thu11.05.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU
Tue16.05.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Tue23.05.202311:00 - 13:00Sem.R. DB gelb 10 Reinforcement Learning VU
Thu25.05.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU
Thu01.06.202311:00 - 13:00Sem.R. DB gelb 03 Reinforcement Learning VU

Examination modalities

Continuously in tutorials; written tests.

Course registration

Begin End Deregistration end
06.03.2023 00:00 12.04.2023 00:00 12.04.2023 00:00

Curricula

Study CodeObligationSemesterPrecon.Info
066 645 Data Science Mandatory elective
860 GW Optional Courses - Technical Mathematics Not specified

Literature

 Lecture notes (in English) will be handed out.

Previous knowledge

The theoretical aspects will be explained in the lectures in a self-contained manner so that the course can be taken during or after the fourth semester.

Miscellaneous

Language

if required in English