CENG 567

Reinforcement Learning

CENG567 Reinforcement Learning

This course introduces reinforcement learning, covering key techniques like multi-armed bandits, Q-learning, and deep reinforcement learning. Students will learn decision-making under uncertainty and apply advanced methods like actor-critic models to real-world problems.

Course Objectives

This course introduces reinforcement learning, covering key techniques like multi-armed bandits, Q-learning, and deep reinforcement learning. Students will learn decision-making under uncertainty and apply advanced methods like actor-critic models to real-world problems.

Course Content

Multi-armed bandits, epsilon greedy, upper confidence bounds, thompson sampling, contextual bandits, markov decision process, dynamic programming, policy and value iteration, monte carlo methods, temporal difference, Q-learning, deep Q-learning, actor-critic models.

Course Coordinator

Dr. Öğretim Üyesi Alper Demir

Course Lecturer(s)

Dr. Öğretim Üyesi Alper Demir

Recommended or Required Reading

Richard S. Sutton, Andrew G. Barto. Reinforcement Learning: An Introduction. Bradford Books, 2nd ed., 2018.

Learning Outcomes

  1. To understand reinforcement learning fundamentals and key concepts.
  2. To apply core algorithms like Q-learning and deep Q-learning.
  3. To analyze Markov decision processes and policy optimization.
  4. To implement reinforcement learning solutions in real-world scenarios.
Week Topics
1 Introduction (Related Reading: Sutton & Barto Ch. 1)
2 Multi-armed Bandits (Related Reading: Sutton & Barto Ch. 2)
3 Markov Decision Processes (Related Reading: Sutton & Barto Ch. 3)
4 Dynamic Programming (Related Reading: Sutton & Barto Ch. 4)
5 Monte Carlo Methods (Related Reading: Sutton & Barto Ch. 5)
6 Temporal-Difference Learning (Related Reading: Sutton & Barto Ch. 6)
7 n-step Bootstrapping (Related Reading: Sutton & Barto Ch. 7)
8 Planning and Learning with Tabular Methods (Related Reading: Sutton & Barto Ch. 8)
9 Value Function Approximation & Eligibility Traces (Related Reading: Sutton & Barto Ch. 9, 12)
10 Policy Gradient Methods & Actor-Critic (Related Reading: Sutton & Barto Ch. 13 + Papers)
11 Deep RL Methods (Related Reading: Selected Papers)
12 Advanced Topics (Related Reading: Selected Papers)
13 Advanced Topics (Related Reading: Selected Papers)
14 Paper Presentations

Assignments (3): 24%

Midterm: 25%

Final: 35%

Paper Presentation: 16%