CENG 567
Reinforcement Learning
This course introduces reinforcement learning, covering key techniques like multi-armed bandits, Q-learning, and deep reinforcement learning. Students will learn decision-making under uncertainty and apply advanced methods like actor-critic models to real-world problems.
Course Objectives
This course introduces reinforcement learning, covering key techniques like multi-armed bandits, Q-learning, and deep reinforcement learning. Students will learn decision-making under uncertainty and apply advanced methods like actor-critic models to real-world problems.
Course Content
Multi-armed bandits, epsilon greedy, upper confidence bounds, thompson sampling, contextual bandits, markov decision process, dynamic programming, policy and value iteration, monte carlo methods, temporal difference, Q-learning, deep Q-learning, actor-critic models.
Course Coordinator
Dr. Öğretim Üyesi Alper Demir
Course Lecturer(s)
Dr. Öğretim Üyesi Alper Demir
Recommended or Required Reading
Richard S. Sutton, Andrew G. Barto. Reinforcement Learning: An Introduction. Bradford Books, 2nd ed., 2018.
Learning Outcomes
- To understand reinforcement learning fundamentals and key concepts.
- To apply core algorithms like Q-learning and deep Q-learning.
- To analyze Markov decision processes and policy optimization.
- To implement reinforcement learning solutions in real-world scenarios.
| Week | Topics |
| 1 | Introduction (Related Reading: Sutton & Barto Ch. 1) |
| 2 | Multi-armed Bandits (Related Reading: Sutton & Barto Ch. 2) |
| 3 | Markov Decision Processes (Related Reading: Sutton & Barto Ch. 3) |
| 4 | Dynamic Programming (Related Reading: Sutton & Barto Ch. 4) |
| 5 | Monte Carlo Methods (Related Reading: Sutton & Barto Ch. 5) |
| 6 | Temporal-Difference Learning (Related Reading: Sutton & Barto Ch. 6) |
| 7 | n-step Bootstrapping (Related Reading: Sutton & Barto Ch. 7) |
| 8 | Planning and Learning with Tabular Methods (Related Reading: Sutton & Barto Ch. 8) |
| 9 | Value Function Approximation & Eligibility Traces (Related Reading: Sutton & Barto Ch. 9, 12) |
| 10 | Policy Gradient Methods & Actor-Critic (Related Reading: Sutton & Barto Ch. 13 + Papers) |
| 11 | Deep RL Methods (Related Reading: Selected Papers) |
| 12 | Advanced Topics (Related Reading: Selected Papers) |
| 13 | Advanced Topics (Related Reading: Selected Papers) |
| 14 | Paper Presentations |
Assignments (3): 24%
Midterm: 25%
Final: 35%
Paper Presentation: 16%
Instructor(s)
- CENG 500
- CENG 501
- CENG 502
- CENG 503
- CENG 504
- CENG 505
- CENG 506
- CENG 507
- CENG 508
- CENG 509
- CENG 511
- CENG 512
- CENG 513
- CENG 514
- CENG 515
- CENG 516
- CENG 517
- CENG 518
- CENG 521
- CENG 522
- CENG 523
- CENG 524
- CENG 525
- CENG 526
- CENG 531
- CENG 532
- CENG 533
- CENG 534
- CENG 541
- CENG 542
- CENG 543
- CENG 544
- CENG 551
- CENG 552
- CENG 555
- CENG 556
- CENG 557
- CENG 561
- CENG 562
- CENG 563
- CENG 564
- CENG 565
- CENG 566
- CENG 568
- CENG 590
- CENG 599
- CENG 608
- CENG 611
- CENG 612
- CENG 613
- CENG 631
- CENG 632
- CENG 641
- CENG 642
- CENG 643
- CENG 651
- CENG 661
- CENG 662
- CENG 663

