2022-2023 Undergraduate and Graduate Bulletin (with addenda) 
    Jun 22, 2024  
2022-2023 Undergraduate and Graduate Bulletin (with addenda)

ROB-GY 6323 Reinforcement Learning and Optimal Control for Robotics

3 Credits
What kind of movements should a robot perform in order to walk, jump or manipulate objects? Can it compute optimal behaviors online? Can it learn this directly from trial and error? This course will introduce modern methods for robotics movement generation based on numerical optimal control and reinforcement learning. It will cover fundamental topics in numerical optimal control (Bellman equations, differential dynamic programming, model predictive control) and reinforcement learning (actor-critic algorithms, model-based reinforcement learning, deep reinforcement learning) applied to robotics. It will also contain hands-on exercises for real robotic applications such as walking and jumping, object manipulation or acrobatic drones. Recommended background in at least one of the following: linear systems; robotics; machine learning; convex optimization; programming (python).

Prerequisite(s): ROB-GY 6003  or ECE-GY 6253  or ME-GY 6703 
Weekly Lecture Hours: 3