Cognitive Robotics: The Future of Robot Toys
Course ID 15694
Description This course explores the future of robot toys by analyzing and programming the VEX AIM robot, a new mobile robot with built-in AI algorithms that we will supplement with Python code and OpenAI API calls. The course's novel approach to robot intelligence combines state machine programming and Python coding with GPT prompt engineering. The lectures cover robot software architecture, human-robot interaction, robot perception, and planning algorithms for navigation and manipulation. Prior robotics experience is not required, just strong Python skills. In the final project, students implement a robot application of their own design that builds on what they have learned.
Key Topics
artificial intelligence, robotics, large language models
Required Background Knowledge
strong Python programming skills; ability to work in teams
Course Relevance
Undergradates who have passed 15-122 or equivalent, or masters students (who should take 15-694)
Course Goals
Understanding of robot perception, navigation, and planning, and of how large language models can be used to construct intelligent robot behaviors
Learning Resources
Python; vex-aim-tools (https://github.com/touretzkyds/vex-aim-tools)
Assessment Structure
Homework 50%; In-class quizzes 10%; Lab participation 10%; Final project 30%
Extra Time Commitment
n/a
Course Link
https://www.cs.cmu.edu/afs/cs.cmu.edu/academic/class/15494-s25