Carnegie Mellon University

Carnegie Mellon Robotics Academy

Use educational affordances of robotics to create CS-STEM opportunities for all learners

applied-ai-curriculum

Applied AI and Robotics with NVIDIA Jetson Nano

Applied AI and Robotics with NVIDIA Jetson Nano provides a hands-on, project-based introduction to the fundamentals of artificial intelligence, machine learning, perception, and autonomy within real-world contexts.



This course leverages a scaffolded series of interactive labs and the NVIDIA Jetson Nano on the JetBot platform to cover core AI and ML techniques – Classification, Regression, Transfer Learning, and Reinforcement Learning – applied to robotic tasks like Collision Avoidance, Path Following, and Autonomous Racing. Learners gain a generalizable understanding of how AI enables robots to perceive and autonomously interact with their environment.

resnet18_jetbot_classification.png

Applied AI and Robotics is broken up into 5 different units. Within the units, students will engage with their robot and learn core concepts through step-by-step, media-driven instructional content, “Try It” remix activities, mini-challenges, “Check Your Understanding” questions, a culminating end-of-unit challenge to apply what they have learned, and an end-of-unit quiz.  

getting-started-with-jetbot_small.png Autonomous Systems are comprised of hardware and software enabling machines to operate independently. In this unit, participants will configure their JetBot, including software, network requirements, assembly, and initial operation. 
basic-navigation_small.png Autonomous systems like the JetBot can be configured to navigate using pre-programmed routines, operator teleoperation, or a blend of both. This unit guides participants through motion control,  precise navigation techniques, and teleoperation.
collision-avoidance-and-path-following_small.png To prepare to navigate unknown environments, autonomous systems are often trained with data from known environments. This unit emphasizes the importance of data collection and labeling for applications like Collision Avoidance and Path Following. Participants will perform supervised learning techniques, utilizing Classification for detecting obstacles and Regression for path prediction. 
autonomous-racing_small.png Reinforcement Learning is a type of machine learning where a robot learns to make decisions through trial-and-error. In Autonomous Racing, the robot learns through trial-and-error as it drives on the track. In this unit, participants collect data from the track, train and visualize the base model, and then provide feedback to the robot as it learns to race.
localization_small.png AprilTags are a special type of marker that allows a robot to know its precise position (localization) and orientation (pose estimation) for accurate navigation. In this unit, participants calibrate the camera to improve AprilTag detection accuracy and leverage ROS (Robot Operating System) to perform waypoint navigation with the AprilTag markers. 

Robot Hardware and Software

The following is recommended in order to take this course:

Other Materials