Learn to build AI-enabled robots that perceive, reason, and act in real-world environments.
Skills you will gain
- AI for Robotics: Understand how AI enables robots to sense, interpret, plan, and act in dynamic environments.
- Robotics Architecture: Learn how perception, language, reasoning, control, and autonomy fit together in robotic systems.
- Multimodal and Foundation Models: Explore how vision-language and vision-language-action models are shaping the next generation of robots.
- Model Development Workflow: Gain practical experience with data preparation, model training, evaluation, and deployment considerations for robotics applications.
- Industry Applications: Analyze real-world robotics use cases across industries such as logistics, manufacturing, autonomous vehicles, and emerging physical AI applications.
Course Description
Artificial intelligence is transforming robotics, enabling machines to perceive their surroundings, understand context, make decisions, and operate in complex real-world environments. This course introduces the AI techniques and system concepts behind modern intelligent robots, with applications across logistics, manufacturing, healthcare, autonomous navigation, service robotics, and emerging physical AI systems.
Students will study the core AI building blocks used in robotics, including perception, sensor fusion, mapping, object detection, segmentation, natural language interaction, reasoning, and learning-based decision-making. The course connects these techniques to practical robotics architectures and industry use cases, highlighting what it takes to move from a model or prototype to a deployed robotic system.
Students will gain hands-on exposure to model training and evaluation workflows while developing a systems-level understanding of how AI, software, sensors, and robotic behavior come together.
Learning Outcomes
Through discussion, technical demonstration and hands-on practice, you will learn to
- Design, develop, and deploy AI-driven applications for real-world robotic systems.
- Translate real-world use cases into effective AI-powered robotics solutions across various industries such as logistics, manufacturing, and healthcare.
- Apply machine learning techniques such as computer vision, sensor fusion, and decision-making models to enable robotic perception, control and autonomy.
Topics Include
- AI and robotics industry landscape
- Robotics system architecture
- Perception systems: cameras, sensors, and sensor fusion
- Object detection, classification, and segmentation
- SLAM, mapping, navigation, and manipulation
- Natural language interfaces for robots
- Multimodal AI and foundation models for robotics
- Vision-language-action models and emerging physical AI systems
- Data collection, model training, validation, and evaluation
- Case studies, demonstrations, and project presentations
- Demonstrations and project presentations
Skills Needed
Students should be proficient in programming languages, such as C++ or Python. Familiarity with machine learning concepts, AI/ML frameworks, linear algebra, and higher-level mathematics is recommended.
Additional Information
AI* - This course introduces the AI foundations of physical intelligence: how robots use perception, language, learning, and reasoning to operate in complex real-world environments using methods such as computer vision, deep learning, and multimodal foundation models.
- Live-Online Attend via Zoom at scheduled times.
| Date | Start Time | End Time | Meeting Type | Location |
|---|---|---|---|---|
| Sat, 09-26-2026 | 9:00am | 12:00pm | Live-Online | SANTA CLARA / REMOTE |
| Sat, 10-10-2026 | 9:00am | 12:00pm | Flexible | SANTA CLARA / REMOTE |
| Sat, 10-17-2026 | 9:00am | 12:00pm | Flexible | SANTA CLARA / REMOTE |
| Sat, 10-24-2026 | 9:00am | 12:00pm | Flexible | SANTA CLARA / REMOTE |
| Sat, 10-31-2026 | 9:00am | 12:00pm | Flexible | SANTA CLARA / REMOTE |
| Sat, 11-07-2026 | 9:00am | 12:00pm | Flexible | SANTA CLARA / REMOTE |
| Sat, 11-14-2026 | 9:00am | 12:00pm | Flexible | SANTA CLARA / REMOTE |
| Sat, 11-21-2026 | 9:00am | 12:00pm | Flexible | SANTA CLARA / REMOTE |
| Sat, 12-05-2026 | 9:00am | 12:00pm | Flexible | SANTA CLARA / REMOTE |
| Sat, 12-12-2026 | 9:00am | 12:00pm | Flexible | SANTA CLARA / REMOTE |
10/1: Please note that there will be no class meeting on 10/3. A makeup date has been scheduled for 12/12.
Students may still enroll if they missed the 1st class session. However, they need to communicate with the instructor via Canvas and catch up on all missed work prior to the 2nd class meeting.
This class meets simultaneously in a classroom and remotely via Zoom. Students are expected to attend and participate in the course, either in-person or remotely, during the days and times that are specified on the course schedule. Students attending remotely are also strongly encouraged to have their cameras on to get the most out of the remote learning experience. Students attending the class in-person are expected to bring a laptop to each class meeting.
No meeting on October 3 and November 28, 2026. To see all meeting dates, click "Full Schedule" below.
You will be granted access in Canvas to your course site and course materials approximately 24 hours prior to the published start date of the course.
Required Tools & Materials: Google Colab account
This course applies to these programs: