Machine Learning for Robotic Fabrication  


Syllabus


This seminar explores the intersection of machine learning and robotic fabrication, focusing on real-world applications in material manipulation, computer vision, and adaptive workflows. The course covers key ML techniques such as computer vision, reinforcement learning, and generative AI, applied to applications such as robotic assembly, 3D vision, and real-time fabrication processes. By the end of the seminar, students will have developed a working ML model integrated with a robotic fabrication task within the ROS framework.

 

Learning Objectives
By the end of this workshop, students will be able to:

  • Understand how to use the full range of the software stack from previous seminars
  • Understand how ML techniques apply to robotic fabrication workflows.
  • Utilize computer vision and 3D sensing for robotic perception.
  • Design ML models for material-aware fabrication and robotic control.
  • Collaborate in teams to develop and present an ML-driven fabrication prototype.

Keywords

  • Machine Learning in Fabrication
  • Machine Learning for Robotics
  • Computer Vision & 3D Sensing
  • Reinforcement Learning for Automation


Hardware / Software requirements 

Linux Ubuntu 20.04 or higher


Faculty


Faculty Assistants


Projects from this course

Software III _ UN_LOG FACTORY

Github : https://github.com/Clarrainl/UN_LOG-Factory | INTRODUCTION | Detecting wood defects in 3D-scanned logs using Machine Learning In the timber industry, a significant portion of wood gets discarded due to irregularities or defects that make it unusable under standard practices. However, many of these logs can still be used creatively or structurally if properly understood and classified. This project … Read more

Software III: AI Optimized Earth Injection Deposits

injection printing

Github: https://github.com/Adronegenius/Software-III-AI-Optimized-Earth-Injection-Deposits The process begins with human fabrication of woven modules using flexible rods or sticks. Due to tension, compression, and human variability, the woven pattern often deforms. Our system integrates computer vision to scan these deformations and a robotic arm to inject earth between structural members at optimized locations. This bridges physical craft and … Read more

Reinforcement Learning for Robot Obstacle Avoidance

adapted from IaaC´s Artificial Intelligence Program’s study of machine learning for robotic pick and place. (https://blog.iaac.net/reinforcement-learning-for-robotic-pick-and-place/research). Github Repository. https://github.com/LaurenD66/ROS-GridWorld-RL-with-Obstacles In a recent study by IaaC´s Artificial Intelligence Program, students used reinforcement learning models to train an (robotic) agent to move through a space defined by a simple grid from an origin to a goal, while … Read more