3D Sensing and System Integration for Autonomous Robots


Syllabus

This hands-on seminar introduces students to 3D perception as a functional component of autonomous robotic systems, with a strong emphasis on system integration and engineering clarity. Rather than treating sensing, reconstruction, and visualization as isolated tasks, the seminar frames 3D spatial information as operational knowledge that enables robots to make decisions and act in the physical world.

Students will explore different sensing techniques and 3D representations, and learn how spatial data flows through an autonomous system—from sensors, to perception pipelines, to decision-making and action. The seminar emphasizes coherent system architecture, explicit data flow, and feasibility-driven implementation.

Working in small groups, students will develop a rapid prototype demonstrating how 3D perception can support a simple autonomous behavior in a mobile robot. The focus is not on building complete navigation systems, but on understanding and implementing the minimal components required to close the perception–action loop with the required assumptions necessary.

 

Learning Objectives
At course completion the student will be able to:

  • Understand the role of 3D sensing and perception within autonomous robotic systems
  • Compare different sensing modalities and 3D representations
  • Design a basic perception pipeline for spatial understanding
  • Integrate perception, reasoning, and decision layers into a coherent system
  • Implement a rapid computational prototype using Python and ROS 2
  • Critically evaluate system limitations, assumptions, and failure cases
  • Clearly communicate system architecture and technical decisions

Faculty


Faculty Assistants


Projects from this course

Woodscreen – structural analysis

Architectural proposal A lightweight modular timber structure made from actively bent locally sourced beech wood processed into strips. By using curvature and pre-stressing the elements, the system achieves stiffness with minimal material, and its scalable logic makes it suitable as a lightweight spanning beam system supported by column brackets. Conceptual analyses Idealization of the structural … Read more

Software III: From Form to Force: Structural Exploration with Karamba.

Introduction This study focuses on the application of Karamba3D for structural analysis and performance evaluation. Through digital simulations, different geometries and loading conditions were assessed to understand force distribution, displacement, and structural behavior. The objective is to investigate how structural analysis can support informed design decisions during the development process. Architecture Proposal The structural investigation … Read more

Software III: Structural Testing with Karamba. Optimizing Our Adaptive Willow Wall System

As part of our Software III course at IAAC, our team conducted a comprehensive structural analysis on our Willow Protocols system using Karamba, a parametric structural analysis plugin for Grasshopper. The Challenge: Beyond Aesthetics Our Adaptive Willow Wall is designed as a collaborative human-robot woven structure with variable thickness, integrated furniture, and thermal performance. While … Read more

Software -II- Brick-Scan

This article presents a project exploring how collected data can be processed and translated into automated classification and robotic decision-making logic. The core concept revolves around studying the physical condition and spatial arrangement of reclaimed construction material, extracting geometry-based and surface-level information to generate a data-driven sorting and retrieval workflow. By combining artificial intelligence with … Read more

AEGIS – Autonomous Emergency Geostructural Inspection System

Solutions for Rapid Data Acquisition in Disaster Scenarios This project explores a robotic perception pipeline designed to support post-disaster assessment and early response scenarios. The core objective is to detect and map cracks in damaged buildings using vision-based data, assisting rescue teams by providing spatial information about potentially unsafe areas. Rather than aiming for full … Read more