Syllabus

Unlock the potential of advanced robotics through our comprehensive workshop that explores the synergy of key technologies. Delving into the heart of robotic intelligence, this program revolves around harnessing the capabilities of ROS and OpenCV for seamless navigation and precision image collection. Explore the fascinating world of 3D modeling using Agisoft, transforming captured images into intricate and realistic three-dimensional representations.

Take your skills to the next level by integrating Deep Learning techniques, empowering you to tackle complex image processing tasks with confidence. Gain insights into enhancing robotic vision and decision-making processes through state-of-the-art Deep Learning methodologies.

Beyond the algorithms, we invite you to explore the intersection of robotics and the online world. Learn the essentials of web visualization, opening doors to presenting and interacting with your robotic creations in a dynamic online environment. Discover the art of showcasing your robotics projects on the web, fostering collaboration and communication.

This workshop provides a balanced blend of theory and hands-on exercises in ROS, OpenCV, Agisoft Metashape, Deep Learning and web visualization.

2025 objectives:

  • Rover
    • Teleoperation 
      • General hardware on the Husky
      • Topics necessary for navigation
    • SLAM
      • FastLIO w/ Lidar
  • Sensors → 3D reconstruction
    • Camera + photogrammetry
    • RGBD
    • Thermal
    • 2D lidar (map)
    • 3D lidar (point cloud)
  • Data
    • Photogrammetry
    • Lidar Scanning
  • Tools
    • OpenCV
    • Open3D
    • Agisoft Metashape
    • Clustering?

Learning Objectives 

The workshop aims to achieve the following learning objectives:

  • Gain a comprehensive understanding of the ROS framework, exploring its diverse possibilities, and learning to program robots. Participants will transition seamlessly from a simulation environment to real-world applications.
  • Develop the capability to create projects in ROS using RDS (ROS Development Studio) and to use Docker for ROS simulations.
  • Comprehend the fundamental concepts of computer vision in the context of robotics.
  • Students will learn to program basic exercises using OpenCV and Python for image processing.
  • Apply ROS and OpenCV knowledge to navigate robots in a real-world environment, analyzing space through robot cameras and responding accordingly.
  • Establish a systematic workflow for extracting and managing data, facilitating the organization and communication of pertinent point cloud information.
  • Work proficiently with Metashape Agisoft software, mastering the technique of photogrammetry to create intricate 3D models.
  • Gain insight into various 3D modeling techniques beyond Agisoft.
  • Receive an introduction to Deep Learning models, empowering participants to train their own models for application with 3D models
  • Learn how to visualize the constructed point cloud in a custom web interface, enhancing clarity and accessibility.

This workshop is designed to equip participants with a basic skill set in ROS, OpenCV, Agisoft, and Deep Learning, fostering the ability to seamlessly integrate these technologies into real-world applications.

Keywords 

  • ROS (Robot Operating System)
  • Simulation environment
  • RDS (ROS Development Studio)
  • Docker
  • Computer vision
  • OpenCV
  • Image processing
  • Robot navigation
  • Space analysis
  • Point cloud
  • Data extraction
  • Photogrammetry
  • 3D models
  • Deep Learning
  • Model training
  • Web interface
  • Point cloud visualization

Faculty


Projects from this course

Robotics Solutions for Building Anomaly Detection

Introduction In the face of increasing climate-related disasters, accurate and efficient scanning methods are essential for assessing structural integrity. Our team developed a robotic scanning solution that utilizes LiDAR-based Husky A200 and drone photogrammetry to detect roof anomalies, such as holes and structural weaknesses.This study explores different scanning methodologies and evaluates their effectiveness in detecting … Read more

Smart Waste Management

Mobile Robotic Scanning & Discrete Element Analysis This workshop served as an introduction to mobile robotics for scanning. We explored various types of mobile robots and different kinds of sensors, focusing on how they integrate with one another to enable diverse scanning approaches. Based on these investigations, we designed a specific scanning methodology suited to … Read more

Robotics Solutions for 3D Space Analysis

Github : https://github.com/j-albo/robotic-3d-space-analysis INTRODUCTION Scanning irregular terrains with today’s scanning technology is crucial for obtaining precise environmental models, optimizing planning and execution in architectural projects. Its high-resolution capture capability allows for mapping complex surfaces and detecting floor level variations imperceptible to the human eye, improving efficiency and reducing errors in design and construction. WHY USING A MOBILE … Read more