Human-Robot Interaction - Workshop at Design Modeling Symposium 2024

Despite recent advancements in robotics for autonomous operations in unstructured environments, their use in construction has been mostly limited to executing predefined plans. However, the unpredictable nature of construction sites and potential errors in planning necessitate higher adaptability in the execution setup to accommodate on-the-fly adjustments or reconfiguration of elements. Human-in-the loop fabrication workflows are particularly well-suited to address these challenges by blending the flexibility and intuition of humans with the precision of robots, creating a powerful partnership. For instance, this can enable humans to intervene in order to mitigate material uncertainties and positioning misalignments. Nevertheless, the interaction modalities between humans and machines typically require both actors to work in close proximity within hazardous environments posing safety risks and logistical difficulties. Moreover, the task of instructing the robots to make changes is challenging due to the scale of the structures being fabricated and the unintuitive robotic constraints.This workshop proposes a novel, hybrid synergetic workflow that enhances human-robot interaction (HRI) to support dynamic and reconfigurable fabrication processes. Humans can intervene by modifying a scaled-down version of the structure, thereby enabling more intuitive and safe adjustments in the building process.

In this workshop, participants will be introduced to collaborative robots (cobots) in the context of digital spatial assembly, their implementation challenges, and how human-in-the-loop strategies can help to overcome them. During the two days, they will get an overview of the digital tools and processes employed for hybrid human-robot construction teams and HRI strategies. We will work hands-on to collaboratively build a structure and explore how humans can intervene remotely in robotic assemblies by manipulating a work-in-progress small-scale physical model. The actions taken on the scaled physical model are recognized and processed with a custom computational tool that maps them to executable tasks for the collaborative robotic setup. This interaction method provides a hands-on medium for non-experts and establishes a communication protocol with the robotic setup outside of the construction zone. As such, our approach aims to lower the barrier for engagement with robotic construction processes and minimize safety risks when working in construction sites.

Initially, participants will interact with the small-scale model made of simplified props as a means of remote instruction and intervention within the robotic timber assembly process. They will be able to experiment and instruct remotely the placement of new elements, as well as disassembly and reconfiguration actions of the full-scale structure. Our system will capture human actions, enabling the creation of a digital counterpart for the small-scale model. A developed algorithm will provide feedback f