Collaborative timber joint assembly: Augmented reality for multi-level human-robot interaction

This research introduces an innovative Augmented Reality (AR) workflow for Human-Robot Interaction (HRI) in timber construction. The approach leverages human dexterity and adaptability alongside the strength and precision of robotic arms to assemble timber structures connected by wood-wood connections. While research in the field of automated construction generally focuses on singular interactions, such as robot agents carrying components and human agents attaching them, this paper explores multiple degrees of interaction involving cooperation or collaboration between agents. A new algorithmic framework is developed to automate the generation of holographic instructions and allocate assembly tasks to human and robot agents according to their abilities. The application to a full-scale demonstrator reveals that certain elements necessitate collaboration for assembly, while others can exclusively be assembled manually or robotically. Ultimately, the research also highlights the benefits of AR in assisting manual assembly, simulating robot trajectories, and increasing safety during collaborative tasks.