Macro workstep detection for assembly manufacturing

In this paper, we introduce a detection system for macro worksteps in a manufacturing assembly line using depth images. The sensor is mounted on the ceiling with a top-down angle. The system was deployed in a real life industrial process where workers had to assemble an ATM machine. Experimental results show the effectiveness of three identification approaches that were used: (1) template matching using a single template per macro workstep, (2) multiple templates for macro worksteps and (3) template matching and motion detection in order to detect the transition between each two consecutive macro worksteps. Each approach has its own benefits in terms of processing speed, accuracy and precision and we discuss them in details along with the challenges the system had, in the discussion section. The results are also investigated in details and we present the future plans for the proposed detection system.