Use of Mobile Devices for Haptic Interaction for classifying 3D Geometrical Objects

Abstract: Technology is the main medium to spread inclusive education and reduce digital divide in almost all domains of disability. Accessibility measures, as e.g. alternative text, long description, often including raw table data, haptic graphics, do exist but in many aspects do not provide a good alternative user experience. Other, more sophisticated methods tend to be complex or expensive. We propose a new method for blind and low vision persons (BLV) to access 3D geometrical shapes using haptic/vibrating features of of-the-shelf mobile devices based on using a mobile application. The application converts 3D geometrical shapes into a 3D virtual model. The user can move the mobile device and thereby virtually explore and feel the 3D geometrical shapes. We develop a low cost inclusive application using augmented reality where sighted user can access objects/models visually (also using haptics if they want) together with BLVs, who explore the 3D geometrical objects. Each 3D shapes can be assigned with different vibration patterns and height with respect to the geometrical shape. This approach provides an easy to implement, inexpensive and of the shelf experimental setting for improving and augmenting the user experience in accessing 3D geometrical shapes. The approach is also considered for experimenting in STEM education and or other subjects using graphical representation. We expect a broad field for ideation, experimenting and sharing to support new approaches for accessibility and inclusive education and cooperation.