Multi-platform Interface


The multi-platform interface of our framework allows the programming of robots using both head-mounted and / or handheld AR devices. The latter offers the possibility of programming in the AR space as well as on the screen space, depicted as follows.

User interface on a head-mounted device (HoloLens)
Source: https://caehealthcare.com/hololens/

In AR user interface on a handheld device (Android mobile)
Source: https://developer.apple.com/design/human-interface-guidelines/ios/system-capabilities/augmented-reality/

On-screen user interface on a handheld device (Android mobile)
Source: https://developer.apple.com/design/human-interface-guidelines/ios/system-capabilities/augmented-reality/

The last two designs can be used interchangeably depending on the user's preferences.
To make the interaction with the framework even more straightforward and user-friendly, programs can be developed by using a method called Programming by Demonstration (PbD). This method simplifies the traditional robot programming by codes which makes it easier for a complete beginner or a user that has little programming skills to develop programs for the robot.