Digital guides on top of aerial work platforms
The goal of this project is to develop a mixed reality application to visualize digital guides on top of aerial work platforms. These guides are used by workers to safely use aerial work platforms without prior knowledge of the machines.
Read more about mixed reality here.Requirements
- MS Hololens Device
- Traditional platform manual
- Aerial work platform
- C# programming language
- 3D modelling / Animations
- Mixed Reality UX/UI design
- Vuforia Marker Tracing
Final result
The application explains step by step how to use the aerial work platform. The user can navigate through the steps by using the voice commands : "Next step", "Previous step" and "Repeat Step". The user can also open a small panel in his/her field of view that has a written text for each step by saying "Open Text". After testing the voice command we also added the tap gesture to go to the next step: the noise of the machine engine obstructed the microphone picking up the voice commands.
Aerial work platform control panel
Aerial work platform control panel
Hololens digital control panel
The user also sees a digital panel on top of the physical panel that gives extra information. For every step the panel lights up to be used buttons in the correct direction. So, by looking at the digital panel the user sees which buttons are connected to the current step.
Release
It opens perspectives, we certainly see a lot of possibilities in this technology, as Pascal Vanhalst said, it is a first step and can be improved, but we all see that we have to look at this. Kris Feys CIO - TVH Equipment
The application was successfully demoed at the TVH Event on 14th of January 2018. Two Aerial work platforms were installed and two people, both with no prior knowledge of the machines, were invited to operate the machines: one using the hololens as a guide, the other one using a traditional manual. The tester using the hololens won the race by far: he could lift the platform up in the air, while his opponent didn’t manage to stabilize the machine.
Interested in developing spatial computing solutions? get in touch