Augmented reality and natural user interface applications for remote laboratories

Maiti, Ananda and Smith, Mark and Maxwell, Andrew D. and Kist, Alexander A. (2018) Augmented reality and natural user interface applications for remote laboratories. In: Cyber-physical laboratories in engineering and science education. Springer International Publishing, Cham, Switzerland, pp. 79-109.


Augmented reality (AR) has a great potential in creating rich user interfaces where users can view and interact with virtual objects. AR can have both passive objects and active objects. The former do not respond to interaction; the latter can be altered in their orientation, shape and position in relation to other virtual objects, for example. Remote laboratories (RLs) enable access to equipment and experiments via the Internet. This chapter focuses on the use of virtual objects in remote laboratories as an alternative, immersive user interface. Having an AR environment allows users to interact with experiments as virtual objects enabling hands-on experiences. This is made possible by using specialised natural user interface (NUI) devices. These devices can capture the natural movement of users and apply them to virtual objects. This chapter considers the role of AR and NUIs in the context of remote laboratories. It provides the context for AR and NUIs and discusses examples of systems that can be used. It demonstrates how users can interact with remote laboratories in these environments. NUI is part of the curriculum at the undergraduate level. This cyber-physical environment provides an ideal context to teach human-computer interaction (HCI). The first two sections of this chapter describe AR and using NUI in the RL environments. The last section introduces a practical example of using NUI and RL to teach HCI.

Statistics for USQ ePrint 34260
Statistics for this ePrint Item
Item Type: Book Chapter (Commonwealth Reporting Category B)
Refereed: Yes
Item Status: Live Archive
Additional Information: Permanent restricted access to Published version, in accordance with the copyright policy of the publisher.
Faculty / Department / School: Current - Faculty of Health, Engineering and Sciences - School of Mechanical and Electrical Engineering
Date Deposited: 21 Aug 2018 05:32
Last Modified: 12 Oct 2018 03:35
Uncontrolled Keywords: augmented reality, e-learning, remote laboratories, computer vision, virtual reality, human-computer interface, Kinect, 3D sensors, gesture recognition, computer networks
Fields of Research : 13 Education > 1301 Education Systems > 130199 Education systems not elsewhere classified
08 Information and Computing Sciences > 0801 Artificial Intelligence and Image Processing > 080104 Computer Vision
Socio-Economic Objective: C Society > 93 Education and Training > 9305 Education and Training Systems > 930502 Management of Education and Training Systems

Actions (login required)

View Item Archive Repository Staff Only