A framework to evaluate performance from an application and user perspective

Kist, Alexander A. (2011) A framework to evaluate performance from an application and user perspective. In: Australian Telecommunication Networks and Applications Conference (ATNAC 2011) , 9-11 Nov 2011, Melbourne, Australia.


Experience related performance measures are important for operational, commercial as well as usability reasons. Quality of Experience (QoE) is widely discussed as a measure of user perceived performance, no universal definition for QoE are available. Instead of moulding QoE into a one-fits-all parameter, this work identifies and defines four specific performance measures that are more descriptive than traditional QoE. They account for objective and subjective measures and focus on applications and tasks specific performance. The parameters include Quality of (an) Application (QoA) and Quality of Use (QoU). They are further divided into objective and subjective measures, i.e. objective QoA, subjective QoA, objective QoU and subjective QoU. Subjective QoA reassembles QoE widely discussed in technical literature; QoU provides a measure for quality of experience in a more general, non technical sense. It is proposed that these individual performance parameters provide a better picture of performance and allow stakeholders to make more specific decisions. The paper also introduces a set of sample performance evaluations for the Remote Access Laboratories application to demonstrate how this framework can be applied and how such parameters can be measured.

Statistics for USQ ePrint 20065
Statistics for this ePrint Item
Item Type: Conference or Workshop Item (Commonwealth Reporting Category E) (Paper)
Refereed: Yes
Item Status: Live Archive
Additional Information: © 2011 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Faculty / Department / School: Historic - Faculty of Engineering and Surveying - Department of Electrical, Electronic and Computer Engineering
Date Deposited: 19 Apr 2012 02:37
Last Modified: 08 Jan 2015 02:55
Uncontrolled Keywords: quality of experience; performance evaluation; remote access laboratories
Fields of Research : 13 Education > 1303 Specialist Studies in Education > 130306 Educational Technology and Computing
15 Commerce, Management, Tourism and Services > 1505 Marketing > 150501 Consumer-Oriented Productor Service Development
10 Technology > 1005 Communications Technologies > 100503 Computer Communications Networks
Socio-Economic Objective: E Expanding Knowledge > 97 Expanding Knowledge > 970109 Expanding Knowledge in Engineering
Identification Number or DOI: 10.1109/ATNAC.2011.6096668
URI: http://eprints.usq.edu.au/id/eprint/20065

Actions (login required)

View Item Archive Repository Staff Only