Establishing a Working Definition of User Experience for eHealth Interventions of Self-reported User Experience Measures With eHealth Researchers and Adolescents: Scoping Review

Newton, Amanda S. and March, Sonja ORCID: and Gehring, Nicole D. and Rowe, Arlen K. ORCID: and Radomski, Ashley D. (2021) Establishing a Working Definition of User Experience for eHealth Interventions of Self-reported User Experience Measures With eHealth Researchers and Adolescents: Scoping Review. Journal of Medical Internet Research, 23 (12):e25012. pp. 1-27. ISSN 1439-4456

Text (Published Version)
Newton et al. scoping review.pdf
Available under License Creative Commons Attribution 4.0.

Download (754kB) | Preview


Background: Across eHealth intervention studies involving children, adolescents, and their parents, researchers have measured user experience to assist with intervention development, refinement, and evaluation. To date, no widely accepted definitions or measures of user experience exist to support a standardized approach for evaluation and comparison within or across interventions. Objective: We conduct a scoping review with subsequent Delphi consultation to identify how user experience is defined and measured in eHealth research studies, characterize the measurement tools used, and establish working definitions for domains of user experience that could be used in future eHealth evaluations. Methods: We systematically searched electronic databases for published and gray literature available from January 1, 2005, to April 11, 2019. We included studies assessing an eHealth intervention that targeted any health condition and was designed for use by children, adolescents, and their parents. eHealth interventions needed to be web-, computer-, or mobile-based, mediated by the internet with some degree of interactivity. We required studies to report the measurement of user experience as first-person experiences, involving cognitive and behavioral factors reported by intervention users. We appraised the quality of user experience measures in included studies using published criteria: well-established, approaching well-established, promising, or not yet established. We conducted a descriptive analysis of how user experience was defined and measured in each study. Review findings subsequently informed the survey questions used in the Delphi consultations with eHealth researchers and adolescent users for how user experience should be defined and measured. Results: Of the 8634 articles screened for eligibility, 129 articles and 1 erratum were included in the review. A total of 30 eHealth researchers and 27 adolescents participated in the Delphi consultations. On the basis of the literature and consultations, we proposed working definitions for 6 main user experience domains: acceptability, satisfaction, credibility, usability, user-reported adherence, and perceived impact. Although most studies incorporated a study-specific measure, we identified 10 well-established measures to quantify 5 of the 6 domains of user experience (all except for self-reported adherence). Our adolescent and researcher participants ranked perceived impact as one of the most important domains of user experience and usability as one of the least important domains. Rankings between adolescents and researchers diverged for other domains. Conclusions: Findings highlight the various ways in which user experience has been defined and measured across studies and what aspects are most valued by researchers and adolescent users. We propose incorporating the working definitions and available measures of user experience to support consistent evaluation and reporting of outcomes across studies. Future studies can refine the definitions and measurement of user experience, explore how user experience relates to other eHealth outcomes, and inform the design and use of human-centered eHealth interventions.

Statistics for USQ ePrint 41182
Statistics for this ePrint Item
Item Type: Article (Commonwealth Reporting Category C)
Refereed: Yes
Item Status: Live Archive
Faculty/School / Institute/Centre: Current - Institute for Resilient Regions - Centre for Health Research (1 Apr 2020 -)
Faculty/School / Institute/Centre: Historic - Faculty of Health, Engineering and Sciences - School of Psychology and Counselling (1 Jan 2015 - 31 Dec 2021)
Date Deposited: 04 Mar 2022 04:10
Last Modified: 30 Mar 2022 03:35
Uncontrolled Keywords: Delphi; Design; Development; EHealth; Health care; Internet; Scoping review; User experience
Fields of Research (2008): 11 Medical and Health Sciences > 1117 Public Health and Health Services > 111799 Public Health and Health Services not elsewhere classified
Fields of Research (2020): 42 HEALTH SCIENCES > 4203 Health services and systems > 420302 Digital health
42 HEALTH SCIENCES > 4203 Health services and systems > 420313 Mental health services
32 BIOMEDICAL AND CLINICAL SCIENCES > 3213 Paediatrics > 321301 Adolescent health
Socio-Economic Objectives (2008): C Society > 92 Health > 9205 Specific Population Health (excl. Indigenous Health) > 920501 Child Health
Socio-Economic Objectives (2020): 20 HEALTH > 2004 Public health (excl. specific population health) > 200409 Mental health
20 HEALTH > 2005 Specific population health (excl. Indigenous health) > 200501 Adolescent health
20 HEALTH > 2003 Provision of health and support services > 200305 Mental health services
Identification Number or DOI:

Actions (login required)

View Item Archive Repository Staff Only