Development of the Telehealth Usability Questionnaire (TUQ).
Parmanto B, Lewis AN, Graham KM, Bertolet MH. · 2016
Read Development of the Telehealth Usability Questionnaire (TUQ). by Parmanto B, Lewis AN, Graham KM, Bertolet MH. (2016) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc4985278.txt.
Introduction
Bambang Parmanto, Allen Nelson Lewis, Kristin M. Graham, and Marnie H. Bertolet build a new survey for rating telehealth visits. Their paper appeared in the International Journal of Telerehabilitation in 2016. Older surveys assumed telehealth meant clinic video systems. Care has since moved to home computers and common software. A scale built for that world was missing, so the team built one and tested how well it holds up.
The survey scores both the screen tools patients and clinicians face and the quality of the remote visit itself. Checks showed the tool is sound and works across many uses. The authors argue ease of use is not a small point: a system patients cannot run delivers no care at all. They offer the survey for judging new telehealth programs and for weighing one platform against another.
Catalog record
| CREATOR | Parmanto B, Lewis AN, Graham KM, Bertolet MH. |
|---|---|
| YEAR | 2016 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Development of the Telehealth Usability Questionnaire (TUQ) By BAMBANG PARMANTO, ALLEN NELSON LEWIS, KRISTIN M. GRAHAM, MARNIE H. BERTOLET Published in: International Journal of Telerehabilitation DOI: 10.5195/ijt.2016.6196 ABSTRACT Current telehealth usability questionnaires are designed primarily for older technologies, where telehealth interaction is conducted over dedicated videoconferencing applications. However, telehealth services are increasingly conducted over computer-based systems that rely on commercial software and a user supplied computer interface. Therefore, a usability questionnaire that addresses the changes in telehealth service delivery and technology is needed. The Telehealth Usability Questionnaire (TUQ) was developed to evaluate the usability of telehealth implementation and services. This paper addresses: (1) the need for a new measure of telehealth usability, (2) the development of the TUQ, (3) intended uses for the TUQ, and (4) the reliability of the TUQ. Analyses indicate that the TUQ is a solid, robust, and versatile measure that can be used to measure the quality of the computer-based user interface and the quality of the telehealth interaction and services. In order to reap the potential benefits of telehealth technologies, the delivery system has to be usable for both patients and clinicians. Usability is the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use (ISO, 1992). This construct is a key to making systems easy to learn and easy to use (Nielsen & Mack, 1994). Measuring the usability of telehealth technology offers a way to evaluate and improve the effectiveness of both the technology and services delivered. Traditionally, telehealth and telemedicine have been conducted over videoconferencing technologies such as Cisco-Tandberg and Polycom. Systems such as Cisco-Tanberg and Polycom are designed for the sole purpose of videoconferencing. However, recent advances in technologies allow videoconferencing to be conducted using multi-purpose computer technologies. Examples include VSee, Adobe Connect, and Cisco WebEx. These multipurpose technologies allow consumers to deliver telehealth using computer software applications instead of traditional videoconferencing systems which are primarily hardware based. In addition to multi-purpose technology, there have been software applications developed specifically for telehealth purposes. These include the Versatile Integrated System for Telerehabilitation (VISYTER) (Parmanto et al., 2010) and EHAB (Peel, Russel, & Gray, 2011) systems. A review of the literature found a number of telehealth questionnaires developed mostly in the early 2000s, including the Telemedicine Satisfaction Questionnaire (TSQ) (Yip, Chang, Chan, & MacKenzie., 2003), Telemedicine Patient Questionnaire (TMPQ) (Demeris et al., 2000, 2004), and Telemedicine Satisfaction and Usefulness Questionnaire (TSUQ) (Bakken, 2009). However, the questionnaires developed in these previous studies were designed to evaluate special purpose videoconferencing technologies. In order to reap the potential benefits of current telehealth technologies, the delivery system has to be usable for both patients and clinicians. The questionnaires commonly employed to measure usability of a telehealth system, including user experience and satisfaction with various aspects of the technology or service, typically use a Likert scale approach to assessment (Mair & Whitten, 2000). Since telehealth technology connects clinicians and patients over a distance, the usability questionnaire is designed to measure the quality of the interactions between two sites (e.g., audiovisual quality, quality of communications, ease of use of the equipment) (Houston & Burton, 1997), and the overall impression of the service (i.e., level of comfort and satisfaction with the telemedicine encounter) (Bakken et al., 2006; Yip et al., 2003). The objective of the present study is to report on the development and reliability assessment of a new usability tool, the Telehealth Usability Questionnaire (TUQ). The TUQ combines items from existing telehealth questionnaires with those from computer usability questionnaires, and was designed to be a comprehensive questionnaire that covers all usability factors (i.e., usefulness, ease of use, effectiveness, reliability, and satisfaction). The TUQ is intended for both clinicians and patients. In addition, the TUQ is intended for use with various types of telehealth systems, including the traditional videoconferencing systems, computer-based systems, and the new generation of mobile telehealth systems. As such, the TUQ utilizes questions that can be modified to correctly address the participants (clinicians or patients) and the telehealth system. METHODS QUESTIONNAIRE DEVELOPMENT Development of the TUQ consisted of four phases: (1) literature review; (2) construct development; (3) item development; and (4) examination of reliability. Each of these phases will be covered in the subsequent sections. BACKGROUND ON EXISTING QUESTIONNAIRES A literature review was conducted to identify existing questionnaires that have been widely used in the evaluation of telemedicine and computer/information technology. Identified questionnaires that were used as models for the TUQ were primarily from two fields: telemedicine and computer and information technology. In the field of telemedicine the following questionnaires were identified: the Telemedicine Satisfaction Questionnaire (TSQ) (Yip et al., 2003), Telemedicine Patient Questionnaire (TMPQ) (Demeris et al., 2000, 2004), and Telemedicine Satisfaction and Usefulness Questionnaire (TSUQ) (Bakken, 2009). Telemedicine questionnaires focus on three factors of usability: usefulness, satisfaction, and interaction quality between patient and clinician over telemedicine technology. The TSQ clearly addresses the three usability factors central to telehealth. For example, it includes items unique to telemedicine such as audio and video quality. TSQ is a questionnaire designed specifically for telemedicine systems. TSQ was also designed for traditional interactive videoconferencing systems such as Polycom or Cisco Tandberg. One main difference between traditional videoconferencing systems and new generation computer-based systems is that the former type of system does not have a user interface that clinicians and patients interact with, which is the case with computer-based systems such as VSee. The traditional videoconferencing systems are usually setup by a technician, and the user (patient and clinician) does not need to know how to setup and interact with the system. This means that the TSQ lacks the items related to interface quality that are important for computer/software-based telehealth. However, because items of the TSQ so clearly address the usability factors central to telehealth, it was identified as a primary source of questionnaire items for the TUQ. In the field of information and computer technology the following questionnaires were identified: the Technology Acceptance Model (TAM) (Davis 1993), and the IBM Post-Study System Usability Questionnaire (PSSUQ) developed by Lewis (1995). The TAM (Davis 1993) describes the relationships between perceived qualities of system usage, affective attitude, and behavioral responses to the system. This questionnaire is used widely in the business information arena. We derived questions related to the usability factors of usefulness and ease of use from the TAM. The PSSUQ measures system usability via a multitude of aspects, including system function, information and interface quality, to users’ satisfaction level. The evaluation covers the standards of effectiveness, efficacy and satisfaction (Lewis, 1995). From the PSSUQ, we derived items for ease of use, interface quality, reliability, and satisfaction. USABILITY ATTRIBUTES OF A TELEHEALTH SYSTEM The TUQ was designed to be a comprehensive questionnaire that covers all usability factors, including usefulness, ease of use, effectiveness, reliability, and satisfaction. The following is a brief description of each of the usability factors assessed in the TUQ. USEFULNESS Usefulness refers to the users’ perception of how the telehealth system functions to provide a healthcare interaction/service similar to the traditional in-person encounter. The system is useful when it works and has positive effects on clinical outcomes or reduces clinical cost (Ekeland, Bowes, &