Evaluating the utility of human-machine user interfaces using balanced score cards

Abstract

Evaluating the utility of Human-Machine Systems’ User Interfaces is not trivial. Several evaluation methods can be used to investigate if the behaviour of the user interface complies with best practices of Human-Machine Interface Design. Even when is possible to agree on which methods to use to conduct the evaluation, defining the utility requires evaluating the interface under analysis toward the company’s goals, or mission. This paper investigates how the utility, perceived by end users of interfaces, can be captured by a research instrument, as well as be represented by a structured approach based on Usability evaluation and Balanced Score Cards methodology. This is an alternative demarche for accessing the Usability of a Software System, and the main goal is helping designers and administrators to maintain and improve their systems.