Lessons learned from creating a general purpose tool for experience sampling methods

Abstract

Experience sampling methods (ESM) are a commonly used technique for capturing information from real or potential technology usage. The ubiquity of mobile phones has created a particularly appealing opportunity for all sorts of ESM studies, but there are complex technical challenges involved. In this work, we have sought to understand those challenges and the overall viability of a general purpose ESM application. The contribution of this work is the identification of the key challenges and approaches that may be more relevant in creating this type of general purpose study support. We have found that the main challenges are associated with data synchronisation, proper notification management, flexible questionnaire design, generalisation of study workflow processes, and efficient positioning. This contribution may inform the design of other generic tools for ESM-based studies.