Evaluation at scale: An approach to evaluate technology for informal workplace learning across contexts

Stefan Thalmann*, Tobias Ley, Ronald Maier, Tamsin Treasure-Jones, Christina Sarigianni, Markus Manhart

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review


The implicit, spontaneous and hidden nature of informal learning in addition to the large and less predictable number of application scenarios challenge the evaluation of learning technology. A further challenge for evaluation is added if a user-centred design method had been employed that already had involved users in large numbers and has led to a high level of expectations regarding the potential of the tool to fulfil their needs. We propose an evaluation approach based on the ideas of active involvement of stakeholders, an iterative planning process, a continuous, open and collaborative interpretation of the data collected on the basis of representations shared across cases plus a pluralism of methods for evaluating learning technology and is particularly intended for large scale evaluations in workplace settings. We present a case, in which we applied the proposed evaluation approach in the context of a large scale research project on technology-enhanced-learning.

Original languageEnglish
Pages (from-to)289-308
Number of pages20
JournalInternational Journal of Technology Enhanced Learning
Issue number4
Publication statusPublished - 1 Jan 2018


  • Informal learning
  • Participatory design
  • Participatory evaluation
  • Workplace learning

ASJC Scopus subject areas

  • Education
  • Computer Science Applications


Dive into the research topics of 'Evaluation at scale: An approach to evaluate technology for informal workplace learning across contexts'. Together they form a unique fingerprint.

Cite this