Over the decades, HCI researchers have developed a broad range of new interfaces that diverge from the “window, icon, menu, pointing device” (WIMP) or Direct Manipulation interaction style. Although some may see post-WIMP interaction styles as disparate innovations proceeding on unrelated fronts, we propose that they share salient and important commonalities, which can help us understand, connect, and analyze them. We believe that all of these new interaction styles draw strength by building on users’ pre-existing knowledge of the everyday, non-digital world to a much greater extent than before.
We propose the notion of Reality-Based Interaction (RBI) as a unifying concept that ties together a large subset of emerging human-computer interaction styles.
Erin Treacy Solovey
Robert JK Jacob
Leanne M Hirshfield
Michael S Horn
The Reality of Reality-Based Interaction: Understanding the Impact of a Framework as a Research Tool
ACM Transactions on Computer-Human Interaction (TOCHI), 2019
Programming Reality within the Reality-Based Interaction Framework
CHI Workshop, Programming Reality: From Transitive Materials to Organic User Interfaces, 2009
Using Brain Measurement to Evaluate Reality Based Interactions
CHI Workshop, Challenges in Evaluating Usability and User Experience of Reality-Based Interaction, 2009
Reality-based interaction: a framework for post-WIMP interfaces
CHI: ACM Conference on Human Factors in Computing Systems, 2008
Putting Tangible User Interfaces in Context: A Unifying Framework for Next Generation HCI
CHI Workshop, Tangible User Interfaces in Context and Theory, 2007
What is the Next Generation of Human-Computer Interaction?
Reality-based interaction: unifying the new generation of interaction styles
CHI EA: ACM Conference on Human Factors in Computing Systems Extended Abstracts, 2007