Over the decades, HCI researchers have developed a broad range of new interfaces that diverge from the “window, icon, menu, pointing device” (WIMP) or Direct Manipulation interaction style. Although some may see post-WIMP interaction styles as disparate innovations proceeding on unrelated fronts, we propose that they share salient and important commonalities, which can help us understand, connect, and analyze them. We believe that all of these new interaction styles draw strength by building on users’ pre-existing knowledge of the everyday, non-digital world to a much greater extent than before.
We propose the notion of Reality-Based Interaction (RBI) as a unifying concept that ties together a large subset of emerging human-computer interaction styles.
[Website]
People
Orit Shaer
Erin Treacy Solovey
Michael Poor
Robert JK Jacob
Leanne M Hirshfield
Michael S Horn
Jamie Zigelbaum
James Kebinger
Publications
journal
The Reality of Reality-Based Interaction: Understanding the Impact of a Framework as a Research Tool
Audrey Girouard, Orit Shaer, Erin Treacy Solovey, Michael Poor, Robert JK Jacob
ACM Transactions on Computer-Human Interaction (TOCHI), 2019
workshop
Programming Reality within the Reality-Based Interaction Framework
Erin Treacy Solovey, Orit Shaer, Audrey Girouard, Leanne M Hirshfield, Michael S Horn, Jamie Zigelbaum, Robert JK Jacob
CHI Workshop, Programming Reality: From Transitive Materials to Organic User Interfaces, 2009
workshop
Using Brain Measurement to Evaluate Reality Based Interactions
Leanne M Hirshfield, Erin Treacy Solovey, Audrey Girouard, James Kebinger, Michael S Horn, Orit Shaer, Jamie Zigelbaum, Robert JK Jacob
CHI Workshop, Challenges in Evaluating Usability and User Experience of Reality-Based Interaction, 2009
conference
Reality-based interaction: a framework for post-WIMP interfaces
Robert JK Jacob, Audrey Girouard, Leanne M Hirshfield, Michael S Horn, Orit Shaer, Erin Treacy Solovey, Jamie Zigelbaum
CHI: ACM Conference on Human Factors in Computing Systems, 2008
workshop
Putting Tangible User Interfaces in Context: A Unifying Framework for Next Generation HCI
Michael S Horn, Orit Shaer, Audrey Girouard, Leanne M Hirshfield, Erin Treacy Solovey, Jamie Zigelbaum, Robert JK Jacob
CHI Workshop, Tangible User Interfaces in Context and Theory, 2007
magazine
What is the Next Generation of Human-Computer Interaction?
Robert JK Jacob, Audrey Girouard, Leanne M Hirshfield, Michael S Horn, Orit Shaer, Erin Treacy Solovey, Jamie Zigelbaum
interactions, 2007
workshop
Reality-based interaction: unifying the new generation of interaction styles
Robert JK Jacob, Audrey Girouard, Leanne M Hirshfield, Michael S Horn, Erin Treacy Solovey, Orit Shaer, Jamie Zigelbaum
CHI EA: ACM Conference on Human Factors in Computing Systems Extended Abstracts, 2007