Analyzing visual attention during whole body interaction with public displays

While whole body interaction can enrich user experience on public displays, it remains unclear how common visualizations of user representations impact users' ability to perceive content on the display. In this work we use a head-mounted eye tracker to record visual behavior of 25 users interacting with a public display game that uses a silhouette user representation, mirroring the users' movements. Results from visual attention analysis as well as post-hoc recall and recognition tasks on display contents reveal that visual attention is mostly on users' silhouette while peripheral screen elements remain largely unattended. In our experiment, content attached to the user representation attracted significantly more attention than other screen contents, while content placed at the top and bottom of the screen attracted significantly less. Screen contents attached to the user representation were also significantly better remembered than those at the top and bottom of the screen.

@inproceedings{10.1145/2750858.2804255,
 author = {Walter, Robert and Bulling, Andreas and Lindlbauer, David and Schuessler, Martin and M"{u}ller, J"{o}rg},
 title = {Analyzing Visual Attention during Whole Body Interaction with Public Displays},
 year = {2015},
 isbn = {9781450335744},
 publisher = {Association for Computing Machinery},
 address = {New York, NY, USA},
 url = {https://doi.org/10.1145/2750858.2804255},
 doi = {10.1145/2750858.2804255},
 booktitle = {Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing},
 pages = {1263–1267},
 numpages = {5},
 keywords = {mobile eye tracking, whole body interaction, user representation, visual attention, public displays},
 location = {Osaka, Japan},
 series = {UbiComp '15}
 }