The ubihave project investigates how ubiquitous computing devices can benefit from behavioral models. This research is motivated by computers permeating our life, as everyday companions and as sensors embedded in the environment. These devices provide rich streams of user-specific data, opening new avenues for applications using behavioral models, which appropriately adapt to individual users and contexts.

Ubiquitous Computing Environments Provide Rich Behavioral Data

The ubihave project investigates how ubiquitous computing devices can benefit from behavioral models. This research is motivated by the fact that computers permeate our life as everyday companions (smartphones, tablets, life-logging wristbands, smart clothes) and as sensors embedded in the environment (WiFi hotspots, NFC, cameras, depth sensors, eye trackers). These devices provide rich streams of user-specific data, opening new avenues for applications using behavioral models. By exploiting and combining ubiquitous data sources for modeling user behavior, the Human-Computer Interaction community has the unprecedented chance to now realize long held visions of intelligent interfaces, smart devices, and reactive environments which appropriately adapt to individual users and contexts. 

 

Benefits of Modeling User Behavior

Many current UIs and devices can react to simple sensor properties. However, interfaces and interactions are rarely adapted to the individual user and context, since this requires dedicated inference tools to process uncertain user-specific sensor data. To render user-specific information more accessible and useful to applications and users, this project aims to build and apply models that can describe, analyze and predict user behavior based on data from mobile devices and ubiquitous sensors. Particular application areas that we expect to strongly benefit from such models are usable privacy and security, touch interaction, text input, and context-aware adaptive interfaces. 

 

Research Questions

This project integrates HCI and user modeling perspectives to address a number of guiding questions: In which applications and contexts can users benefit from behavioral models? How can models improve interactions? Do users notice and like adaptations and do they match their expectations? Which features, models and algorithms are suitable to capture and utilize user behavior? How do we define performance metrics for user actions with behavior-aware interfaces? Which interactions provoke characteristic and consistent behavior? 

 

Impact

The contribution of the project is threefold. Firstly, we chart a holistic design space to understand and investigate user modeling comprehensively across tasks and beyond the desktop. This reveals future opportunities and a goal unique to this project: we aim to identify common grounds for diverse applications based on the same user representation, leading to efficient data handling across applications. Secondly, we use deployment-based research to identify scenarios in which behavioral biometrics help to optimize, personalize and secure interactions. Examples include novel usable security mechanisms, efficient and usable mobile text entry, activity-aware applications, and novel mobile services that can adapt to user behavior. Thirdly, to allow applications to consider user-specific interaction characteristics and behavior, this project also develops inference tools, which can process uncertain sensor data with respect to the targeted user contexts and goals.

Publications

prange2020avi.jpg Sarah Prange, Lukas Mecke, Alice Nguyen, Mohamed Khamis and Florian Alt. Don't Use Fingerprint, it's Raining! How People Use and Perceive Context-Aware Selection of Mobile Authentication. In Proceedings of the 2020 International Conference on Advanced Visual Interfaces. AVI'20. Association for Computing Machinery, New York, NY, USA. [Download Bibtex]
kosch2020avi.jpg Thomas Kosch, Mariam Hassib, Robin Reutter and Florian Alt. Emotions on the Go: Assessing Emotional Probes in Real-Time using Facial Expressions. In Proceedings of the 2020 International Conference on Advanced Visual Interfaces. AVI'20. Association for Computing Machinery, New York, NY, USA. [Download Bibtex]
rivu2020cogain.jpg Sheikh Radiah Rahim Rivu, Yasmeen Abdrabou, Ken Pfeuffer, Augusto Esteves, Stefanie Meitner and Florian Alt. StARe: Gaze-Assisted Face-to-Face Communication inAugmented Reality. In Proceedings of the 2020 ACM Symposium on Eye Tracking Research & Applications. COGAIN '20. ACM, New York, NY, USA. [Download Bibtex] [Video]
froehlich2020dis.jpg Michael Froehlich, Felix Gutjahr and Florian Alt. Don't lose your coin! Investigating security practices of cryptocurrency users. In Proceedings of the 2020 ACM Conference on Designing Interactive Systems. DIS '20. ACM, New York, NY, USA. [Download Bibtex]
abdrabou2020etra.jpg Yasmeen Abdrabou, Ken Pfeuffer, Mohamed Khamis and Florian Alt. GazeLockPatterns: Comparing Authentication Using Gaze andTouch for Entering Lock Patterns. In Proceedings of the 2020 ACM Symposium on Eye Tracking Research & Applications. ETRA '20. ACM, New York, NY, USA. [Download Bibtex] [Video]
mecke2019soups2.jpg Lukas Mecke, Daniel Buschek, Mathias Kiermeier, Sarah Prange and Florian Alt. Exploring Intentional Behaviour Modifications for Password Typing on Mobile Touchscreen Devices. In Fifteenth Symposium on Usable Privacy and Security (SOUPS 2019). USENIX Association, Santa Clara, CA. [Download Bibtex] [Video]
mecke2019soups1.jpg Lukas Mecke, Sarah Delgado Rodriguez, Daniel Buschek, Sarah Prange and Florian Alt. Communicating Device Confidence Level and Upcoming Re-Authentications in Continuous Authentication Systems on Mobile Devices. In Proceedings of the Fifteenth Symposium on Usable Privacy and Security. (SOUPS 2019). USENIX Association, Santa Clara, CA. [Download Bibtex]
pfeuffer2019chi.jpg Ken Pfeuffer, Matthias Geiger, Sarah Prange, Lukas Mecke, Daniel Buschek and Florian Alt. Behavioural Biometrics in VR - Identifying People from Body Motion and Relations in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. CHI '19. ACM, New York, NY, USA. [Download Bibtex]
abdelrahman2019mum.jpg Yomna Abdelrahman, Pawel Wozniak, Pascal Knierim, Dominik Weber, Ken Pfeuffer, Niels Henze, Albrecht Schmidt and Florian Alt. Exploring the Domestication of Thermal Imaging. In Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia. MUM'19. ACM, New York, NY, USA. [Download Bibtex]
mecke2018mobilehciadj.jpg Lukas Mecke, Sarah Prange, Daniel Buschek, Mohamed Khamis, Mariam Hassib and Florian Alt. Outsourcing Security: Supporting People to Support Older Adults. In Proceedings of the Mobile HCI '18 Workshop on Mobile Privacy and Security for an Aging Population. [Download Bibtex]
buschek2018tochi.jpg Daniel Buschek, Mariam Hassib and Florian Alt. Personal Mobile Messaging in Context: Chat Augmentations for Expressiveness and Awareness. In ACM Trans. Comput.-Hum. Interact., 25, 2018, 23:1--23:33. [Download Bibtex]
khamis2018avi.jpg Mohamed Khamis, Carl Oechsner, Florian Alt and Andreas Bulling. VRpursuits: Interaction in Virtual Reality Using Smooth Pursuit Eye Movements. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces. AVI '18. ACM, New York, NY, USA. [Download Bibtex]
buschek2018chi2.jpg Daniel Buschek, Benjamin Bisinger and Florian Alt. ResearchIME: A Mobile Keyboard Application for Studying Free Typing Behaviour in the Wild. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. CHI '18. ACM, New York, NY, USA. [Download Bibtex]
khamis2018chi2.jpg Mohamed Khamis, Anita Baier, Niels Henze, Florian Alt and Andreas Bulling. Understanding Face and Eye Visibility in Front-Facing Cameras of Smartphones Used in the Wild. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. CHI '18. ACM, New York, NY, USA. [Download Bibtex]
khamis2018chi1.jpg Mohamed Khamis, Christian Becker, Andreas Bulling and Florian Alt. Which One is Me?: Identifying Oneself on Public Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. CHI '18. ACM, New York, NY, USA. [Download Bibtex]
makela2018chi.jpg Ville Mäkelä, Mohamed Khamis, Lukas Mecke, Jobin James, Markku Turunen and Florian Alt. Pocket Transfers: Interaction Techniques for Transferring Content from Situated Displays to Mobile Devices. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. CHI '18. ACM, New York, NY, USA. [Download Bibtex]
mecke2018chiea.jpg Lukas Mecke, Sarah Prange, Daniel Buschek and Florian Alt. A Design Space for Security Indicators for Behavioural Biometrics on Mobile Touchscreen Devices. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. CHI EA '18. ACM, New York, NY, USA. [Download Bibtex]
weber2018chiea.jpg Dominik Weber, Alexandra Voit, Gisela Kollotzek, Lucas van der Vekens, Marcus Hepting, Florian Alt and Niels Henze. PD Notify: Investigating Personal Content on Public Displays. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. CHI EA '18. ACM, New York, NY, USA. [Download Bibtex]
khamis2018dronet.jpg Mohamed Khamis, Anna Kienle, Florian Alt and Andreas Bulling. GazeDrone: Mobile Eye-Based Interaction in Public Space Without Augmenting the User. In 4th ACM Workshop on Micro Aerial Vehicle Networks, Systems, and Applications (DroNet '18). DroNet'18. ACM, New York, NY, USA. [Download Bibtex]
mattusch2018etra.jpg Thomas Mattusch, Mahsa Mirzamohammad, Mohamed Khamis, Andreas Bulling and Florian Alt. Hidden Pursuits: Evaluating Gaze-selection via Pursuits when the Stimuli's Trajectory is Partially Hidden. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications. ETRA '18. ACM, New York, NY, USA. [Download Bibtex]
trotter2018mumadj.jpg Ludwig Trotter, Sarah Prange, Mohamed Khamis, Nigel Davies and Florian Alt. Design Considerations for Secure and Usable Authentication on Situated Displays. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia. MUM 2018. ACM, New York, NY, USA. [Download Bibtex]
drewes2018mum.jpg Heiko Drewes, Mohamed Khamis and Florian Alt. Smooth Pursuit Target Speeds and Trajectories. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia. MUM'18. ACM, New York, NY, USA. [Download Bibtex]
mecke2018mum.jpg Lukas Mecke, Ken Pfeuffer, Sarah Prange and Florian Alt. Open Sesame!: User Perception of Physical, Biometric, and Behavioural Authentication Concepts to Open Doors. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia. MUM'18. ACM, New York, NY, USA. [Download Bibtex]
prange2018mum.jpg Sarah Prange, Daniel Buschek and Florian Alt. An Exploratory Study on Correlations of Hand Size and Mobile Touch Interactions. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia. MUM'18. ACM, New York, NY, USA. [Download Bibtex]
khamis2018imwut.jpg Mohamed Khamis, Daniel Buschek, Tobias Thieron, Florian Alt and Andreas Bulling. EyePACT: Eye-Based Parallax Correction on Touch-Enabled Interactive Displays. In Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 1, 2018, 146:1--146:18. [Download Bibtex]