Assess and Augment: Toward Games & Training With Biophysical Sensor
The more you know about the mental state of a learner, player, or trainee, the better you can tailor an experience to their current state and progression over time. There are multiple non-invasive techniques for assessing trust, engagement, fatigue, emotions, and learning progress using biophysical sensors. After you collect and understand this data, many possibilities exist for augmenting their experience. Tracking learning progress with fNIR brain imaging and fatigue by measuring pupil dilation then subsequently scaling difficulty is one example. Automating certain user interface interactions through gaze detection is another. Virtual characters that react to eye contact (or its absence) are also a possibility. In the talk, the latest research on the efficacy of these techniques will be provided, along with potential use cases in games, training, and learning.
★
★
★
★
★
309 views • 30 slides