140 likes | 264 Views
Cyclic input of characters through a single digital button without visual feedback. Yang Xiaoqing xiaoqing.yang@uta.fi. New Interaction Techniques Dept. of Computer and Information Sciences University of Tampere 25.02.2003. Introduction to the problem.
E N D
Cyclic input of characters through a single digital button without visual feedback Yang Xiaoqing xiaoqing.yang@uta.fi New Interaction Techniques Dept. of Computer and Information Sciences University of Tampere 25.02.2003
Introduction to the problem Spatial-temporal mapping & perceptive features Control by the sonification of spatial patterns Mobile People with special needs
Background and previous research Traditional seven-segment display element is used as a layout for symbol imaging. Commercial systems and equipments are on sale, but most are used for displaying numbers. If each of the segments is lighted accordingly to a single user action a temporal sequence can be useful for imaging in cyclic input techniques.
Objectives in general • To study the features of user perception of spatial-temporal mapping through sonification of spatial patterns
A B /8 C D E F G /6 H I J K L M N O /0 P Q R S /5 T /7 U V W X Y Z /2 1 3 9 Spatial Model • Cyclic Synthesis
soundgraph Sound action Sound Sound F0 musical interval Fmax sound Time Sound Model • Cyclic Synthesis
Research methods • Conceptual modeling for spatial-temporal structures and relationships. • Constructive research to design and simulate the temporal components and relationships. • Usability evaluation of user activity under different time conditions and communication with computer without visual feedback. • Empirical research of the rhythmic musical sequences coordinated to spatial seven-segment layout.
Experimental setup • Snapshot of the program during testing
Experimental setup • Snapshot of the program with opened frame of the tools
Preliminary results • From previous investigation, the duration of the cycle in this case depends on the speed on which the user can act. • Even if the user had experience s/he could not predict what next symbol will be presented. Therefore the first segment is the most difficult, at least, during the test.
Forecasted results • The new techniques for an evaluation of user behavior concerning temporal features of feedback cues. • Dynamics for user performance evaluated through: reaction time per spatial pattern /symbol; a number of errors • Sound parameters for sonification the array of spatial patterns • Conceptual model for a simple spatial-temporal structure
Prospective scientific issues & possible applications • The temporal space for human-computer interaction: • perception features of temporal events; • influence of modality onto the time perception • Event modality & spatial-temporal mapping • Synthesis and visualization of temporal objects
References • Kirsh D.: Complementary Strategies: Why we use our hands when we think. In Proc. of the 17th Annual Conference of the Cognitive Science Society. Hillsdale, NJ, Lawrence Erlbaum (1995). • Lauruska, V.: Computerized Control and Communication System for Handicapped. In: Klaus, J., Auff, E., Kremser, W., Zagler, W.L. (Eds.): Proc. 5th Int. Conference ICCHP’96, (Linz, Austria). Verlag R. Oldenburg, Wien Munchen (1996) 515-520 • Keytools TM Product information available at: http://www.keytools.com/input/ability.htm • Mind Controlled Switch, information available at: http://www.mctos.com/htm/mctos.htm • Evreinov, G., Raisamo, R. Cyclic Input of Characters through a Single Button Manipulation In Proc. of the 8th Int. Conf. on Computers Helping People with Special Needs. ICCHP 2002, Linz, Austria, 15-20 July. J.Klaus, K.Miesenberger, W. L. Zagler (Eds.), LNCS Vol. 2398, Springer-Verlag Berlin Heidelberg, 2002, pp. 259-266. • Mizobuchi, S., Wanobe, E. How long is a “long” key press? In Proceedings of INTERACT’01, Michitake Hirose (Ed.), IOS Press, IFIP, 2001, pp.735-736. • Fabre, J., Howard, S. and Smith, R. Designing time at the user interface. Behaviour & Information Technology, 2000, Vol. 19(6), 451-463. • Hanappe, P. Design and implementation of an integrated environment for music composition and synthesis. PhD Theses, 1999, available at: http://www.ircam.fr/equipes/repmus/Rapports/PeterHanappe99/