1 / 99

New Interaction Techniques

New Interaction Techniques. Engineering basics for Computer Interaction. Grigori Evreinov. Department of Computer and Information Sciences University of Tampere, Finland. Department of Computer and Information Sciences University of Tampere, Finland. www.cs.uta.fi/~grse.

ally
Download Presentation

New Interaction Techniques

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. New Interaction Techniques Engineering basics for Computer Interaction Grigori Evreinov Department of Computer and Information SciencesUniversity of Tampere, Finland Department of Computer and Information SciencesUniversity of Tampere, Finland www.cs.uta.fi/~grse January – June, 2003

  2. Fossil Wrist PDA with Palm OS http://www.fossil.com/ KP-C50 PC Tag Writer Engineering basics for CI Device Capabilities and their Future http://www.ccs.neu.edu/home/fell/images/BBB/BBBphoto.jpeg http://www.casio.com/labelprinters/product.cfm?product=3766&display=14&cid=5227 TAUCHI MMIG G. Evreinov p 01_97 17.01.2003

  3. Engineering basics for CI within just the last 24 months, myriad audio, video, PDA and cellular products have equipped people not only to carry around data, images and audio but also to swap devices between various types of hardware new technologies include non-volatile flash memory cards and small disk drives flash memory cards have no moving parts and retain data in the absence of power memory is key to retaining complex data on a device it enables storage of programs, audio and video files and provides users with more efficient data compression methods sufficient memory also allows devices to run applications that require large amounts of memory to implement, like as Java etc TAUCHI MMIG G. Evreinov p 02_97 17.01.2003

  4. Engineering basics for CI two major subjects are to develop very high density magnetic medium and very sensitive reading head technology using Giant Magnetic Resistance Effects [3] Association of Super-Advanced Electronics Technology (ASET) TAUCHI MMIG G. Evreinov p 03_97 17.01.2003

  5. Engineering basics for CI IBM has demonstrated a GMR (Giant Magneto Resistive) head with an areal density capability greater than 35.3 billion bits per square inch and laboratory demonstrations up to 130 Gbits/in2 have been reported in the industry, indicating that future disk drives could exhibit capacities at least two times higher than today IBM Magnetic Hard Disc Drive Technology [5] TAUCHI MMIG G. Evreinov p 04_97 17.01.2003

  6. Engineering basics for CI added functionality implemented in recent 2G and 2.5G terminals source: UMTS (Universal Mobile Telecommunications System) Forum [1] TAUCHI MMIG G. Evreinov p 05_97 17.01.2003

  7. Engineering basics for CI the above-mentioned multifunctional devices are based on a mobile phone centric approach new multimedia and mixed data services would create further opportunities for UMTS devices to be complementary to other electronic devices considering the high level of complexity entailed in integrated multifunctional devices, a feasible approach is to enable traditional portable (consumer or business user) devices to interwork with UMTS terminals implementing core access functionality examples would include a digital camera interworking with a UMTS terminal, which would enable a user to transfer a digital image to the terminal for incorporation in a multimedia message the possible combinations are very wide ranging TAUCHI MMIG G. Evreinov p 06_97 17.01.2003

  8. Engineering basics for CI many different applications are expected to be implemented in UMTS devices for each application, corresponding additional components or elements need to be employed this will have some impact on the terminal design from a form factor perspective on the other hand, most users want to carry as small and as light a device as possible even though new functionality or features are added further miniaturization is one of the key issues and this requires further miniaturization or integration of all related components on UMTS devices TAUCHI MMIG G. Evreinov p 07_97 17.01.2003

  9. Engineering basics for CI several approaches for further integration and miniaturization LSI - Large Scale Integration LTCC - Low Temperature Co-fired Ceramics; integrate high frequency passive components into one ceramic substrate MEMs - MicroElectroMechanical Systems an advanced technology that makes possible to integrate passive elements into semiconductor MEMS is also known as micromachine technology source: Nikkei Electronics No. 782, cit. in [1] TAUCHI MMIG G. Evreinov p 08_97 17.01.2003

  10. Engineering basics for CI Trends in component technology TAUCHI MMIG G. Evreinov p 09_97 17.01.2003

  11. Engineering basics for CI Display technology sometimes the user may be concerned more with viewing a screen than with listening to an ear piece the display represents the most important component in the future of communication perhaps users will interact through the display in many different environmental conditions for almost all device applications they will need to view high information content multimedia as well as the high bandwidth video the display is also likely to function as an input device through the use of “soft keys” for effective interaction between users and displays, a direct-view display must be as large as possible within the constraints of a portable device TAUCHI MMIG G. Evreinov p 10_97 17.01.2003

  12. Engineering basics for CI no single display technology can currently satisfy all of requirements, like resolution, contrast / brightness, illumination, colour, frame rate, interface, bezel (non-display area), thickness, weight the simplest displays, including for mobile applications, are passive matrix displays a passive matrix display is an array of pixels, each of which contains an optical element that is sandwiched between column and row electrodes passive addressing via the column and row electrodes puts limitations on the achievable display resolution and levels of grey-scale that can be programmed at each pixel TAUCHI MMIG G. Evreinov p 11_97 17.01.2003

  13. Engineering basics for CI in STN Liquid Crystal Displays, the optical element is a Super Twisted Nematic (STN) liquid crystal that modulates (between 180 to 260 degrees resulting in better contrast)the transmission of light through polarisers positioned at each side of the liquid crystal cell STN materials have a sharp transmission-voltage response and a slow switching speed (e.g. >100ms), and as such are well suited to binary (black or white state) passive addressing, although 3-4 bit grey-scale can be achieved displays of this type are particularly suitable for text and simple graphics display, and this is sufficient for many of today’s low-bandwidth applications, while they have a limited viewing angle these reflective displays are very low power and are commonly illuminated by a (near white) LED, and are very cheap to manufacture TAUCHI MMIG G. Evreinov p 12_97 17.01.2003

  14. Engineering basics for CI higher performance color STN LCDs offer desirable benefits for multimedia applications, though the introduction of colour filters can reduce total display brightness and increases the unit cost transflective technology helps ensure that pixels make the most of both ambient light and back-light sources although not capable of matching the performance of TFT (Thin Film Transistor) LCDs, the best color STNs of today can achieve 65,000 colors for still images and 15 frames per second video at intermediate resolutions one of the more interesting technological developments is the move to plastic substrates; plastic STN LCDs offer lighter weight, greater impact resistance and the option to have custom (e.g. non-rectangular) display shapes TAUCHI MMIG G. Evreinov p 13_97 17.01.2003

  15. Engineering basics for CI these transistors do not generate light or color, an often-made mistake this is where the liquid crystals (LC) and their alignment come into play the transistors control the orientation of the LC, thus allowing them (LC) to pass (or not pass) light from the backlight XtraViewTM Wide Viewing Angle Technology [9] TAUCHI MMIG G. Evreinov p 14_97 17.01.2003

  16. Engineering basics for CI by having the electrodes on the same glass substrate, they allow the crystals to remain horizontal to the glass substrates in both the on and off states such design improves the viewing angle by passing the light through the crystals at their most efficient orientation – a horizontal orientation – thus dispersing the light more efficiently XtraViewTM Wide Viewing Angle Technology [9] TAUCHI MMIG G. Evreinov p 15_97 17.01.2003

  17. Engineering basics for CI organic electroluminescent (OEL) materials emit light in proportion to the current flowing through them, and have the advantages of high brightness and of being very thin higher performance displays are composed of active matrix pixels each pixel typically includes an optical element and switch the switch is an active component such as a TFT (thin-film transistor) or a TFD (thin-film diode), and is addressed by column (data) and row (scan) lines TFTs are normally fabricated from a thin-film of amorphous Silicon (a:Si); though complete construction of the TFT requires the deposition of several additional layers, including the addressing lines, today, this can be achieved with a minimum of five photolithographic masks, which keeps the cost of active matrix displays competitive TAUCHI MMIG G. Evreinov p 16_97 17.01.2003

  18. Engineering basics for CI four of the most common active matrix display cross-sections to maximize the use of ambient light, a single polariser can be used; micro-reflective structures and careful choice of colour filters can increase brightness at the expense of contrast ratio and of viewing angle source: UMTS Forum [1] TAUCHI MMIG G. Evreinov p 17_97 17.01.2003

  19. Engineering basics for CI although more expensive to manufacture than passive displays, the active matrix pixel switch permits a larger total number of pixels in the display, higher resolution, higher contrast and accurate grey-scale pixel programming in transmissive TFT LCDs, the optical element is usually a Twisted Nematic liquid crystal that modulates the transmission of light supplied by a back-light through orthogonal polarisers positioned at each side of the liquid crystal cell Twisted Nematic materials have a shallow transmission-voltage response and a fast switching speed (e.g. 25ms), and can therefore achieve 8-bit or higher RGB grey-levels (16 million colours) at 60 Hz updates (i.e. “true colour“ video) high performance active OEL displays based on poly-silicon TFTs are being considered since more than one of them can be implemented at each pixel to implement a small current-mode driver circuit this “pixel circuit“ is very power efficient and can minimize luminance non-uniformity across the display TAUCHI MMIG G. Evreinov p 18_97 17.01.2003

  20. organic electroluminescent Super Twisted Nematic Low Temperature Poly-Silicon Engineering basics for CI source: Advanced Data Research, Japan (11/09/00) [1] TAUCHI MMIG G. Evreinov p 19_97 17.01.2003

  21. Engineering basics for CI Input devices usability is a key issue affecting both the implementation of applications and device design unification of input methods is an important factor in realizing “easy to use” user interfaces, but unification of new features could bring complexity to users to understand which input device is doing which function and/or feature some UMTS devices will have similar input methods and components like current mobile units (keypad and pointing device), others may employ touch screens and voice recognition devices should not only support the display of character encodings and character sets in supporting internationalized content in local languages, they must also allow for the input of text in those local languages TAUCHI MMIG G. Evreinov p 20_97 17.01.2003

  22. Engineering basics for CI Keyboards and keypads a basic requirement for a mobile unit input device is to employ at least ten keys for activating the phone and the line and for inputting telephone numbers most current mobile phones employ between 14 and 17 keys, normally realized using carbon printed or gold flashed substrate combined with a carbon printed rubber sheet, poly-dome sheet or metal contact sheet reliability is becoming an increasingly important factor as mobile phones change from voice-oriented to games-oriented usage the minimum life cycle for the key panel has to guarantee at least one million contact cycles sensitivity to moisture from the human body becomes an issue TAUCHI MMIG G. Evreinov p 21_97 17.01.2003

  23. Engineering basics for CI direct membrane/polydome switches printed circuit boardcontact patterns the most important single design objective is to provide as many shorting paths as possible so best switch operation can be realized when the button is actuated indirect full-travel membrane switch switch technologies [10] TAUCHI MMIG G. Evreinov p 22_97 17.01.2003

  24. Engineering basics for CI wire-free soft technology demo 1 the three modes of ElekTex™ sensor operation - position sensing (X-Y positioning), pressure measurement (Z sensing) and switch arrays – are normally achieved through four connections to each fabric interface http://www.electrotextiles.com/flash/tech_spec.shtml TAUCHI MMIG G. Evreinov p 23_97 17.01.2003

  25. this width should be same as length of key-travel + 0.2mm sample designs illustrating indirect polydome construction 1. rubber keypad (non-conductive) 2. spacer/Adhesive 3. membrane/polydome layer with conductive ink 4. spacer/Adhesive 5. PCB 6. conductive ink Printed Circuit Board (PCB) design for use with membrane/polydome switches Engineering basics for CI Logistic Design (UK) Ltd. [12, 13] TAUCHI MMIG G. Evreinov p 24_97 17.01.2003

  26. Engineering basics for CI the snap ratio (or click ratio) of any conductive rubber keypad directly affects the tactile feel realized by the operator keypads with snap ratios of 40-60% have excellent tactile feel and relatively long life, while keypads with snap ratios below 30% have relatively weak tactile feel, but longer life dual-durometer keypads also improve tactile feel the snap ratio of any keypad can be calculated by working with the formula F1-F2 divided by F1, where F1 is the actuation force and F2 is the contact force ICHIA Technologies Inc. [11] TAUCHI MMIG G. Evreinov p 25_97 17.01.2003

  27. Engineering basics for CI a very general guideline that can be followed for developing good tactile feel is to specify higher actuation forces for keypads with large keys than those with small keys this rule also applies to key heights: tall keys require higher actuation forces than short keys ICHIA Technologies Inc. [11] TAUCHI MMIG G. Evreinov p 26_97 17.01.2003

  28. Engineering basics for CI another typical guideline for actuation force is to specify a minimum actuation force of 80 - 100 grams for keys with heights of 10 - 15mm and a minimum actuation force of 150 - 175 grams for keys with heights of 15 - 25mm care should be taken when designing tactile feel so a minimum return force of 30 grams is realized this minimum return force will help greatly to eliminate the potential problem of sticking keys [11] even though it is possible to use ten keys for writing emails or inputting characters, this would not be acceptable to users other solutions have to be considered today, several sub-systems and technologies are already available to support these requirements; some have already been used in market products TAUCHI MMIG G. Evreinov p 27_97 17.01.2003

  29. Engineering basics for CI pen-input technology (touch screen, track pad and click) or voice recognition technology could also improve usability as alternatives to keypad-based input methods with the trend towards even more innovative device features and designs that go beyond conventional keypads - often incorporating icons, pictograms, and symbols for interaction and inputting instead of keys TAUCHI MMIG G. Evreinov p 28_97 17.01.2003

  30. Engineering basics for CI Pointing devices beside keypads, many different kinds of pointing devices have been implemented onto mobile applications that allow the user to scroll the menu or to select a subject on the display currently available surface mounted devices (SMD input devices) for mobile phones: (a) top-faced slide switch with centre push; (b) side-faced slide switch with centre push; (c) small rotary encoder (Jog); (d) 4-directional switch with centre push; (e) very small rotary encoder source : ALPS Electric Co., Ltd [2] TAUCHI MMIG G. Evreinov p 29_97 17.01.2003

  31. Engineering basics for CI film GlidePoint slide potentiometers low-profile type TACT & mechatronic detection switches small rotary encoder colorless tablet with a high transparency of 88%; deadspace of 2.0 mm; micro dot spacers to maintain visibility hollow shaft encoders for level control 8-Directional operating switches with thin center-push switch source : ALPS Electric Co., Ltd [2] TAUCHI MMIG G. Evreinov p 30_97 17.01.2003

  32. http://www.altavista.com Engineering basics for CI pressure sensitive direction devices provide a user interface to facilitate user navigation through increasingly complex menu structures pressure sensitive direction switches H01C 010/46 USA Pat. No 6,313,731 TAUCHI MMIG G. Evreinov p 31_97 17.01.2003

  33. Engineering basics for CI the round grid pattern for directional navigation are shown, where the signal and output contact regions U, D, L, R, G are circumferentially displaced and arranged in a circular pattern capacitive pointing stick apparatus G09G 005/08 USA Pat. No 6,437,772 pressure sensitive direction switches H01C 010/46 USA Pat. No 6,313,731 TAUCHI MMIG G. Evreinov p 32_97 17.01.2003

  34. Engineering basics for CI multi-directional symbol input [7] X-conductors (24) and Y-conductors (25) are placed on a flexible base plate (26); the membrane (28) and the contacts (29) are located under the base plate (26); the membrane (28) and the contacts (29) form a dome switch the X-conductors (24) and the Y-conductors (25) are electrically connected to a Module of Measuring Touch Point Coordinates (30) which electrically interacts with a Module of Analysis of Lateral Movement Trajectory (31); an Interface Module (32) interacts with both the Module of Analysis of Lateral Movement Trajectory (31) and a Module of Mechanical Keypad (33) to which dome contacts (34) are connected TAUCHI MMIG G. Evreinov p 33_97 17.01.2003

  35. switch technologies [10] contact switch capacitive magnetic reed ferrite core mercury contact Engineering basics for CI TAUCHI MMIG G. Evreinov p 34_97 17.01.2003

  36. Engineering basics for CI capacitance switch with a compression spring resistance increases until switch closure this poor responsiveness is disturbing for most situations, and unacceptable for repetitive use (due to the increased risk of RSI), so is rarely found in contemporary products bent spring the bent spring, though more expensive, provides slightly better feedback than electrometric mat underlay (with domes under each key) switch technologies [10] TAUCHI MMIG G. Evreinov p 35_97 17.01.2003

  37. Engineering basics for CI pressure-actuated pointing device [14] the magnitude of the applied positive pressure gradient and point of pressure application on the finger pad determine the magnitude and direction of the cursor's displacement on the graphics screen TAUCHI MMIG G. Evreinov p 36_97 17.01.2003

  38. Engineering basics for CI tongue touch keypad is the “keyboard” that utilizes key chording this device is available for quadriplegics who need in computer access the keypad contains a miniature circuit board with a nine-button keypad and radio transmitter that fits into a standard dental retainer worn in the roof of the mouth http://www.wheelchairnet.org/WCN_ProdServ/Docs/TeamRehab/RR_97/9702art1.PDF http://www.gerardpas.com/lrahm/gallery/si11.html TAUCHI MMIG G. Evreinov p 37_97 17.01.2003

  39. Engineering basics for CI a pair of ear-microphones output signals were examined to detect the side of teeth-chattering, right or left at discriminator block [Hashimoto, Yonezawa and Itoh 15] TAUCHI MMIG G. Evreinov p 38_97 17.01.2003

  40. Engineering basics for CI tonguepoint is an isometric tongue pointing device was developed in IBM Almaden Research Center [16] a tonguepoint is a mouthpiece that, similar to a dental night guard or a sports mouth guard, is form fitted to each individual's upper teeth and hard pallet because of this fixture the user may relax at normal jaw posture when wearing the mouthpiece speaking with the tonguepoint inserted in the mouth is also feasible Die Zungensteuerung (PROTOS System) http://www.camt.de/ TAUCHI MMIG G. Evreinov p 39_97 17.01.2003

  41. Engineering basics for CI analog button the analog button and testing software has also been designed in TAUCHI Unit a pilot investigation was carried out to study behavior patterns in hand-eye coordination and some new strategies of their exploitation the results suggest that there is potential for further development and applications of these alternative input devices to control by different entities (menu pointing, scrolling, etc.) of information environment TAUCHI MMIG G. Evreinov p 40_97 17.01.2003

  42. Engineering basics for CI TAUCHI MMIG G. Evreinov p 41_97 17.01.2003

  43. IR-Photodiode IR LED IR-Photodiode Engineering basics for CI pointing devices can improve usability for specific applications and functionality applications such as mobile gaming will require dedicated pointing devices to satisfy the “easy to play” principle for users development trends for pointing devices focus on further miniaturization and the ability to deploy re-flow soldering techniques on current devices already employed in consumer electronic products TAUCHI MMIG G. Evreinov p 42_97 17.01.2003

  44. Engineering basics for CI Cameras Complementary Metal-Oxide Semiconductor (CMOS) image sensors have been highlighted recently with a smaller size and reduced weight as a candidate technology for integrating digital camera capability into mobile phones CMOS image sensors offer lower power consumption and a much smaller physical integration area than the Charge-Coupled Device (CCD) image sensors which are conventionally used for digital still cameras and camcorders that require high picture quality CMOS image sensors have been accepted only for certain products that focus on low power consumption rather than picture quality demo 2 http://intron.kz.tsukuba.ac.jp/vrlab_web/floatingeye/floatingeye_e.html TAUCHI MMIG G. Evreinov p 43_97 17.01.2003

  45. Engineering basics for CI the latest CMOS sensor technology could bring around 110,000-pixel (that is, based on 352 x 288 pixels, they can provide Common source Intermediate Format (CIF) compliant quality levels) with 1/7” optics, a form factor of < 101010 mm3 and low consumption of < 100 mW CCD could bring 350,000 ~ 380,000 -pixel with 1/6” optics however, the physical integration area is rather bigger than that for CMOS sensors as CCD requires 3-4 different supply voltages and power consumption for CCD is still over 200 mW the next opportunity for image sensors would be to satisfy the requirements of the PDA and notebook PC markets TAUCHI MMIG G. Evreinov p 44_97 17.01.2003

  46. Engineering basics for CI an image sensor must achieve 640 x 480 dots, or Video Graphics Array (VGA) compliant CMOS and CCD image sensors will be competing technologies in sensor market that needs products with a resolution of VGA-compliant quality CMOS image sensors used in dark environments suffer deterioration in colour production quality and increase of output noise CCD image sensors offer better quality but rather high power consumption as well as a larger integration area CMOS image sensors are facing the challenge of improving picture quality along with downsizing whilst CCD image sensors are facing the challenge of reducing their size and power consumption TAUCHI MMIG G. Evreinov p 45_97 17.01.2003

  47. Engineering basics for CI proximity detector for a seeing eye mouse motion produces successive frames of translated patterns of pixel information, which are compared by autocorrelation to ascertain the direction and amount of movement [6] a hold feature suspends the production of movement signals to the computer, allowing the mouse to be physically relocated on the work surface without disturbing the position on the screen of the pointer TAUCHI MMIG G. Evreinov p 46_97 17.01.2003

  48. Engineering basics for CI Solid-State Optical Mouse Sensor the HDNS-2000 is a reflective optical sensor that measures changes in position by optically acquiring sequential surface images (frames) and mathematically determining the direction and magnitude of movement the sensor is designed to be used with the HDNS-2100 (Lens), HDNS-2200 (LED Assembly Clip), and HLMP-ED80 (High Light Output 639 nm LED) this optical tracking engine has no precision optical alignment resolution is specified as 400 cpi (characters per inch) at rates of motion up to 12 inches per second source: Agilent Technology [3] TAUCHI MMIG G. Evreinov p 47_97 17.01.2003

  49. Engineering basics for CI source: Agilent Technology [3] TAUCHI MMIG G. Evreinov p 48_07 17.01.2003

  50. Engineering basics for CI virtual keyboard with one CCD camera [17] Fingertip Detector outputs a list of fingertips’ 2-D coordination only if fingertips were detected; Stroke Detector watches the alternation of the moving vectors of each fingertip; Keyboard Checker translates fingertip’s coordinates detected as stroke to user-defined key character TAUCHI MMIG G. Evreinov p 49_97 17.01.2003

More Related