1 / 13

A Domain-Specific Language to Define Multi-Touch Gestures

SPLASH Workshop on Domain-Specific Modeling, Reno/Tahoe, Nevada. A Domain-Specific Language to Define Multi-Touch Gestures. Shahedul Huq Khandkar Frank Maurer. Touch Interfaces. The new medium of interaction Key variations Features Physical structure.

lida
Download Presentation

A Domain-Specific Language to Define Multi-Touch Gestures

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SPLASH Workshop on Domain-Specific Modeling, Reno/Tahoe, Nevada A Domain-Specific Language to Define Multi-Touch Gestures ShahedulHuqKhandkar Frank Maurer

  2. Touch Interfaces • The new medium of interaction • Key variations • Features • Physical structure Source: Microsoft Research, apple.com, zatznotfunny.com, slashgear.com

  3. Use of Touch Interface • Generic application commands • Context specific commands

  4. Existing Tools for Gesture Recognition • Predefined gestures • Application specific implementations • Template based recognition algorithms • Compares with sample dataset

  5. Limitations of Template based Recognition • Requires specific start and end point • Limited multi-touch & multi-step support • Hard to define conditional logic Image: slashgear.com

  6. A DSL to define gestures name: ZoomInvalidate Touch state: TouchMove and Touch limit: 2 and On same object and Distance between points: increasingreturn Distance, Distance changed

  7. Defining Multi-step Gestures Primitive Conditions name: ActorObjectvalidate as line1 Touch state: TouchMove and Touch limit: 1 and Touch shape: line and Touch length: 100..200 validate as line2 Touch state: TouchMoveand … validate line1 perpendicularTo line2 and … return Position, Bounding box Return Types

  8. IDE Support

  9. Primitive Conditions & Return types • The toolkit provides • 15 primitive conditions • 10 return types Image: testmaster.in

  10. Extensibility • Define syntax (parsing logic) • Validation logic • C# or any other .NET supported language

  11. Performance Benefits • Less computation – lazy evaluation • Reuse validated data Touch b & c Touch b & c Touch a & c 3 touches (a, b, c) Touch a &b Touch a &b Return type Calculator Raw data Touch limit: 2 On same object …

  12. On Going & Future Work • Generate definitions from samples • Visual representation of gesture definition Image: aboutcellulars.com

  13. Questions? • Gestures • Language structure • Extensibility • IDE support • http://touchtoolkit.codeplex.com Image: huffingtonpost.com

More Related