1 / 20

Manipulation of 3D objects with gestures and voice

Manipulation of 3D objects with gestures and voice. Research issues: 3D Sketching Input devices: mouse, bird Gesture recognition Voice recognition. 3D Sketching. Goal: Space Modelling (by 3D object creation) Traditional sketching is inherently 2D: floor plan, cross section, perspective

betsy
Download Presentation

Manipulation of 3D objects with gestures and voice

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Manipulation of 3D objects with gestures and voice Research issues: 3D Sketching Input devices: mouse, bird Gesture recognition Voice recognition

  2. 3D Sketching • Goal: Space Modelling (by 3D object creation) • Traditional sketching is inherently 2D: floor plan, cross section, perspective • Adaptation of Kai’s Inner world

  3. Input Devices • ‘Controlled’ space modelling requires high accuracy • 6 DOF Input devices show best performance with positioning and deforming

  4. Gesture Recognition • Hand movement > command • Sketch > object

  5. Voice Recognition • Speech interpretation • Command recognition

  6. 3D Sketch application • Creation of rectangular shapes and spaces: • Drag & Copy box • Delete box • Navigate • Rotate viewpoint

  7. 3D Sketch application • Creation of rectangular shapes with specific orientation: • Orient box • Drag & Copy box

  8. 3D Sketch application • Set/change color of box by voice command: • Select box • Say: “red”, “green”, “blue’

  9. 3D Sketch application • Creation of curves shapes and spaces: • Drag & Copy box along curve • -45 < angle < +45 degr.

  10. Improvements & Extensions • Scale box size: • Uniformly / non-uniformly • Surface profile

  11. Improvements & Extensions • Group Objects: • Sketch gesture = group • Add/remove object

  12. Improvements & Extensions • Change dimensions: • By box • By group

  13. Improvements & Extensions • Interpret Sketch: • Parameterized geometry • Change position and dimensions of shapes and openings • Geometrical constraints

  14. Improvements & Extensions • Interpret operations: • Representation: Box mesh or Param. Geom. • Design intend: Level, aspect

  15. Improvements & Extensions • Deformation of box meshes: • Geometric representation ? • To which extend ? • Transformation to Param. Geom. ?

  16. Improvements & Extensions Connection to Feature Database: • database element: sketch attributes: position, color, … • specialization into Param. Geom. attributes: parameters, textures, ...

  17. Improvements & Extensions User environment: • LCD sketchpad with pencil • Bird: positioning and deforming • Large screen projection • Command input: pointing, speech • Cross section box

  18. Improvements & Extensions Modify utilities: • Move • Copy • etc.

  19. Goodbye and Thanks

More Related