1 / 20

Microsoft Research Faculty Summit 2007

lee
Download Presentation

Microsoft Research Faculty Summit 2007

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

    2. When Is The Pen Mightier Than The Keyboard? Andries van Dam Professor of Computer Science Brown University

    4. First Wave: Research ‘60s and ‘70s

    8. RIP (Adapted from Bill Buxton)

    9. Third Wave: Research And Deployment (2000 …) Much more powerful hardware Tablet PC Digitizers Wacom Cintiq Smartboard Much improved software support Tablet SDK Handwriting recognition Speech recognition Character recognizers Better recognition algorithms Machine learning (use those cycles!)

    10. Pen-Centric Computing: My Definition Takes advantage of the pen More than a high resolution mouse for picking and trailing digital ink Interprets digital ink in appropriate context for character/symbol, gesture, and diagram recognition Best if used within a multi-modal interface, e.g., with speech recognition Uses pen, finger, multi-touch, … HP IQ770HP IQ770

    11. Music Notepad Change to make lightweight intro to idea that some things are better sketched than typed. have a picture of a kid using. just pictures what would be good - optional 3d order. take the best music editing progra now and show what its ui is like. is this a good stalking horse? find what’s out there. total time - 30 minutes. if it does make a nice cvompare and contrast have a screen shot. of the best of wimp interfaces. “What-you-see-is-what-you-entered (WYSIWYE).” from UIST98 paper on Music Notepad. URL to Atlanta, GA school w/ Tablet PC per student/teacher http://www.marietta-city.k12.ga.us/index.html Change to make lightweight intro to idea that some things are better sketched than typed. have a picture of a kid using. just pictures what would be good - optional 3d order. take the best music editing progra now and show what its ui is like. is this a good stalking horse? find what’s out there. total time - 30 minutes. if it does make a nice cvompare and contrast have a screen shot. of the best of wimp interfaces. “What-you-see-is-what-you-entered (WYSIWYE).” from UIST98 paper on Music Notepad. URL to Atlanta, GA school w/ Tablet PC per student/teacher http://www.marietta-city.k12.ga.us/index.html

    12. Demo: MathPad2 Overview Mathematical sketching Combine handwritten math, simple FoC, and freeform diagrams 2D math expression recognizer Graphing; symbolic and numeric solutions Uses MATLABŽ as underlying math engine Diagrams animate according to associated math expression(s) Fully gestural interface for editing Expressions can be deleted, edited, and re-recognized Modeless operation

    13. MathPad2 Sketch-based interface dataflow The stroke data that users enter in a sketch-based interface goes through a series of transformations on the way to being interpreted as a gesture or sketch. Typically, the raw data first undergoes a preprocessing step followed by a segmentation step that breaks up the stroke data into logical pieces. These segmented pieces are analyzed and important features are extracted from them. These features are then used in a classification and parsing (interpretation) step, ultimately leading to some form of sketch understanding. In the next few slides we will examine each of these steps. Keep in mind that not all sketch-based interfaces use all of these transformations in the order presented in the slide. Some approaches, especially when dealing with gesture-based interfaces, may skip some of the steps, while others may perform the steps in a different order or may perform a particular step more than once. However, having said this, the dataflow model shown in the slide is a good way to think about the internal workings of a sketch-based interface.The stroke data that users enter in a sketch-based interface goes through a series of transformations on the way to being interpreted as a gesture or sketch. Typically, the raw data first undergoes a preprocessing step followed by a segmentation step that breaks up the stroke data into logical pieces. These segmented pieces are analyzed and important features are extracted from them. These features are then used in a classification and parsing (interpretation) step, ultimately leading to some form of sketch understanding. In the next few slides we will examine each of these steps. Keep in mind that not all sketch-based interfaces use all of these transformations in the order presented in the slide. Some approaches, especially when dealing with gesture-based interfaces, may skip some of the steps, while others may perform the steps in a different order or may perform a particular step more than once. However, having said this, the dataflow model shown in the slide is a good way to think about the internal workings of a sketch-based interface.

    14. Math Error Visualization Techniques Always typeset After interaction pause, show typeset Can disrupt input, but is best for reading Adjusted handwriting Replace with clear handwriting after pause Less disruptive, but less clear Typeset offset Interactive fit-to-width typeset below ink Easy to read, but takes up a lot of space Typeset mini Interactive fixed-size typeset below ink Harder to read, but less distracting Note colorization in adjusted handwriting to show parseNote colorization in adjusted handwriting to show parse

    15. Demo: ChemPad

    16. ChemPad Architecture

    18. ChemPad Architecture

    19. MSpcc An invitation Center to be international resource for pen-computing community Open source software Website as portal for information Institutions and people Projects and applications Publications, demos, and tutorials Research Wiki http://pen.cs.brown.edu Workshops We invite your inquiries and contributions!

    20. “To Infinity And Beyond…” Where - Ktty Hawk, NC When – December 17, 1903 Plane name – Flyer Who – Orville Wright Almost beat him: Samuel Pierpont Langley in his Aerodrome – October, 1903 – failed to lift off. Santos Dumont in his Canard at Paris – October, 1906 – flew 197 feet to become the first flyer to cover 25 meters. Louis Bleriot was the first to fly an aircraft across the English channel – in 1909. Where - Ktty Hawk, NC When – December 17, 1903 Plane name – Flyer Who – Orville Wright Almost beat him: Samuel Pierpont Langley in his Aerodrome – October, 1903 – failed to lift off. Santos Dumont in his Canard at Paris – October, 1906 – flew 197 feet to become the first flyer to cover 25 meters. Louis Bleriot was the first to fly an aircraft across the English channel – in 1909.

More Related