1 / 14

SAVI

SAVI. Shopping assistant for the visually impaired. Saurav Chatterjee Andrew Ebaugh Chuck Eli (industrial design). Interdisciplinary Effort. Industrial Design students (winter quarter) => Understand consumer needs and product design Concept and initial form factor prototype

parker
Download Presentation

SAVI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SAVI Shopping assistant for the visually impaired Saurav Chatterjee Andrew Ebaugh Chuck Eli (industrial design)

  2. Interdisciplinary Effort • Industrial Design students (winter quarter) => • Understand consumer needs and product design • Concept and initial form factor prototype • Computer Engineering students (spring quarter)=> • Understand embedded systems • Take concept to working prototype CSE + Industrial Design

  3. Basic concept of SAVI • What does it do? • SAVI allows blind people to locate and identify items using RFID technology • What is it good for? • Blind people can shop by themselves • Currently have to depend on others • Limits their choices • Helps them identify items once they get home • More flexible than Braille signs and tags • Easy to update and add additional information (e.g., sale price, contents, etc.)

  4. Independence and Freedom "The sense of accomplishment in doing it myself is a great feeling." - Brad Lingrand

  5. Play Video • mms://videosrv6.cs.washington.edu/general/cse477_04sp_254k_320x240.wmv • Start Time: 00:56 • End Time: 02:13

  6. Architecture Input Output Processing

  7. Architecture, cont. • Hardware components • RFID tags, reader in a glove form factor • Intel Personal Server • Product description via audio to head-phones • Software components • SQL database • DB query service • MP3 decoder

  8. Implementation • RFID scanner – mote running TinyOS transmits RFID tag scan to a mote in a CF card on personal server • CF card mote – accessible as a serial port on personal server, /dev/tts/3 • Serial forwarder service – dumps whatever is received on the serial port to listeners on a network port (4444 TCP) • ODBS listener service – Connects to network port, and registers as a listening client, accepting forwarded packets.

  9. Implementation, cont. • ODBS – Multi-threaded: port listening thread, database query thread, output thread • Product information is stored in SQL database • Upon receiving a RFID scan, the service queries the product database • Additionally queries for brand, price, sale information • Each piece of information returns an associated audio clip; from all of these, a presentation “playlist” is generated

  10. Implementation, cont. • Presentation clip – Once the clip has been generated, ODBS makes a call to Runtime.exec() to execute an mp3 audio player • Execution call takes the form of: madplay /mp3/brand-04.mp3 /mp3/product-02.mp3 /mp3/alphanum-39.mp3 • MP3 player talks to audio board as /dev/dsp • Headphones/ear-piece connected to audio board

  11. Evaluation • How well does it work? • The system works pretty well. The key metrics: • Distance glove needs to be from tag • Length of time glove needs to be reading tag • Delay between successful scan and start of audio(i.e. processing time) • Length and relevance of audio clip

  12. Evaluation, cont. – metrics • Distance glove needs to be from tag • Depends on how charged the batteries are, and how sensitive the antenna is • For our glove reader with a Mylar antenna in palm and full batteries, the distance is 3-4 inches. • Length of time glove needs to be reading tag • We have toyed with different reading frequencies to tune this metric • Currently check for a tag 4 times per second. At this speed, the reader can detect a tag when moved by it at an acceptable speed (i.e. as if you were feeling around the object)

  13. Future Work • Lots to be done, lots of possibilities • Database contains a lot of information not currently used: UPC code, location, quantity • There should really be an audio output component always loaded, rather than making an external call • The product database could be a central store database accessed over wi-fi or similar • Could integrate a shopping list or store navigation aid • Would like to have a scanner at the checkout register that relates product name, price, subtotal as rung up • The glove we have is definitely a prototype: should have a lightweight, chargeable battery, and several buttons • Possible text-to-speech for audio generation, and linking with existing UPC-based product databases

  14. Questions? Bluetooth ear piece Personal server as part ofcell phone or PDA RFID reader “glove”that is inconspicuous Tags on shelf edgesor on individual items

More Related