430 likes | 927 Views
Captioning Solutions for Handheld Media and Mobile Devices. Geoff Freed Carl and Ruth Shapiro Family National Center for Accessible Media at WGBH Boston, Massachusetts http://ncam.wgbh.org/mm. About NCAM.
E N D
Captioning Solutions for Handheld Media and Mobile Devices Geoff Freed Carl and Ruth Shapiro Family National Center for Accessible Media at WGBH Boston, Massachusetts http://ncam.wgbh.org/mm
About NCAM • The Media Access Group at WGBH is a non-profit service (offices in Boston, Los Angeles, & New York) • The Caption Center (est. 1972) • the world's first captioning agency • makes audiovisual media accessible to audiences who are deaf or hard-of-hearing • Descriptive Video Service (est. 1990) • makes television, film & video accessible to audiences who are blind or visually impaired • The National Center for Accessible Media (est. 1993) • a research, development and advocacy entity • works to make existing & emerging technologies accessible to all audiences • digital television, convergent media, educational technologies, Web, multimedia
Part I: Project Overview
Project summary • Explore and prototype methods for delivering captioned media to mobile devices of all kinds • Address the technical requirements for packaging and distributing captions • Examine ways for users to access and control caption data
Project summary • Launched October 1, 2007 (http://ncam.wgbh.org/mm) • Partners and participants include... • AOL • Apple • HP • Open Media Network • Research In Motion • MacNeil/Lehrer Productions • Samsung • Funding provided by the U.S. Department of Education
Project goals • Publish demonstration models that show how to create, distribute, download and display captioned content on handheld devices • Publish usability research on accessible interface and caption-display options • Distribute information for content creators, service providers, and third-party tool developers to create and transcode captions • Detail the requirements necessary for non-proprietary as well as proprietary text and video formats to render captions
What’s being tested? • Phones, smartphones • PDAs • PMPs • Handheld television receivers
Mother says... “Come on... do people really watch TV and movies on telephones?”
Part II: How movies or TV signals get to a mobile device
How is video delivered to mobile devices? • Downloaded from the Web and synced to mobile device
How is video delivered to mobile devices? • Downloaded or streamed via wireless network directly to mobile device
How is video delivered to mobile devices? • Over data networks (e.g., EDGE, EV-DO, CDMA, GPRS, HSDPA, others) directly to mobile device
How is TV delivered to mobile devices? • Via dedicated mobile-television standard (MPH, ATSC-M/H, MediaFLO (North America), DVB-H, DMB (Europe, Asia), others: • V CAST (Verizon), CV (AT&T), Sprint TV (Sprint), others
How are captions delivered? • Ideally… • as data tracks in downloaded or streamed video • as data carried along with the digital mobile-TV signal • Methods available today: • closed captions encoded into video for certain Apple devices (iPhone, iPod Touch, iPod Nano) • open captions visible in any format, playable on any player
Part III: Devices, evaluations
What’s being evaluated? • Video support • what format(s)? • downlodable only, or streaming? • if streaming, can captions be received and controlled? • Closed-caption support • what format(s)? • how are they controlled?
What’s being evaluated? • Will the device display open captions? • Characteristics • font face and size • text color • background type (transparent, translucent, solid) • background color • Can characteristics be controlled by the user?
Devices currently under evaluation Apple iPhone Apple iPod Nano
Apple iPhone • Video support: M4V; iPod player • Display: 3.5"/480x320 • Caption support: closed (.scc format; pop-on and roll-up) and open • Closed-caption control: yes • Characteristics: • .scc: • white monospace font, black background • no user control • open: • determined by author • no user control
Apple iPod Nano • Video support: M4V; iPod player • Display: 2"/320x240 • Caption support: closed (.scc format; pop-on and roll-up) and open • Closed-caption control: yes, via VideoSettings menu • Characteristics: • .scc: • white monospace font, black background • no user control • open: • determined by author • no user control
Devices currently under evaluation BlackBerry® Curve 8320™ Smartphone
BlackBerry Curve 8320 • Video support: MP4, H.263, WMV; BlackBerry Media Player • Display: 2.5"/320x240 • Caption support: open only • Caption control: none • Characteristics: • open captions only • style determined by author • no user control
Devices currently under evaluation • HP iPAQ 210 PDA • HP iPAQ 510 Voice Messenger
HP 210 • Video support: WMV; Windows Media Player • Display: 4"/480x640 • Caption support: open only • Caption control: none • Characteristics: • open captions only • determined by author • no user control
HP 510 • Video support: WMV; Windows Media Player • Display: 2"/176x220 • Caption support: open only • Caption control: none • Characteristics: • open captions only • determined by author • no user control
Devices currently under evaluation • Samsung BlackJack II (i617)
Samsung BlackJack II i617 • Video support: WMV; Windows Media Player • AT&T’s CV service (not yet evaluated) • Display: 2.4"/320x240 • Caption support: open only • Caption control: none • Characteristics: • open captions only • determined by author • no user control
Part IV: Upcoming work
What’s next? • Focus groups in Los Angeles and Boston • test a variety of caption-display options • ideas for caption-control interfaces • Continue studying caption-creation methods for mobile delivery • Begin creating prototypes of caption-control interfaces • Continue to work with standards groups • W3C’s Timed Text working group, Synchronized Multimedia working group, Mobile Web Initiative and the Video on the Web activity • ATSC M/H working group • Continue to work with vendors to develop and refine methods for creating and distributing caption data • Create working examples of captioned media
More information • Project Web site: http://ncam.wgbh.org/mm • project summary • prototypes of captioned media for various devices • device-comparison chart