330 likes | 450 Views
DigitalWell Digital Asset Management Systems & Applications Jim DeRoest, Director Streaming Media Technologies. www.digitalwell.org. Who We Are – Streaming Media, Video & TV Technologies. Campus Institutional repository/Asset Management – Digitalwell Project
E N D
DigitalWellDigital Asset Management Systems & Applications Jim DeRoest, Director Streaming Media Technologies www.digitalwell.org
Who We Are – Streaming Media, Video & TV Technologies • Campus • Institutional repository/Asset Management – Digitalwell Project • Streaming – Distance education, eLearning • Television – UWTV, uw2.tv, ResearchChannel • Cable & Satellite broadcast 17.1million homes • +2500hrs modem to SD to HD on-demand programming • Live multicast internationally to 30mbps DV • Radio – KEXP • Analog and Digital broadcast • Streaming audio to 1.4mbps • On demand broadcast & playlist archive • Video/Audio Research • iHDTV – desktop to uncompressed HD over the Internet
Mission • Exploit Next Generation Network Bandwidth • High Quality, Low Latency Interactive Systems • Deliver Realism - Quality & Latency Matter • Health Sciences, Biology, Performance Arts • System Integration & Automation – End to End • Television, Radio, Internet Technologies • Middleware Standards • Intellectual Property, Discovery, Metadata • Research & Outreach • National/International Consortia, K20 • Digital Media Asset Management • On Demand Access, DLib Interoperation, Preservation
Broadcast, Streaming, On-Demand www.researchchannel.org www.uwtv.org www.kexp.org
ResearchChannelNationwide 7x24 Hour Television Channel on Cable and SatelliteInternational RetransmissionResearch Consortia
Research Universities: Duke UniversityGeorge Mason UniversityJohns Hopkins UniversityMassachusetts Institute of TechnologyNational University of SingaporeOregon State UniversityPenn State University Rice UniversityRutgers, The State University of New Jersey Stanford UniversityTufts UniversityUniversidad de Puerto RicoUniversitat Politècnica de CatalunyaUniversity of Alaska FairbanksUniversity of ChicagoUniversity of HawaiiUniversity of HoustonUniversity of Maryland - College ParkUniversity of PennsylvaniaUniversity of Southern CaliforniaUniversity of VirginiaUniversity of WashingtonUniversity of Wisconsin-MadisonVirginia TechYale University Research Organizations: Howard Hughes Medical InstituteInternet2National Academies National Academy of EngineeringNational Academy of Sciences National Institute of Standards and TechnologyNational Institutes of Health National Institute of Nursing ResearchNational Library of Medicine National Science & Technology Medals FoundationNational Science FoundationNational Sea Grant College ProgramPacific Northwest GigapopStanford Hospital & ClinicsWisconsin Public Television Corporate Research Centers: Corporation for Education Network Initiatives in CaliforniaIBM CorporationJohnson & JohnsonMicrosoft ResearchSony Electronics Inc.Vulcan Inc. RC Global Initiative Australia Brazil Chile China Finland Korea Netherlands Portugal Spain ResearchChannel Participants
Broadcast Subscribers • 9.0 million - Dish Network • 8.1 million - Individual cable systems • 17.1 million - Total
International On-Demand & Multicast KEXP Listener:“Filipino listeners have a limited music resource. Your online audio streams are able to satisfy hungry listeners such as myself. Thank god for the internet!”
Regional distribution outside U.S. * Webtrends: October 2002 - 2003. U.S. is 75% of Total, this shows remaining 25%
Collaborators • Research & Standards Development • Educational Outreach • Content Sharing • Network Test Beds
DigitalWell: Digital Asset Management • Project focus • Broadcast-”Intercast” integration. • Automation – End to End • capture, describe, deliver • High quality, Realism • Commodity, Standard def, High def • Next generation networks • Asset agnostic • Doc, pic, audio, video, data blobs • Middleware • Metadata, DRM/IPMP, API • Scalable/Pluggable Architecture • Evolve with Technology • Federated DAMS Interoperation • Storage/Preservation
DW Admin API Windows, Unix File systems HSM HPSS, ADSM Broadcast Automation LDAP SRB OAI DigitalWell Architecture Broadcast, Dlib, eLearning Federation Authorization-Authentication-Access Control OAI WebISO, Shibboleth, PKI Access APIs WS API Request Director Metadata Services Stream State Manager Data Transport/Streams Servers Metadata Abstraction Storage Pool Abstraction Databases DB2, SQLServer Drivers
Satellite & Cable Broadcast Video Capture Traffic System Metadata Internet Multicast Service DV, MPEG2, WM Synchronization Single Pass Tape Dub & Encoding MPEG2 SD HD WM, Real, QT International Retransmission VoD Metadata Web Broadcast Schedule Program Library Video On Demand Internet Streaming Service Digital Asset Repository DigitalWell End to End Automation Environment
Instantiation • Dub time automation • Single pass ingest • Virage/Flipfactory • 15mbps MPEG2 master • Format transcoding • Keyframe, metadata creation • Queued for review • Archive & publish • Scheduling • Protrack/Digitalwell • Metadata synchronization • Automated monitoring • Ingest to delivery
Middleware • Metadata • Dublin Core, MPEG7, Custom • OAI, possibly METS • WS API • Collection Directory – LoC/AMIA MIC • Access Controls • Web ISO (Pubcookie), • Institutional Groups • Collection and Asset level ACLs • Shibboleth under development • Preservation • OAIS?
Broadcast Scheduling Integration • Broadcast Traffic & Web Integration • Program metadata store (DigitalWell) • Broadcast schedule (ProTrack, Louth) • Daily extract ProTrack list metadata • Synchronize metadata (ProTrack, DigitalWell) • Tape number and program name • Dynamic generation of ResearchChannel Web • Broadcast schedule • VoD library
Delivery – Little Video … Big Video • Clustered Load Sharing Server Architecture • WM9, Real10, Quicktime, Shoutcast, VideoCharger, VideoLAN • Little Video – Smartphones, PDAs, • Path 1, WM, Shoutcast • Audio/Video streaming, VoD • Middle Video – Desktop • Modem, DSL, Broadband environments • Audio: 32kbps to 1.4mbps Uncompressed • Video: 56kbps to 5.6mbps SD, 19.2mbps HD • DVTS DV 30mbps • Unicast and Multicast • Big Video • Studio Quality SDI delivery 250mbps (SD, HDCAM) • Uncompressed HD 1.5mbps • VoD Demo APAN 2004 • International VC Demo SC’04 http://www.researchchannel.org/projects
Interactive High Definition Video SC’04 Network Routes
Internet SDTV to Desktop • Servers, Players, Codecs • VidoeLan, IBM Videocharger • ffmpeg, Elecard • MPEG2 @ 5.6mbps • Content stored and streamed from UW DigitalWell architecture • All UWTV, ResearchChannel programming available – over 2000 hrs. • UWTV, ResearchChannel SD multicast at 2mbps
Internet HDTV to Desktop • Servers, Players, Codecs • VidoeLan, IBM Videocharger, MS WM9 • ffmpeg, Elecard • 1080i MPEG2 @ 19.2mbps • 720p WM9 @ 5mbps • Content stored and streamed from UW DigitalWell architecture • Developing HDTV card integration for component out display to HD plasmas, projectors, LCDs
Storage Management • Pluggable Hierarchical Infrastructure • Hardware – NAS/SAN/Robotic Tape • 30 TB NAS – Isilon IQ • 2 TB SAN staging – EMC Symetrix • STK robotic tape silos – 9840, 9940 • Software – Mass Store System • HPSS, TSM • Disaster recovery - offsite copies • Content Sharing • Mirroring/Synchronization • Peer to Peer • Federated/Disparate Digital Repositories • SRB OAI
Open Federated Archives Media Repositories DigitalWell Other DAMS, DLS SRB/OAI NSDL UW CDL Targeted Media Portals
DigitalWell Institutional R1 • Institutional Repository Services • Broadcast Migration • KEXP, UWTV, ResearchChannel • Two Previous Broadcast DW Implementations • Production 1QTR 2005
DigitalWell R1 • What’s New … • Enhanced Content Upload • Batch Collection Ingest: Assets and XML Metadata • Validation Assets to Metadata • Recoverable Upload • Metadata Profiles • DWLite – File System Metadata, Limited Search • Extended Dublin Core – Search • PBCore – Broadcast Support • Advanced Custom Fields
DigitalWell R1 • What’s New … • WS API • Interface Development, Teaching Tools • System Admin Tool • User Account Management • Automated Account Creation/Expiration • User Quotas • Collection Management • Selectable per Asset Delivery Option • Stream only, Download or Both
DigitalWell R1 • New Non-broadcast Collections • Health Sciences – MRI imaging • School of Music – 15k hrs Ethnomusicology • College of Forestry – Sat images old growth • Experimental Education – SD video to K12 • iEARN – International student video collab http://www.iearn.org • PETTT VideoTraces – Collab video tool http://epts.washington.edu/pettt/projects/videotraces.html
Sharing PBS Programming Over the Internet between 8 stations
Microsoft Research • MURL Goals: • Increase awareness among researchers everywhere about the recent advances in the availability of streaming video technologies • Provide access anywhere, at any time, to the rich, distinctive seminars of the partner institutions • Investigate the potential of streaming video and collaborative technologies to change, and improve, the delivery of information and education • Explore the social and communication issues that may arise from increasing the audience for seminars that are traditionally targeted to smaller, face-to-face groups
DigitalWell - What’s next… • Content Sharing/Synchronization • SRB prototype with AARNET • Advanced Search • CRIM MADIS MPEG7 Video Object Search • Encoding • Closed Caption, Transcripts • User Initiated Batch Transcoding • Network and Storage Scaling • Bandwidth > 1.5gbps per stream • Cost • 1Hr Broadcast HD ~9GB • 1Hr HDCAM/SDI ~120GB • 1Hr Studio HD ~670GB • Video Conferencing • Low Latency HD and Plasma Resolution • Tarari HPC hardware • SDI Firewire • Capture Card • Access Grid and Video Presence integration
? Questions ?www.researchchannel.orginfo@researchchannel.orgderoest@researchchannel.org