540 likes | 561 Views
“Digital Libraries (A Pictorial View)” Bioinformatics ‘99 October 7-8, 1999. Edward A. Fox fox@vt.edu http://fox.cs.vt.edu Computer Science Digital Library Research Lab Internet Technology Innovation Center at VT Virginia Tech, Blacksburg, VA, USA. Acknowledgements (Selected).
E N D
“Digital Libraries (A Pictorial View)”Bioinformatics ‘99October 7-8, 1999 Edward A. Fox fox@vt.edu http://fox.cs.vt.edu Computer Science Digital Library Research Lab Internet Technology Innovation Center at VT Virginia Tech, Blacksburg, VA, USA
Acknowledgements (Selected) • Sponsors: ACM, Adobe, IBM, Microsoft, NSF, OCLC, SURA, US Dept. of Education • Co-PIs: John Carroll, Andy Cohill, John Eaton, Lenny Heath, Debby Hix, Brian Kleiner, Gail McMillan, Mary Beth Rosson • Students: Fernando Das Neves, Robert France, Neill Kipp, Paul Mather, Constantinos Phanouriou, James Powell, Ohm Sornil, David Watkins, Chang Zhang, Jianxin Zhao
Improving Education Info. Literacy (1995) Internet (1984) SGML (1985) Digital Libraries NSF DLI (1994) Multimedia (1986) WWW (1994) University Scholarly Electronic Pub. (1988) Library Cancellations (1988) PDF (1992)
Repository of Digital Objects Repository Access Protocol handle Metadata terms and conditions Digital object
DLs: Definitions • Super information systems • Knowledge management systems with persistence, organization, and usability • Collections of digital objects with expanded services, for distributed user communities, without limitations of space, time, physical copies • Latest implementation of visions of Bush, Licklider, Nelson, and previous scholars • Systems, services, institutions, enterprises, and projects of the digital library community
5S Layers Societies Scenarios Spaces Structures Streams
Definition: Digital Libraries are complex systems that • help satisfy info needs of users (societies) • provide info services (scenarios) • organize info in usable ways (structures) • present info in usable ways (spaces) • communicate info with users (streams)
Definition: 5S Framework • Societies: interacting people (, computers) • Scenarios: services, functions, operations, methods • Spaces: domains + constraints (e.g., distance, adjacency): 2D, vector, probability • Structures: relations, trees, nodes and arcs • Streams: sequences of items (text, audio, video, network traffic)
DLs Shorten the Chain from Author Editor Reviewer Publisher A&I Consolidator Library Reader
DLs Shorten the Chain to Author Digital Library Editor Reviewer A&I Reader
DLs Shorten the Chain to Roles Digital Library Author Teacher User Reader Editor Learner Reviewer Librarian
User Search Support(multilingual, XML) Note: All groups shown are connected with NDLTD.
Signed Grad School Student Gets Committee Signatures and Submits ETD Approval form
Ph.D. Graduate School Approves ETD Student is Graduated Quality control
Library Catalogs ETD and New Students Have Access to the New Research WWW NDLTD Digital library access control
Institutional Members • Coalition for Networked Information (CNI) • Committee on Inst. Coop. (CIC - for Big 10) • Diplomica.com • Dissertation.com • National Library of Portugal • UNESCO • Organization of American States (OAS) • Ibero-American Science, Technology, and Education Consortium (ISTEC)
US University Members • Air University (Alabama) • Cal Tech • Clemson University • College of William & Mary • Concordia University (Illinois) • East Tenn. State University • Florida Institute of Tech. • Florida International University • Michigan Tech • Naval Postgraduate School (CA) • North Carolina State U. • Penn. State University • Rochester Institute of Tech. • U. of Florida • U. of Georgia • University of Hawaii, Manoa • U. of Iowa • U. of Maine • U. of Oklahoma • U. of South Florida • U. of Tennessee, Knoxville • U. of Tennessee, Memphis • U. of Texas at Austin • U. of Virginia • U. Wisconsin - Madison • Vanderbilt U. • Virginia Tech - required since 1/97 • West Virginia U. - required beginning fall 1998 • Worcester Polytechnic Inst.
Australian Project Members • U. New South Wales (lead institution) • U. of Melbourne • U. of Queensland • U. of Sydney • Australian National University • Curtin U. of Technology • Griffith U.
German Project Members • Humboldt University (lead institution) • 3 other universities • 5 learned societies • 1 computing center • 2 major libraries
Other International Members • Chinese University of Hong Kong • Chungnam National U., Dept of CS (S. Korea) • City University, London (UK) • Darmstadt U. of Tech. (Germany) • Free University of Berlin (Germany - Vet. Med.) • Gyeongsang National U. (Korea) • India Institute of Technology, Bombay (India) • Nanyang Technological U. (Singapore, part) • National U. of Singapore (Singapore, part) • *National Library of Portugal • Polytechnic University of Valencia (Spain) • Rhodes U. (South Africa) • St. Petersburg St. Tech.U (Russia) • Univ. de las Américas Puebla (Mexico) • University of Pisa (Italy) • U. Laval; U. of Guelph; U. Waterloo; Wilfrid Laurier U. (Canada)
Access Statistics 1996 1997 1998 Total successful requests: 37,171 247,573 628,401 Av. successful requests/day: 102 685 1,690 Requests for .PDF files: 4,600 72, 854 343,236 Requests for .HTML file 28,225 129,831 215,896 Distinct hosts served 9,015 22,725 36,724 Total data transferred: 3,229M 25,953M 74,051M Av. data transferred/day: 9M 73M 222M
Popular Works 1997 9920 Liu, Xiangdong. Analysis and Reduction of Moire Patterns in Scanned Halftone Pictures (Ph.D. in Computer Science, May 1996; 6.6Mb) 7656 Petrus, Paul. Novel Adaptive Array Algorithms and Their Impact on Cellular System Capacity (Ph.D. in Electrical Engineering, March 1997; 5Mb) 2781 Agnes, Gregory Stephen. Performance of Nonlinear Mechanical, Resonant-Shunted Piezoelectric, and Electronic Vibration Absorbers for Multi-Degree-of-Freedom Structures (Ph.D. in Engineering Mechanics, Sept. 1997; ? + 7926Kb) 2492 Gonzalez, Reinaldo J. Raman, Infrared, X-ray, and EELS Studies of Nanophase Titania (Ph.D. in Physics, July 1996; 4607Kb) 1877 Shih, Po-Jen. On-Line Consolidation of Thermoplastic Composites (Ph.D. in Engineering Mechanics, Feb. 1997; 3.3Mb) 1791 Saldanha, Kevin J. Performance Evaluation of DECT in Different Radio Environments (MS in Electrical Engineering, Aug. 1996; 3.2Mb) 1431 DeVaux, David. A Tutorial on Authorware (MS in CS, April 1996; 2.3Mb) 1394 Kuhn, William B. Design of Integrated, Low Power, Radio Receivers in BiCMOS Technologies (Ph.D. in Electrical Engineering, Dec. 1995; 2518Kb)
Accessibility Activities / Plans • Interface design (simple, 3D, VR) • Usability studies • Generic multi-lingual support • Support for those with disabilities • Hybrid collection (paper, MARC, abstracts, full-text, multimedia) • Disciplinary classifications, tools • Visualization of results, collection
CAVE Experiments • Use a familiar metaphor • building / floor / room / shelf / book • Rearrange orderings / shelving • use categories, clustering, ranking • use visualization: colors and gaps • study space mappings: physical, logical • Simplify movement for key tasks
ENVISION • NSF “A User-Centered Database from the Computer Science Literature” (1991-93) • Collected bib/typesetter data, converted to SGML • Scanned thousands of page images • MARIAN search engine - can be made available (also applied to the Virginia Tech library catalog) used as part of a prototype object-based DL, with tailored visualization interface (L. Nowell dissertation)
MARIAN • Multiple Access Retrieval of Information with ANnotations • (Musical: Marian the Librarian …) • Evolved from 1980’s CODER system to a distributed Online Public Access Catalog (OPAC), then DL backend, now becoming a full DL system • From C/C++ to Java by Jianxin Zhao • Future uses: NDLTD, NUDL, PetaPlex
User User User User MARIAN Layers User Interface Layer User Information Layer Search Engine Layer Database Layer
MARIAN Testing Architecture Load Generator Webgate Java Server C/C++ Server
PetaPlex • Digital Library Machine (“super” object store) • Parallel computer / storage utility for scale of 1000 to 100,000,000 gigabytes (1 Tbyte - 100 Pbyte) • Knowledge Systems Incorporated is supplying VT-PetaPlex-1 for $250,000 with • high speed backbone connection (OC-12) • 2.5 terabytes through 100 “Nanoservers”: • Each = Network connection + IBM 25GB disk + 233 MHz Pentium II + Linux
PetaPlex Approach • Extend work on KMS begun in 1970s • Achieve qualitative improvement in quality of hypertext • sub-second response • with terabyte and petabyte scale stores • Rapid response through hashing over a very large storage space • support URN access as primitive service • support name / repository model for digital library
Service Machine 1 Service Machine 3 PetaPlex Complex Service Machine 2 Service Machine 4 FRONT END MACHINE RS/6000, 1G RAM, 4 Proc. Nanoserver PetaPlex Core Nanoserver Nanoserver Nanoserver Nanoserver Nanoserver Nanoserver Nanoserver Nanoserver Nanoserver Nanoserver Nanoserver Nanoserver Nanoserver
PetaPlex Service Machines • Small object server • Large object server • video on demand • streaming audio • Information retrieval server • Proxy / cache server (e.g., 1 terabyte server of 1000 worldwide for Comsat/Intelsat)
PetaPlex Top View 4 ft. side
PetaPlex Side View 15 shelves Roles: * Support * Cooling * Power Aluminum 8 ft. high 4 ft. wide
PetaPlex Cost Goals, Approach • Maximize number of seeks achievable • Maximize % of cost invested in disks • Maximize flexibility, composability, reliability • Minimize cost per unit of storage • Approach “information utility” • Increase throughput and reliability by replicating on other PetaPlex systems • Use robotics, wireless, and commodity production of nanoservers
National Synchronization Home Page http://dli.grainger.uiuc.edu/national.htm DIGITAL LIBRARIES INITIATIVE Funded through a joint initiative of: National Science Foundation Defense Advanced Research Projects Agency National Aeronautics and Space Administration Stephen M. Griffin Division of Information and Intelligent Systems National Science Foundation sgriffin@nsf.gov