190 likes | 311 Views
The OCKHAM / NSDL Digital Library Services Registry. A Distributed Approach To Enable End-to-End Digital Service Resolution. Funded by the National Science Foundation National Science Digital Library Program 2 Year Project Funding. Goals.
E N D
The OCKHAM / NSDLDigital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service Resolution
Funded by the National Science Foundation • National Science Digital Library Program • 2 Year Project Funding
Goals • Create a Registry for all possible Digital Library Services • Enable End-to-End Digital Library Service Resolving Sub-Goals • Ensure DLSR is Scalable and Redundant • Ensure Manageability of DLSR is Scalable • Use Existing Standards and Technologies
Use of the DLSR 3 Examples • Library Portal Use Case • Metasearch Use Case • Personal Digital Library
Distributed DLSR • The OCKHAM/NSDL DLSR is Distributed • Many nodes over the network • Scalability • Redundancy • Approach in part based on DNS model
A Brief History of DNS • Hosts.txt file (later just hosts) • ARPAnet started with centralized management • Inter-NIC • Eventually, a more manageable approach was needed • Current Distributed DNS System was created • Allows De-centralized administration • Hierarchical design • Simplifies management • Reduces bandwith, bottlenecks • Reduces duplicate name issue (i.e. .edu, .com, etc.)
Distributed DLSR • Reasoning much the same as DNS • Similarities and Differences
Data Layer Relational Db & OJB • Synchronized • Database Interchangeability • Ease of development Lucene • Fast indexing • “on the fly” indexing • Flexible query engine
Interface Layer Current Interfaces • Struts powered J2ee interface • OAICat - OAI-PMH 2.0 Future Interfaces • SRU/W • Z39.50 • OpenURL Output Formats • Html • XML
Clients • Web browser • OAI-PMH • Z39.50 • Any web enabled application.
Network Layer • JXTA provides low level network functionality • Peer identification and discovery • Transport layer • PeerManager provides modular application level functionality • Load Management • Client/Server Modules • Main Registry Modules • URL Server • Harvester Client
Using OAI For Propagating Data • A peer can query any other peer and receive an incremental update • Queries are based on the latest record modification date for the peer’s local copy of the set • Subsequent queries will use the new latest record modification date
Hierarchal Network Topology Topology Requirements • Data must propagate to all peers • Compensation for inherent instability of P2P networks • Scalable structure • Low overhead • DNS for Digital LibraryServices
OCKHAM Future • Expand the DLSR Community and Use • Explore and build DLSR-aware tools and services • Prototype semi-automated creation of DL’s
Further Information OCKHAM Website – http://ockham.org Martin Halbert, Emory – mhalber@emory.edu Jeremy Frumkin, Oregon State University – jeremy.frumkin@oregonstate.edu