1 / 33

ETD Search Services

Join the ETD Search Services community to access and share research data. OCLC NDLTD Union provides 112,652 ETDs metadata from 44 institutions in 3 formats. Use SRU and VTLS Search for efficient retrieval.

darrick
Download Presentation

ETD Search Services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ETD Search Services Ming Luo EdwardA.Fox(fox@vt.edu) Virginia Tech

  2. Acknowledgements (selected) • Support: Adobe, AOL, DFG, NSF (DUE-0333531,0136690,0121679; IIS-0086227,0080748 ), OCLC, UNESCO, VTLS • Colleagues: Vinod Chachra, Tom Dehn, Marcos Gonçalves, Thom Hickey, Aaron Krowne, Ming Luo, Gail McMillan, Hussein Suleman, Jeff Young

  3. Where are the data coming from? • From this community! • Please join us, share your data! • OCLC NDLTD Union • 112,652 ETDs metadata • 44 institutions • Will be able to provide 3 formats • DC • ETDMS • MARC21

  4. Where are the data coming from? • OCLC (Research) contacts are • Thom Hickey [hickey@oclc.org] • Jeff Young [jyoung@oclc.org] • Tom Dehn [dehn@oclc.org] • VTLS has some additional data sources • Providing data other than through OAI-PMH • Including in Korean and Greek • Contact is Vinod Chachra [chachrav@vtls.com]

  5. Institutions in OCLC NDLTD Union Set (1)

  6. Institutions in OCLC NDLTD Union Set (2)

  7. OCLC SRU • What is SRU? • Search and Retrieve URL Service (SRU) is web service based protocols for searching databases • Derived from Z39.50 • Uses Common Query Language • Current version: V1.1, 13th February 2004 • Three basic operations, explain, scan and searchRetrieve

  8. CQL Examples(from http://www.loc.gov/z3950/agency/zing/cql/) • dc.title cql.stem • dc.title = "cat" cat • dc.title = "cat" author = "smith" • dc.title any "cat" bath.author cql.exact "smith, j." • dc.title any/relevant/rel.CORI "cat fish" dc.author exact/stem "smith, j." • dc.title = cat "<element>" • dc.title = "cat" and bath.author = "smith" " cat" or hat • dc.title = "cat" prox/distance=1/unit=word dc.title = "in""cat" prox/distance>2/ordered "hat" • dc.title=cat and/rel.sum dc.title=dog • > dc="http://www.dublincore.org/" dc.title = "cat"

  9. OCLC SRU Interface

  10. VTLS Search • Based on Virtua system from • VTLS (www.vtls.com) • Visionary Technology in Library Solutions • Developed in C++ • Uses Oracle Database

  11. Virtua User Interface • Scan Search • Key Word Search • Expert Search

  12. VTLS Union CatalogContent Languages • The VTLS NDLTD Union Catalog has data in 6 different languages. These are: • English • German • Greek • Korean • Portuguese • Spanish • Examples follow

  13. Language = German; hits = 137

  14. Full record display

  15. Virginia Tech ETD Union • Componentized Digital Library Software • Uses OCLC’s OAI data provider • Mirrored in China by CALIS • About 200 queries and 400 pages per day for the past year and usage is increasing

  16. Metadata harvesting The World According to OAI Service Providers Discovery Current Awareness Preservation Data Providers

  17. User Interface Search Browse What’sNew OCLCdataprovider VT ETD Union System Diagram

  18. Extended OAI-PMH Open Digital Library Protocol Protocol for Metadata Harvesting

  19. Extended OPEN ARCHIVE Open Digital Library Component OPEN ARCHIVE

  20. Open Digital Library Components • Running now • XML-File (data provider from file system) • Search: simple or in-memory (Essex) or generalized • Union, browse, recent, filter • E-journal/review, Submit, Edit, Annotation • Recommender, Rating; Mirroring (see JCDL’02) • Working with NCSA: from DB, unstructured text • Others in process • Classification/categorization • Registry (and other connections with web services)

  21. Program Video Video Image Image Program Program Video Image XPMH 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 OA OA XPMH PMH OA XPMH OA XPMH XPMH OA XPMH OA Document Document Document XPMH XPMH 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 XPMH OA OA XPMH OA PMH XPMH open digital library

  22. ETD-2 ETD-4 Video ETD-3 Image Program Program Video Image 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 ETD-1 Document Document 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 1010100101010010101010010101010101010101 Example Open Digital Library ODLRecent USER INTERFACE Recent PMH ODLUnion Filter PMH ODLUnion Union Browse PMH ODLBrowse PMH ODLUnion Filter PMH Search ODLSearch ETD DL for the Networked Digital Library of Theses and Dissertations (www.ndltd.org) Students and researchers ETD collections

  23. ETD Union Search Mirror Site in China (CALIS)(http://ndltd.calis.edu.cn – popular site!)

  24. Composability Efficiency Effectiveness OCLC SRU Medium High High VTLS Low High Medium Virginia Tech ETD Union Search High Medium Medium Quality of Search Services

  25. Software Used Software License Price of Software Full Text Search OCLC SRU Homegrown N/A N/A No VTLS VIRTUA (VTLS.com) Commercial Depends on user number, collection size No Virginia Tech ETD Union Search Open Digital Library BSD-like Open Source License Free No Virginia Tech ETD collection Ultraseek (Verity.com) Commercial Depends on user number, collection size Yes Comparison of Software

  26. Next Steps with VT ETD Union • Web Services based component • Easier user interface configuration • Better precision of search results; full-text? • Research studies (e.g., Ryan Richardson dissertation) • Studies of collections and genre • Summaries using concept maps • Cross-language retrieval

  27. References: • Z39.50 International - Next Generation: http://www.loc.gov/z3950/agency/zing • VT Service: http://rocky.dlib.vt.edu/~etdunion/cgi-bin/OCLCUnion/UI/index.pl • VTLS Service: http://www.vtls.com/ndltd • OCLC Service (SRU): http://alcme.oclc.org/ndltd/SearchbySru.html

  28. Thank You! • Paper with more details is available at URL: http://tennessee.cc.vt.edu/~lming/software/ETDSearchServices0.7.doc • DLRL: www.dlib.vt.edu, http://dlbox.nudl.org/ • Fox: http://fox.cs.vt.edu

More Related