1 / 43

Searching Featured Lists

Searching Featured Lists. Mercer University Libraries. Jeremy Brown Linda Chen. About Mercer University. Academic University 11 Schools 10,000+ students. Featured Lists. User Manual Page #107098 Supports review files of bib or item records Do Not support other record types

kendis
Download Presentation

Searching Featured Lists

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Searching Featured Lists MercerUniversity Libraries Jeremy Brown Linda Chen

  2. About Mercer University Academic University 11 Schools 10,000+ students

  3. Featured Lists User Manual Page #107098 Supports review files of bib or item records Do Not support other record types Need to keep the list(s) from the Creating List

  4. 2 Steps Create a list Set up a WWWOption

  5. Step 1 – Create a List

  6. Step 1 - Creating List Search Screen

  7. Step 2 - WWWOption

  8. Step 2 - WWWOption User Manual Page # 106908 WWWOPTION: FEATURED_LIST

  9. Example 1 WWWOPTION: FEATURED_LIST=[list]|[table_header]| [revfile_header]|[#recs_header] FEATURED_LIST= 01,03,12,17

  10. Example 2 WWWOPTION: FEATURED_LIST=[list]|[table_header]| [revfile_header]|[#recs_header] FEATURED_LIST=01,03,12,17|SELECTED TITLES|TOPIC|# TITLES

  11. Our WWWOption FEATURED_LIST=[list]|[table_header]| [revfile_header]|[#recs_header] FEATURED_LIST=03,02,05,06,36|February 2012| Collections|# Titles

  12. Feature List What do we use it for? Monthly New Book Lists Special Projects Display Different Collections Anyone has other suggestion?

  13. Feature List This is ok, but.. Something is missing… Cannot search the list

  14. Searching Feature Lists

  15. What We Wanted Menu of Feature Lists to Search Keyword Search function

  16. What We Noticed Feature List URLs always contain “ftlist” Review file number Result Record URLs always contain Review file number Bibliographic record number

  17. Anatomy of a List URL

  18. A Result URL

  19. Anatomy of a Result URL

  20. This Sounded Indexable! Each URL contains the list review file Each URL contains the bib number Bibliographic records have lots of key words.

  21. Indexing WebPACFeature Lists

  22. Technologies Used Nutch: http://nutch.apache.org/ SOLR: http://lucene.apache.org/solr/ jQuery/AJAX: http://jquery.com

  23. Flow Chart

  24. Crawl The WebPAC

  25. What Does Nutch Do? Read list of URLs Download one of the URLs Extract all the links on the page, add to list of URLs Extract the full text of the page Repeat until done with URLs Send Pages to SOLR for indexing

  26. Set up WebPAC for Crawling We need to let our crawler look at the WebPAC Name the crawler in [nutch_home]/conf/nutch-site.xml Edit /iiidb/http/robots.txt Add: User-agent: MercuSpider Disallow:

  27. Goals of Nutch URL Configuration Only want bibs from the featured lists We do not want to crawl: MARC view Save record screens Request item screens Probably others… We do not want to index the whole WebPAC

  28. Set up Nutch for Crawling the WebPAC Edit nutch/conf/regex-urlfilter.txt Add: -^http://library.mercer.edu/.*request.* -^http://library.mercer.edu/.*save.* -^http://library.mercer.edu/.*marc.* +^http://library.mercer.edu/search~S1.*ftlist

  29. Indexing with SOLR

  30. What Is SOLR? A search engine in a box Put documents in Creates a full text index Answers queries

  31. Set up Solr for Crawling the WebPAC SOLR comes ready to run It works well with Nutch Easy to use as search engine back end

  32. The Single, Solitary SOLR Modification Add to solr-example/solr/conf/solrconfig.xml <requestHandlername="/mercuFtlist" class="solr.StandardRequestHandler"> <lstname="defaults"> <intname="rows">10</int> <strname="echoParams">explicit</str> <strname="fl">url,id</str> </lst> <lstname="appends"> <strname="fq">(url:ftlist)+(url:\+\+ftlist/\+\+ftlist)</str> </lst> <lstname="invariants"> <boolname="facet">false</bool> </lst> </requestHandler>

  33. SOLR Request Handler, Explained We only want the URL and ID in our results We only want to search items that appear in the feature list <strname="fl">url,id</str> <strname="fq">(url:ftlist)+(url:\+\+ftlist/\+\+ftlist)</str>

  34. Performance Hit (Millennium)

  35. Performance Hit (Web Server)

  36. Searching

  37. Architecture Standard web form AJAX calls to SOLR for results AJAX results enhancement

  38. Search Form

  39. Search Form in the WebPAC

  40. Basic Results Display

  41. Enhanced Results

  42. More Information Our Featured Lists:http://library.mercer.edu/search~S1?/ftlist Visit our Systems page:http://libraries.mercer.edu/university-libraries/systems-department/iug-2012or: http://goo.gl/3q3QV MAJAX is located here:http://libx.org/majax/

  43. Thank You!

More Related