1 / 13

zKWIC: A Web Based KWIC Tool

zKWIC is a tool for searching installed corpora with user-supplied keywords, displaying them in context, and allowing filtering with regular expressions. It integrates open source components such as Zope, MySQL, SWISH-E, and Python. The tool functions on Win32 (Cygwin) and Unix platforms, storing compressed corpora in a relational database. zKWIC features a user-friendly web interface for searching and filtering, with a two-step uploading/indexing process and additional administrative functions.

rustyc
Download Presentation

zKWIC: A Web Based KWIC Tool

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Robert Irie irier@spawar.navy.mil Code 244207 SPAWAR Systems Center San Diego zKWIC: A Web Based KWIC Tool

  2. Introduction • Keyword in context (KWIC) tool • Searches installed corpora for user supplied keywords and displays them in context • Allows successive filtering with standard regular expressions • Integration of open source components • Web application server (Zope: http://www.zope.org) • Relational database (MySQL: http://www.mysql.com) • Search engine (SWISH-E: http://www.swish-e.org) • Scripting language (Python: http://www.python.org) Note: zKWIC may function better with Internet Explorer than with Netscape Navigator on some non-Windows platforms

  3. Architecture • Win32 (cygwin) and Unix platforms • Compressed corpora stored in relational database • User interface • Searching/Filtering through web interface • Administrator usage • Two-step uploading/indexing of corpora through shell interface • Additional administrative functions through special web interface

  4. zKWIC System Diagram Index Files SWISH-E Search Engine User Browser Zope Web Server Index Admin Shell MySQL DB Convert Corpus

  5. User Interface • Search Interface (Web) • Keyword entry • Form field: Semicolon-separated keywords • Text File: CR-separated keywords • Single or multiple index selection (indices previously created by administrator) • Retrieve previous results • Results Interface (Web) • Per file display of matches, or view all matches • Successively filter matches using regular expressions • Sort by column (right or left context, keyword, etc.) • Save results to database for later retrieval • Link from keyword to file (full doc) context, with keyword highlighted

  6. Search Interface Manual Keyword Entry File-based Keyword Entry Single or Multiple Index Selection Start Search Previous Search Results (name assigned by user)

  7. Results Interface Menu Regular Expression Filter Match Summary Save Results Show All Matches Matched File Display

  8. Administrator Interface • Execution Directory • (ZOPE_INSTANCE_HOME)/Extensions • Multiple Indices • Indexbase- A unique name for each corpus (no extension) • Upload corpus (shell) • ./convert.py [-o] [-g] [-i indexbase] [-d dir [-e ext] -r]|[file ...] • By directory (recursively), by extension, or by file name • Index corpus (shell) • ./index.py [incr|full|delete] [all|indexbase] • Full: Indexes entire corpus • Incr: Indexes only files uploaded since last full index

  9. Administrator Interface (shell) Upload all *.py files in current directory, naming corpus 'pyscripts' Index corpus 'pyscripts', creating full index file

  10. Administrator Interface (Web) http://localhost:8080/zkwic/zkwicadmin

  11. JCorporaLogger • Developed by Robert Gottlieb (gottlieb@spawar.navy.mil) • Java-based, zKWIC interoperable utility • Shows user last set of queries made into zKWIC • Shows user last set of indexes that were indexed (via swish-e) • JcorporaLogger installation • logger.properties file: set up query to access table you wish to display • Usage • Click on the Query button. • Click on any column headers to sort the entire data set based on that column. • Double click inside any table cell to copy information (e.g. to rerun a query in zKWIC)

  12. JCorporaLogger Usage User Query Term Query File Indices Date

  13. Acknowledgments • Beth Sundheim (sundheim@spawar.navy.mil) • Robert Gottlieb (gottlieb@spawar.navy.mil)

More Related