120 likes | 150 Views
FileMaker OAI-PMH Solutions. Tom Habing, Tim Cole, Matt Cordial {thabing, t-cole3, cordial}@uiuc.edu Two Approaches to making Filemaker Databases Harvestable via OAI-PMH Dynamic Third-party Gateway OAI Static Repositories (< 5,000 records) Implemented in DAVIS DC versus CDWA-Lite.
E N D
FileMaker OAI-PMH Solutions Tom Habing, Tim Cole, Matt Cordial {thabing, t-cole3, cordial}@uiuc.edu • Two Approaches to making Filemaker Databases Harvestable via OAI-PMH • Dynamic Third-party Gateway • OAI Static Repositories (< 5,000 records) • Implemented in DAVIS • DC versus CDWA-Lite
UIUC’s OAI FileMakerPro Gateway FileMakerPro Databases OAI Harvesters http://some.edu:591/FMPro?-db=artifacts&... http://myoai.org/oai.aspx/artifacts?verb=... OAIster OAI FileMaker Gateway http://myoai.org/oai.aspx reap http://this.org:591/FMPro?-db=collection&... http://myoai.org/oai.aspx/collection?verb=...
OAI FileMakerPro GatewayThe Problem • FMP has widespread use in the museum community and is often used for special collections in libraries • Until recently there are no easy or convenient tools for making FMP databases OAI accessible
OAI FileMakerPro GatewaySolution • Out of the box, FMP has a built-in web server and can export XML • http://www.filemaker.com/downloads/pdf/xml_overview.pdf • This facilitates a solution similar to OAI Static Repositories • Except it is not static; data is being fed directly from the database and not from a static copy • This is a slight fib: because of how datestamps are derived they only have a ganularity of one day, so an incremental harvest might be up to 24 hours out of date
OAI FileMakerPro GatewayMore Technical Details • Databases Layouts are Exposed as two different XML Grammars (version 8 adds a third) • The -dso_xml format (deprecated): • Easier to transform with XSLT • But may be malformed in some cases (the gateway can accommodate this) • The XML Schema varies by database • Same as XML export format used by MS SQL Server • The –fmp_xml format: • Always the same XML Schema regardless of the database • Difficult to transform
OAI FileMakerPro GatewayCovert Implementations • It is relatively easy to identify and intermediate FMP databases using the Gateway. • Use Google to Find them: • http://www.google.com/search?q=allinurl%3A591+fmpro • Gather configuration details like layouts, etc. • Write an XSLT to transform –dso_xml into oai_dc • Some FMP database owners probably don’t even realize how easy it is for someone to perform a wholesale download of their entire database • Good for OAI implementers, • But FMP database owners, be careful of sensitive data!!! • Make sure the web-based edit features are secured!!!
OAI FileMakerPro GatewayAn Invitation http://cicharvest.grainger.uiuc.edu/fmpgateway/ • We are looking for FMP collections we can test with the Gateway • We’ve currently tested using FMP 6,7,& 8 • Only using oai_dc metadata • We do plan to maintain the Gateway, similar to our OAI Static Gateway
OAI Static Repositories • Static Repository • A single XML file containing all metadata, identifiers, and datestamps • Accessible from a web server via an HTTP URL, such as http://host:port/path/file.xml • Static Repository Gateway • Provides intermediation for one or more Static Repositories • http://www.openarchives.org/OAI/2.0/guidelines-static-repository.htm
Static Repository Gateway Example Using DAVIS • Export a found-set in the OAI format with the DAVIS tool • Place this file in a web-accessible location • e.g -- http://some.webserver.edu/moac/moactest.xml • Initiate the Static Repository with a Static Repository Gateway • <Static Repository Gateway URL>?initiate=<Static Repository URL> • e.g -- http://some.edu/gateway2/oai.asp?initiate=http://another.edu/moac/moactest.xml
Gateway Comparison • Static Repository • http://imlsdcc.grainger.uiuc.edu/gateway2/oai.asp/hades.grainger.uiuc.edu/matt/moac/moactest.xml?verb=GetRecord&identifier=oai:bampfa.berkeley.edu:CM.84&metadataPrefix=oai_dc • FileMaker Pro Gateway • http://cicharvest.grainger.uiuc.edu/fmpgateway/oai.aspx/moac?verb=GetRecord&identifier=oai:grainger.uiuc.edu.moac:130611&metadataPrefix=oai_dc • New layout needed in DAVIS to expose related “media” information via the FMP Gateway
CDWA Lite • Relationship between “work” and its related “media” more explicit than with DC • Stronger semantics • Static Repository Example (with related media) • http://imlsdcc.grainger.uiuc.edu/gateway2/oai.asp/hades.grainger.uiuc.edu/matt/moac/earthtest.xml?verb=ListRecords&metadataPrefix=cdwalite • Static Repository Example (no related media) • http://imlsdcc.grainger.uiuc.edu/gateway2/oai.asp/hades.grainger.uiuc.edu/matt/moac/moactest.xml?verb=GetRecord&identifier=oai:bampfa.berkeley.edu:CM.84&metadataPrefix=cdwalite
Considerations • Repository Size • Current export of Static Repository from DAVIS works well for small sets of data (@ 1,000 – 1,500 records) which will not change frequently • FMP Gateway handles dynamic content and larger collections • Mapping • One layout must exist in FileMaker containing all of the information to be exposed • FMP Gateway requires an XSLT be written for that particular layout • CDWA-Lite with DAVIS • Detailed technical information about related media is not represented • Because it is in the database there is no direct link to the metadata