1 / 48

ETANA-DL NSF Digital Library Project

ETANA-DL NSF Digital Library Project. Edward A. Fox, Virginia Tech. ASOR Annual Meeting, 2004. fox@vt.edu http://fox.cs.vt.edu http://fox.cs.vt.edu/talks/2004/. Problems. Delay in publication of primary archaeological data

jillian-bernard
Download Presentation

ETANA-DL NSF Digital Library Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ETANA-DLNSF Digital Library Project Edward A. Fox, Virginia Tech ASOR Annual Meeting, 2004 fox@vt.edu http://fox.cs.vt.edu http://fox.cs.vt.edu/talks/2004/

  2. Problems • Delay in publication of primary archaeological data • Lack of sustainable solutions to long-term preservation of valuable information • Lack of services useful to the archaeology community, including “traditional DL services” • Difficulty in understanding complex archaeological information systems • Difficulty in requirements elicitation for archaeological systems • Interoperability among heterogeneous archaeological systems

  3. Solution – our approach • Applying and extending Digital Library (DL) techniques to solve the following problems: making primary data available, data preservation, and interoperability • Modeling archaeological information systems using 5S theory to better understand the domain and design the system and the supported services • Rapidly prototyping DLs that handle heterogeneous archaeological data using componentized frameworks: elicitating requirements, providing useful services

  4. ETANA-DL • Archaeological Digital Library • Applies and extends the OAI-PMH • Open Archives Initiative Protocol for Metadata Handling • Design considerations • Componentized • Distributed architecture • Extensible • Portable

  5. Heterogeneous data handling

  6. ETANA-DL Canned Demo

  7. ETANA-DL Searching Service Search

  8. ETANA-DL Multi-dimensional Browsing 3 new sites 2 new types of artifacts

  9. ETANA-DL Visual Browsing Service Visual Browse By site

  10. Visual Browsing Nimrin: Topographical Drawings Square: N40/W20 Full site North westquadrant

  11. Visual Browsing Nimrin : Square information Square: N40/W20 Locus: 86 Loci layout

  12. Visual Browsing Nimrin : locus sheet

  13. Visual Browsing Bab edh-Dhra' Cemetery Pottery # 25

  14. Visual Browsing Bab edh-Dhra' Cemetery Pottery # 25

  15. 5S Archaeological DL Modeling • Modeling archaeological information systems • using the 5S theory • to better understand the domain and • design the system and the supported services

  16. Structures indexing Societies Scenarios hypertext Streams Spaces searching services Minimal DL Collection Repository browsing A Minimal DL in the 5S Framework Structured Stream Structural Metadata Specification Descriptive Metadata Specification Metadata Catalog Digital Object

  17. Streams ArchObj searching Structures Spaces Scenarios indexing browsing Societies ArchColl hypertext ArchDR Minimal ArchDL SpaTemOrg StraDia ArchDColl services Descriptive Metadata specification Structured Stream Arch Descriptive Metadata specification Arch Metadata catalog ArchDO A Minimal ArchDL in the 5S Framework

  18. Scenario model Society model Repository building Services Archaeologist Service Manager Value added General public Domain specific Space model Information Satisfaction Geographic space User interface Metric space Structure model Taxonomies Spatial Metadata Temporal Artifact-specific *Sub-partition Region *Site *Partition *Locus *Container *Artifact Stream model Text Video Audio Drawing Photo 3D Modeling ETANA-DL – An Archaeological DL Meta-model

  19. Scenario model Society model Services Harvesting, Converting Archaeologist ETANA-DL Service Manager Annotation, binding Generic public Object comparison, marking item for analysis Space model Web interface Site-specific coordinate system Vector space Searching, Browsing Taxonomies Structure model Field record, locus sheet Bone type Spatial Archaeological periods Seed species Jordan Umayri *Field *Square *Locus *Pail *Bone Jordan Valley *Quadrant *Square *Bag *Locus *Seed Nimrin Southern Israel Halif *Field *Area *Locus *Basket *Figurine Stream model Site/field plan(drawing) Figurine image (photo) Preliminary/FinalReport (application/pdf) Modeling ETANA-DL – ETANA Model

  20. 5SGraph: A DL Modeling Tool • Overall objective of 5SGraph: Help users model their own instances of a digital library (DL) in the 5S language (5SL). • A simple modeling process which enables rapid generation of digital libraries is needed. • Support non-expert users. • Speed-up development process. • Increase the quality of final product.

  21. Goals of 5SGraph • To help digital library designers understand the 5S model quickly and easily • To help digital library designers build their own digital libraries without difficulty • To help digital library designers transform their models into 5SL files automatically • To help digital library designers understand, maintain, and upgrade existing digital library models conveniently

  22. 5SGraph How does 5SGraph work? • 5SGraph loads and displays a metamodel in a structured toolbox. • The structured editor of 5SGraph provides a top-down visual environment for the DL designer. • 5SGraph produces correct 5SL files according to the visual model built by the designer.

  23. Overview of 5SGraph Workspace (instance model) Structured toolbox (metamodel)

  24. Stream Model

  25. Structure Model

  26. Space Model

  27. Scenario Model

  28. Society Model

  29. Component Reuse • Components can be loaded/saved. • Load and save sub-trees • Component reuse saves time and effort. • Full reuse from component pool • Partial reuse: adapting components

  30. Semantic Constraints • There are inherent semantic constraints in the hierarchical structure of the 5S model. • 5SGraph maintains the constraints and enforces these constraints over the instance model to ensure correctness.

  31. Metadata harvesting The World According to OAI Service Providers Discovery Current Awareness Preservation Data Providers

  32. Data and Service Providers • Data Providers • possess metadata and share it (internally / externally) • via well-defined OAI protocols (e.g., database servers) • Service Providers • harvest data from Data Providers • provide higher-level services to users • (e.g., search engines) • Who will fit where in ETANA-DL? • Data Provider – YOUR PROJECT • Service Provider – ETANA-DL

  33. Why be an OAI Provider • Speed up publication • Long-term preservation • Do not need to worry about providing services

  34. How to be an OAI Provider • Requirements • Perl • Web server with ability to run CGI scripts • Download OAI-XMLFile-2.1.tar.gz from http://www.dlib.vt.edu/projects/OAI/software/xmlfile/xmlfile.html • Extract the files into a directory from which CGI scripts may be run • gunzip OAI-XMLFile-2.1.tar.gz • tar –xvf OAI-XMLFile-2.1.tar

  35. How to be an OAI Provider (Cont.) • Want your pottery collection be an OAI data provider? • Create a director “mySitePottery” under ‘OAI-XMLFile-2.1/XMLFile’ • Copy the contents in test5 directory to “mySitePottery” directory • Modify the config.xml under ‘OAI-XMLFile-2.1/XMLFile/mySitePottery’

  36. <?xml version="1.0" ?> … <repositoryName> pottery repository name</repositoryName> <adminEmail> YourAdmin@yourServer</adminEmail> <archiveId> pottery Archive ID</archiveId> <recordlimit>500</recordlimit> <datadir> directory of pottery XML collection </datadir> … <metadata> <prefix> prefix of pottery repository </prefix> <namespace> namespace of your schema </namespace> <schema> location of your XML file schema </schema> </metadata> </xmlfile>

  37. Apply the 5S Framework in Integrating Archaeological DLs • Architecture of a Union DL • Union Catalog Integration • Union Services Automation

  38.     Society Society Union Society     General Public archaeologists Archaeologists General Public Architecture of a Union DL DL1 Union DL DL2 Union Service Service Service Harvesting, Mapping, Searching, Browsing, Clustering, Visualization Searching Browsing Union Catalog Catalog1 Catalog2 Union Repository Repository1 Repository2

  39. Union Catalog Integration Mapping Tool VN Metadata Format Union Catalog VN Catalog Virtual Nimrin (VN) Wrapper Global Metadata Format HD Catalog Halif DigMaster (HD) Wrapper HD Metadata Format Mapping Tool

  40. Visual Mapping Tool Architecture Visualizing Components Composite Mapper Mapper1 Mapper2 Mapper3 Mapper4

  41. Visual Mapping Tool Demo

  42. local schema global schema

  43. Mapping recommendation

  44. Mapping confirmation Mapping history

  45. No recommendation for “Tomb_Area”

  46. User-decided mapping

  47. Requirements (1) Analysis (2) DL Designer 5S DL 5SGraph Meta Expert Model Practitioner 5SL Teacher DL Model c omponent Design (3) pool Researcher ODLSearch, ODLBrowse, ODLRate, Tailored ODLReview, 5SLGen ……. DL Implementation (4) Services 5SGraph 5SGen Mapping Tool 5SSuite

  48. ArchDL Expert 5S Archaeology MetaModel ArchDL Designer 5SGraph Structure Sub-model VN Metadata Format HD Metadata Format Scenario Sub-model ETANA-DL Metadata Format Harvesting description VN Catalog VN Catalog Mapping Tool Mapping description Wrapper4VN Wrapper4HD Inverted Files Browsing description XOAI Web Interface Search Service Index Union Catalog … Browse DB Index Browse Service Component Pool Services DB 5SGen Other ETANA-DL Services XOAI Browsing …

More Related