90 likes | 193 Views
EMu enhancements and developments. Darrell J. Siebert NHM Collections Database Manager. EMu. Object oriented data model Convenient for collections management purposes Some relational functionality Can link between some modules in many-to-1 relationship Client-Server architecture
E N D
EMu enhancements and developments Darrell J. Siebert NHM Collections Database Manager
EMu • Object oriented data model • Convenient for collections management purposes • Some relational functionality • Can link between some modules in many-to-1 relationship • Client-Server architecture • EMu user community-wide aspects server side • NHM bespoke aspects client side • Indexing methods to support data model • ‘joins’ not supported
EMu enhancements and developments to support digitisation programme • Export of data for NHM data portal (Informatics Initiative) • Server side image loading • Batch Operations • IMu • Barcodes
Data export for data portal • EMu data model and indexing methods not suitable for our needs for fast web display • ‘Table dump’ -- core product functionality • Initial dump of data from relevant tables • Only records with appropriate security setting are exported! • Automatic weekly change list • Informatics Initiative team structures and indexes data to suit needs of data portal
Server side image loading • Images typically processed client side (on desktop PC) • Can be ‘slow’: > 10 min for 220MB Mellon Project botanical image • 100,000 Mellon images: 1.9 years to load • Bulk server side image loading (images processed by server) • 220MB Mellon Project image processed in 1 min • 100,000 Mellon images: 69 days to load • Effectively 24/7 background process • Currently using 1 core; can increase this but need to understand impact on server performance
EMu Batch Operations module: dataset cleanup • Collections digitisation programme: high quality, end-to-end outcomes • Collections information in digital form associated with appropriate image(s) • High quality collections information – our biggest challenge • Duplicates • Identical records • Near identical records for same information • EMu Batch Operations module • Standard, client side ‘Merge’ operation addresses duplicate records • Bulk ‘Merge’ operations moved to server side • Frees client for other uses • Effectively 24/7 background process
IMu API • IMu – api delivered as standard with EMu • Standard functionality: query; insert; update; and delete • IMu is ‘EMu data model aware’ • IMu is ‘EMu security model aware’ • Informatics Initiative team exploring delivering data to a scratch pad for the SCORE project using IMu api • With appropriate developer expertise IMU can enable development of mobile (tablet) applications
Barcodes • Labels too small to fit much information on • Palaeo labels 42x42mm • Slide labels 25x25mm (or smaller) • Barcode • Machine readable object • Encodes registration number • Can be linear or 2D -- these are 2D - 5x5mm • Can be ‘read’ with mobile phone • Link to richer information • Wireless infrastructure • Mobile devices and applications