1 / 26

Erin Kinney, Wyoming State Library

Erin Kinney, Wyoming State Library. Motivation. #1 priority that came out of 2004 statewide digitization meeting WSL received many reference questions, obituary and ILL requests. Project. Digitize all newspapers published in Wyoming 1849-1922* and make them

dana
Download Presentation

Erin Kinney, Wyoming State Library

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Erin Kinney, Wyoming State Library

  2. Motivation • #1 priority that came out of 2004 statewide digitization meeting • WSL received many reference questions, obituary and ILL requests

  3. Project Digitize all newspapers published in Wyoming 1849-1922* and make them easily accessible over the internet. *Preserved on microfilm at the Wyoming State Archives

  4. Project • 1,436 microfilm reels • 850,000 full pages • 8,000,000 clippings

  5. Funding Applied for a 2006 NDNP grant, which was not funded. The Wyoming State Legislature appropriated $940,000 to the State Library in FY07-08. Requested additional funding in FY09-10 which was later denied.

  6. The Partners Wyoming State Library Wyoming State Archives University of Wyoming American Heritage Center Wyoming Press Association Wyoming State Historical Society

  7. Partners • Wyoming State Archives provided copies of master microfilm reels • Wyoming State Historical Society provided metadata workers • The company picked to do the work was PTFS from Bethesda, MD

  8. Why PTFS? • Expertise: people, process, software, hardware • More than ten years imaging experience • All media types, qualities, formats • Many hardware and software configurations • R&D Development of an archiving system has helped PTFS perfect imaging capabilities

  9. Technical Requirements • All text searchable • Content management system (CMS) with a web interface, and a customizable thesaurus • Very powerful search engine

  10. Technical Standards • Project followed 2007 NDNP best practices • High Accuracy OCR & Auto-Zoning • 400 dpi grayscale • Enhanced metadata • Articles, legal/land notices, and advertisements clipped

  11. Digitization Processes Enhance metadata Receive newspaper microfilm reels; Inventory control Data formatting for system Create image/text PDFs: full page & clippings OCR images Categorize, sort, prepare QC/QA ArchivalWare Approval Server Zone, crop & de-skew full images Scan Microfilm at 400 dpi Post Image Processing Export to USB External Drive

  12. Image Sizes

  13. Challenges Image Quality, OCR Accuracy Difficult to achieve high OCR accuracy Original text quality varies : yellowed paper, bleed through, faded, bound page curvature Microfilm quality varies Dark borders, washed out sections, out of focus Misc: Scratches, Thumbs, Tape, Staples!! Grayscale best, but results in large files sizes PTFS Confidential

  14. Challenges Rules for zoning (for clipping) are complicated to design and execute Newspaper formats vary widely from title to title & year to year Determine zoning rules and consistently follow PTFS Confidential

  15. Challenges “NDNP Ready” Imaging & metadata standards, XML packets Massive storage requirements—many, many terabytes of storage File types: TIFF and PDF Browse hierarchy Determines organization of collection Supports logical presentation Page & clipping relationships PTFS Confidential

  16. Solutions Browse Hierarchy Organized by county/city, then newspaper title, year, month, date Pages and clippings will be presented together Page & clipping relationship Clippings linked to pages Archive quality image location Archive quality images transported via USB external drive and backed up to tape (twice!) PTFS Confidential

  17. Lessons Learned • Lots of open communication, between all partners, contractor and sub-contractors • Start looking for money early, but make sure you have your ducks in a row. Don’t get discouraged.

  18. Lessons Learned • Think of the long term implications of decisions made at the beginning of the project • Decisions made at the beginning of the project can have unforeseen, and often huge, implications.

  19. Opportunities • Fill in gaps in coverage • Orphan papers—publishers and even towns that no longer exist • “New to us” newspaper titles that haven’t been located and microfilmed yet

  20. Wyoming Newspaper Project Contact Erin Kinney, Digital Initiatives Librarian erin.kinney@wyo.gov http://wyonewspapers.org

More Related