Microfilmed Newspapers: Selection for Digitization Success

4. Selecting Microfilm for a Digital Imaging Project  Microfilm Format Film Generation Determining Film Base & Polarity Evaluating Technical Criteria Microfilm To Digital � Tips For Success! Review presentationReview presentation

5. Selecting Microfilm for a Digital Imaging Project  1ST Step Determine format of microfilm available Chapter slide Chapter slide

6. Microfilm Format Determination 35 mm Preservation microfilm Larger frames/smaller reduction Negative or positive Acetate ? Diazo/Vesicular 16mm/105mm 35mm microfilm Preferred, most commonly used format for preservation microfilm Width of the film allows for wider range in reduction. Tabloid size newspapers could be filmed as low as 16:1 Could be negative or positive Could be acetate base film Could be diazo or vesicular film. Diazo and vesicular films are inexpensive use copy films, however they are not as durable as polyester base film and wear faster from heavy use. Other common formats are 16mm and 105mm microfiche. It�s unlikely these formats were used to microfilm newspapers simply because of the limits of the cameras themselves. The most common misconception about 16mm film is that it is always comparable to 35mm and that is not always the case. More often than not, the 16mm film is thinner, 2mil vs. 35mm film that is 4 mil. Therefore, it cannot be duplicated. 35mm microfilm Preferred, most commonly used format for preservation microfilm Width of the film allows for wider range in reduction. Tabloid size newspapers could be filmed as low as 16:1 Could be negative or positive Could be acetate base film Could be diazo or vesicular film. Diazo and vesicular films are inexpensive use copy films, however they are not as durable as polyester base film and wear faster from heavy use. Other common formats are 16mm and 105mm microfiche. It�s unlikely these formats were used to microfilm newspapers simply because of the limits of the cameras themselves. The most common misconception about 16mm film is that it is always comparable to 35mm and that is not always the case. More often than not, the 16mm film is thinner, 2mil vs. 35mm film that is 4 mil. Therefore, it cannot be duplicated.

7. Microfilmed Newspapers: Selection for Digitization Success  2nd step Determine generation of microfilm Chapter slide Chapter slide

8. Microfilm Generation Determination Archival Master Camera film 1st generation Negative Acetate ? Archival master 1st generation film from the camera Intended not to be used and stored indefinitely Polarity is most likely negative. Some continuous tone film is positive, so it could be a little deceiving to always think your camera master is �only� negative Could be acetate base film This is not the ideal generation to scan from, however, it may be your only copy or it may be the only legible copy. If that is the case, you need to weigh the risks and decide whether or not to scan from this generation.Archival master 1st generation film from the camera Intended not to be used and stored indefinitely Polarity is most likely negative. Some continuous tone film is positive, so it could be a little deceiving to always think your camera master is �only� negative Could be acetate base film This is not the ideal generation to scan from, however, it may be your only copy or it may be the only legible copy. If that is the case, you need to weigh the risks and decide whether or not to scan from this generation.

9. Microfilm Generation Determination Print Master Duplicate copy 2nd generation Negative Acetate ? Print Master Duplicate copy of the camera master Most often the print master is negative, because it�s to replicate the archive master and serve as the print copy to create more positive use copies. First copy � closest to the resolution of the archive master (loss of resolution with each generation) The print master should be stored off site and only pulled on an as need basis. Ideal generation for scanning Could be acetate. Print Master Duplicate copy of the camera master Most often the print master is negative, because it�s to replicate the archive master and serve as the print copy to create more positive use copies. First copy � closest to the resolution of the archive master (loss of resolution with each generation) The print master should be stored off site and only pulled on an as need basis. Ideal generation for scanning Could be acetate.

10. Microfilm Generation Determination Service Copy Duplicate copy 3rd generation Positive Heavily used Acetate ? Service Copy Duplicate copy typically created from the print master Most likely positive Use copy, intended to be used, therefore it has been used heavily and is most likely scratched and/or dirty. Not ideal for scanning because it is a third generation and could be heavily scratched, which we will talk about later. Could be acetate Service Copy Duplicate copy typically created from the print master Most likely positive Use copy, intended to be used, therefore it has been used heavily and is most likely scratched and/or dirty. Not ideal for scanning because it is a third generation and could be heavily scratched, which we will talk about later. Could be acetate

11. Microfilmed Newspapers: Selection for Digitization Success  3rd step Determine base and polarity of microfilm Chapter slide Chapter slide

12. Acetate or Polyester Base?What�s better for digitization? Chapter slide Chapter slide

13. Acetate Deteriorating Warped Brittle Curled Acetate microfilm was produced and used from the 1920's to the 1970's, with the majority produced in the 1930's and 1940's. Acetate microfilm is not recommended for use for preservation microfilming and/or where long-term record retention is required, due to the inevitability of deterioration of the acetate film base. Acetate film will deteriorate, it�s only a matter of time. The base of the film has weakened and dirt becomes embedded in the film, it�s very difficult if not impossible to clean Acetate film can not only tear on film scanners, it becomes more problematic to scan because the dirt transfers to the scanners. Acetate film is not ideal for scanning and the best option would be to create a polyester dupe of the film for scanning. However, if the film is poor quality to begin with, duplicating it could yield worse results. Again, you need to weigh the risks. Acetate microfilm was produced and used from the 1920's to the 1970's, with the majority produced in the 1930's and 1940's. Acetate microfilm is not recommended for use for preservation microfilming and/or where long-term record retention is required, due to the inevitability of deterioration of the acetate film base. Acetate film will deteriorate, it�s only a matter of time. The base of the film has weakened and dirt becomes embedded in the film, it�s very difficult if not impossible to clean Acetate film can not only tear on film scanners, it becomes more problematic to scan because the dirt transfers to the scanners. Acetate film is not ideal for scanning and the best option would be to create a polyester dupe of the film for scanning. However, if the film is poor quality to begin with, duplicating it could yield worse results. Again, you need to weigh the risks.

14. Steps to determine if your film is acetate Review slide Another option is to perform chemical testing with A-D strips. This is a test introduced in early 1995 by the Image Perma�nence Institute, Rochester Institute of Technology, to quantify the amount of acidic vapors pre�sent in acetate micro�film. A-D strips ("A-D" stands for "acid detecting") are acid-base indicator papers that turn from blue to green to yellow in the pres�ence of an increasing amount of acid. Review slide Another option is to perform chemical testing with A-D strips. This is a test introduced in early 1995 by the Image Perma�nence Institute, Rochester Institute of Technology, to quantify the amount of acidic vapors pre�sent in acetate micro�film. A-D strips ("A-D" stands for "acid detecting") are acid-base indicator papers that turn from blue to green to yellow in the pres�ence of an increasing amount of acid.

15. Polyester Preservation Stable Durable Polyester is the most appropriate film stock for preservation microfilm. Polyester base film is virtually tear proof both during processing and in subsequent usage Properly processed and stored, silver halide, polyester base films are estimated to have a life expectancy of 500 years. Ideal for scanning Stable and should withstand scanning Base is durable, therefore dirt should not be embedded in the base Easier to clean Polyester is the most appropriate film stock for preservation microfilm. Polyester base film is virtually tear proof both during processing and in subsequent usage Properly processed and stored, silver halide, polyester base films are estimated to have a life expectancy of 500 years. Ideal for scanning Stable and should withstand scanning Base is durable, therefore dirt should not be embedded in the base Easier to clean

16. Negative or Positive Polarity?What�s better for digitization? Chapter slideChapter slide

17. Positive Usually 3rd generation Lower resolution More scratched Scratches and noise are more difficult to eliminate. Each scratch will be a line in the digital image and will most likely interrupt character recognition Scratches and noise are more difficult to eliminate. Each scratch will be a line in the digital image and will most likely interrupt character recognition

18. Example: Heavily scratched positive microfilm SampleSample

19. Negative Usually less noise Better contrast for text and optical character recognition (OCR) Negative (Inverting the polarity during scanning): Background noise is less prevalent Easier to eliminate scratches Better option for digitization Negative (Inverting the polarity during scanning): Background noise is less prevalent Easier to eliminate scratches Better option for digitization

20. Example: digitized from negative microfilm SampleSample

21. Microfilmed Newspapers: Selection for Digitization Success  4th step Evaluate technical criteria Chapter slide Chapter slide

22. Microfilm Technical criteria Reduction ratio Newspapers filmed at 20:1 or lower are optimal Newspapers filmed at a higher resolution could contain small text that is not legible Reduction Ratio generally between 16:1 and 20:1 The reduction ratio directly influences image quality and OCR results. The lower the reduction ratio (below 20x) the better. (If the reduction ratio is too high to allow scanning at 400 dpi. tests on sample images should be performed to determine if a lower resolution (e.g., 300 dpi) provides acceptable confidence levels in OCR text. If the reduction ratio is not indicated on the microfilm, typically by an eye legible target in the start sequence, it is important to know the size of the original material in order to adequately represent the pages size in the digital image.  For example: 8000 pixel scanner array Divided by 400 ppi = inches (20inches) in height (maximum capture size at 400ppi.) Reduction Ratio generally between 16:1 and 20:1 The reduction ratio directly influences image quality and OCR results. The lower the reduction ratio (below 20x) the better. (If the reduction ratio is too high to allow scanning at 400 dpi. tests on sample images should be performed to determine if a lower resolution (e.g., 300 dpi) provides acceptable confidence levels in OCR text. If the reduction ratio is not indicated on the microfilm, typically by an eye legible target in the start sequence, it is important to know the size of the original material in order to adequately represent the pages size in the digital image. For example: 8000 pixel scanner array Divided by 400 ppi = inches (20inches) in height (maximum capture size at 400ppi.)

23. Microfilm Technical Criteria Resolution Focus achieved at the time of capture, measured with a 100X microscope Poor resolution = fuzzy text = poor OCR The resolution is the focus of your film and whether or not the images are legible Resolution is measured with a test target that was filmed and is the only truly indicator of the legibility If you do not have a test target to measure the resolution, we suggest you use the microscope to look at the text. Keep in mind the film generation you are scanning from Blurry images on the film will result in blurry digital imageThe resolution is the focus of your film and whether or not the images are legible Resolution is measured with a test target that was filmed and is the only truly indicator of the legibility If you do not have a test target to measure the resolution, we suggest you use the microscope to look at the text. Keep in mind the film generation you are scanning from Blurry images on the film will result in blurry digital image

24. Microfilm Technical Criteria Density Range Film created to meet preservation guidelines Film too light or too dark = poor OCR Film with uneven lighting = poor OCR Guidelines were created to ensure the contrast on the camera master will result in good legible copies. Densities that are too dark will have filled in letters Densities that are too light will have missing text. You can opt to duplicate your film darker or lighter, however you will lose some focus. Light balance is key factor at the time of capture as shown in the next slide Guidelines were created to ensure the contrast on the camera master will result in good legible copies. Densities that are too dark will have filled in letters Densities that are too light will have missing text. You can opt to duplicate your film darker or lighter, however you will lose some focus. Light balance is key factor at the time of capture as shown in the next slide

25. Example: Uneven lighting � lost text SampleSample

26. Review Steps 1 - 4  Microfilm Format�35mm Microfilm Generation�archival, print master, service copy Microfilm Base & Polarity�acetate vs. polyester; negative vs. positive Microfilm Technical Criteria�reduction, resolution & density reviewreview

27. Tips for a successful microfilm to digital project Know your microfilm Quantity Quality Contents Chapter slideChapter slide

28. Tips for a successful microfilm to digital project Quantity Frame count = 1up/2up Targets ISE intentional second exposures Duplicates �How many images do you really have?� Was the newspaper filmed 1 page at a time or two? If two pages, i.e. 2-UP, you need to double your image count. If two up, they will need to be split which could add costs to your project. Most of the time, the first and last pages are filmed 1-up, however the scanner is set up for automated scanning at 2-UP f Are there targets on the film, do you keep them or delete them? These are all things to consider that may impact your budget �How many images do you really have?� Was the newspaper filmed 1 page at a time or two? If two pages, i.e. 2-UP, you need to double your image count. If two up, they will need to be split which could add costs to your project. Most of the time, the first and last pages are filmed 1-up, however the scanner is set up for automated scanning at 2-UP f Are there targets on the film, do you keep them or delete them? These are all things to consider that may impact your budget

29. Tips for a successful microfilm to digital project Quality Poor original Poor filming Poor condition of the film Know the quality of the original text before it was microfilmed. Evaluate your film to determine the best source for the best image. know if the material wasn�t collated before filming and issues are missing or filmed out of order. Microfilm of bound material may have page curvature, gutter shadows, or out of focus pages that influence digital image quality. These are all factors that could affect the outcome, especially the budget if special handling needs to be applied to �fix� how it was filmed. Know the quality of the original text before it was microfilmed. Evaluate your film to determine the best source for the best image. know if the material wasn�t collated before filming and issues are missing or filmed out of order. Microfilm of bound material may have page curvature, gutter shadows, or out of focus pages that influence digital image quality. These are all factors that could affect the outcome, especially the budget if special handling needs to be applied to �fix� how it was filmed.

30. Tips for a successful microfilm to digital project Contents Newspaper format Size of the paper, including supplements and full page spreads Was it filmed bound? Title changes, should it be treated as one? �How many images do you really have?� Newspaper format, pages per issue Supplements and full page spreads Filmed bound, could have gutter glare Title changes, even small changes may need to be considered as significant Again, all things to consider that could be multipliers of your image count �How many images do you really have?� Newspaper format, pages per issue Supplements and full page spreads Filmed bound, could have gutter glare Title changes, even small changes may need to be considered as significant Again, all things to consider that could be multipliers of your image count

31. Review tips for success! Quantity � how many images do you really have Quality � poor quality film = poor quality images Contents � bound newspapers and title changes �How many images do you really have?� Poorly prepared original material, no matter how well microfilmed, yield poor results. Know the layout of the newspaper title and be familiar with changes within the title �How many images do you really have?� Poorly prepared original material, no matter how well microfilmed, yield poor results. Know the layout of the newspaper title and be familiar with changes within the title

32. Microfilmed Newspapers: Selection for Digitization Success  Microfilm to digital Chapter slideChapter slide

33. Digitization and imaging options Duplicate to polyester Image enhancement Dynamic threshold adjustment Don�t lose hope if you determine your film is acetate and deteriorating. One option is to duplicate the film to polyester. Just keep in mind, the quality could be slightly lower and you may be better off scanning from the original Your film is skewed and dirty. You have options to apply image enhancements to the scanned image Your film is dark or light? You have options to apply a dynamic threshold process. Again, all of these could affect your budget and the success of your project.Don�t lose hope if you determine your film is acetate and deteriorating. One option is to duplicate the film to polyester. Just keep in mind, the quality could be slightly lower and you may be better off scanning from the original Your film is skewed and dirty. You have options to apply image enhancements to the scanned image Your film is dark or light? You have options to apply a dynamic threshold process. Again, all of these could affect your budget and the success of your project.

34. Questions?  Kelly Barrall/Joan DaShiell1-800-773 7222