Mahmoud S. Hamid, Neal R. Harvey, and Stephen Marshall

1. Genetic Algorithm Optimization of Multidimensional Grayscale Soft Morphological Filters With Applications in Film Archive Restoration Mahmoud S. Hamid, Neal R. Harvey, and Stephen Marshall IEEE Transactions on Circuits and Systems for Video Technology, 2003

2. Outline • Introduction • Soft Morphological Filters (SMF) • Genetic Algorithm(GA) • Introduction • Applying to the File Dirt Problem • Discussion • Conclusion

3. Introduction • Film dirt is the common problem in old film archives. • This damage manifests itself as “blotches” of random size, shape and intensity. • These blotches are nontimecorrelated. • The cost of conventional restoration are very high. • Some of then can only deal with physical film strip. • Most of the conventional image sequence restoration algorithms involve median filtering. • Then, lots of median filter are Introduced.

4. Soft Morphological Filters (SMF) • Grayscalesoft morphological filters. • Two parts of the structuring element : the hard center and the soft boundary. • Less rigidly in noisy conditionsmore tolerant to small variations in the shapesof the objects.

5. Soft Morphological Filters (cont.) • The structuring system [a,b,r] consists of three parameters: • a is the hard center. • bis called the structuring function. • b\a is the soft boundary. • r is the repetition parameter. • The grayscale soft dilation and the grayscale soft erosion :

6. Soft Morphological Filters (cont.) • Grayscale soft open-closing and soft close-opening are combinations of the soft closing and soft opening operations.

7. Extend to the Spatio-Temporal Domain • video sequence is a much richer source of visual information than a still image; • image sequences that contain fast motion always been a problem in the restoration of film archives.

8. Genetic Algorithm (GA) • Initial Population • Evaluation • fitness • Mating Selection • Reproduction • EnvironmentalSelection

9. Initial Population Evaluation Final Population Mating Selection Next generation Reproduction Y Evaluation N Stop? Environmental Selection GA

10. Genetic Algorithm (cont.) • Structuring function: • a) Hard Center • b) Soft Boundary • Rank (Repetition parameter) • Sequence of soft morphological operations: • {soft erode, soft dilate, do-nothing}

11. Applying the GA Optimization Method to the File Dirt Problem • Fitness should be determined. • Find areas of the uncorrupted image. Artificially corrupt these ideal image regions. • Fitness value based on some measure of the mean absolute error (MAE).

13. Fitness Function • Fitness for an image in the sequence is a measure of how it is close to the ideal. • fitness value = 100means the filter is perfect.

14. Genetic Operators • Selection: Stochastic universal sampling • Crossover: Uniform crossover • (probability = 0.75) • Mutation: Randomly choosing • (probability = 0.03) • Population Size: 30 Parent Solutions

15. Discussion • Structuring function size = 773 . • Running for 500 generations.

16. Fitness of LUM = 98.56

17. Fitness of LUM = 98.56 • Fitness of optimized SMF = 99.52

18. Discussion (cont.)

19. Discussion (cont.) • To compare with a method which is depend the detection of the noise using the ROD detector [19] with ML3Dex filter[20]. • It filters the detected noisy pixels and leaves the remaining image pixels untouched. • Use the same noise detection with optimized SMF. [19] M. Nadenau and S. Mitra, “Blotch and scratch detection in image sequences based on rank ordered differences,” in Proc. 5th Int. Workshop on Time Varying Image Processing and Moving Object Recognition, Sept. 1996, pp. 27–35. [20] A. Kokaram, Motion Picture Restoration. Berlin, Germany: Springer, 1998.

20. Fitness of ML3Dex= 99.54 • Fitness of SMF with noise detection = 99.88

21. Discussion (cont.) • SMF could perfectly restore all fast-moving objects.

22. Conclusion • A technique for the optimization of multidimensional grayscale soft morphological filters using the GA. • Showed excellent performance in removing dirt from film and has little effect on the image detail. • The fast-moving objects were restored perfectly.