A Compression Based Distance Measure for Texture

1. A Compression Based Distance Measure for Texture Bilson J. L. Campana Eamonn J. Keogh University of California – Riverside bcampana@cs.ucr.edu

2. What makes texture important? Why is texture hard to mine? The CK method and CK-1 measure. Rival methods. Datasets and experimenting. The results. Outline of the Talk

3. exture is Everywhere!!

4. Global scalars • Entropy • Standard Deviation • Energy • … • Global vectors • Wavelet coefficients • Fourier Transforms • … • Local Features • SIFT descriptors • Textons • … But what IS texture? The old forget, the young don’t know!

5. Textures are ubiquitous in images • Proper analysis of an image should take into account many details • Texture • Color • Shape • Geospatial data • Etc. • Current approaches for texture analysis require far to much tuning • Cannot simply use texture algorithms correctly for many datasets Mining Textures There seems to be texture, but I don’t want to spend the time setting up and tuning if it doesn’t work! We’ve formed a simple solution to your problems!

6. Simple things are easily understood, accepted and used. The CK Method Everything should be made as simple as possible, but not simpler. -Albert Einstein Measure image similarity by exploiting video compression

7. Kolmogorov Complexity The Kolmogorov complexity K(x) of a string x is a measure of the resources needed to specify x abababababababababababababababab b4w1x8nb2y39abgk5q85s7arjqj0cvab Consider this example… And now, conditional complexity K(x|y)… Incomputable!! We have images!

8. Three types of frames • I, B, P • Encoder settings are intuitively set and empirically tested In this example, the P frame has 1 reference to the I frame. HowMPEG1 Works I B P

9. The CK-1 Measure • Query images are used to create a two frame movie. C(x|y) C(y|x) y x x y - 1 C(x|x) C(y|y) x y x y You can’t control what you can’t measure. -Tom DeMarco

10. Apply Invariance to Rotation As you’ll see. CK-1 is very FAST! So you can just measure two images several times while rotating them? PRECISELY!

11. Gabor Filter Banks* • Widely used for its ability to be tuned to many applications • Six orientations and four scales • Filters are convoluted through the image and responses are gathered into a response vector • Textons** • Classification from clustered filter responses • Extended from the previous filter bank implementation Rival Algorithms *P. Wu, B. S. Manjunath, S. Newsam, H. D. Shin, A texture descriptor for browsing and similarity retrieval, Signal Processing: Image Communication, Volume 16, Issues 1-2, Pages 33-43, September 2000. • **M. Varma, A. Zisserman, A Statistical Approach to Texture Classification from Single Images, Int. J. Comput. Vision 62, 1-2, 61-81, Apr. 2005.

12. 15 experimental datasets • Many demonstrations • Arachnology • Forensic Science • Biology • Archeology • Biometrics • Historical Texts • Texture benchmarks • And more! A World to Be Measured A LOT of datasets!

13. One nearest neighbor, leave-one-out cross validation Texton measure is trained on the entire dataset All experiments, demonstrations, and figures are completely reproducible All datasets and source are available online Experiments and Reproducing! Hey Doc! Start reproducing at www.cs.ucr.edu/~bcampana/texture.html

14. Speed Check Why is CK-1 so fast? Because it’s simple! Go with blue!!

15. Perception is Key! Filter Bank CK-1

16. Performance at a Glance CK-1 is DEFINITELY a contender!

17. Presented a compression based framework and measure for texture. Simple. Empirically tested Freely and easily available. Fast. Accurate. In Summary Simplicity, carried to an extreme, is elegance. -Jon Franklin

18. Contact Email bcampana@cs.ucr.edu • Paper Support Site www.cs.ucr.edu/~bcampana/texture.html