Edge Detection Evaluation in Boundary Detection Framework

1. Feng Ge Computer Science and Engineering, USC Edge Detection Evaluation in Boundary Detection Framework

2. Edge Detection Error • Edge detection Detect pixels with strong gradient of “gray-level” • Error • False negative(Missing ): Not detected Edges • False positive: detected false edges • Orientation error: shift from real position • Dislocation error: shift from real direction • How to evaluate these errors?

3. Evaluation Criteria • Ground Truth • Human or predefined results? • Quantificaition • Measuring and expressing in number means good. • Generality • Real images in large number Combined 3 criteria are good evaluation methods!

4. Overview • Subjective vs Objective • Human vision checking • Quantitative measurement • With ground truth vs Without • Standard for evaluation • Some characters,e.g, continuation,coherence. • Synthetic vs Real images • Simple structure • Complicated structures

5. Motive—in boundary detection framework • Problem: Boundary detection algorithms work well in synthetic data, while poorly in real images • This gap,we believe, is largely introduced by edge detection

6. Experiment Settings: Image Database • Large: 1030 images • Generality • Unambiguous • Manually extracted ground truth

7. Experiment Settings: Evaluation Flowchart

8. Experiment Settings: Detectors • Edge & Line Detector: Canny & Line Approximation • Boundary detector: Ratio-Contour

9. Experiment Settings: performance measurement

10. Experiment • Original imagesimage->edge->fragments->bounday->evaluation • Synthetic imagestexture images->fragments --->bounday->evaluation ground truth->adding noise • Semi-synthetic images original images->background -->bounday->evaluation ground truth->adding noise

11. Experiment --Synthetic images • Result • Much better than original images • Problem • Background correlation changed • Irregular background in texture images

12. Experiment –Semi-synthetic images • Edge-map error analysis • Model simulation

13. Result-1 Procedure: Sample ground truth, random delete some percentage of fragments • Simulate edge missing

14. Result-2 • Simulate edge detection error: missing & dislocation • Fix dislocation error, vary missing rate (a) • Fix missing error, vary dislocation error (b) (a) (b)

15. Conclusion • Our noise model is close to real edge error, as regarding to the simulated result • Edge missing and dislocation are mainly encountered errors in edge detection. • Edge dislocation is more crucial in edge error compared with missing error

16. Discussion-1 • Error introduced by line detection

17. Discussion-2 • Model error • Gaussian distribution assumption • Based on boundary detection • Globally, not locally • Introduce some error, but statistically, reasonable • Image database • Low resolution • Ground truth error

18. Future work • Distinguish errors introduced by line approximation from edge detection • Noise model refinement • Substitute line with curve in edge-map approximation • Data base improvement

19. Thank You !