220 likes | 234 Views
Detailed progress report for the Fall 2010 Segmentation GUI project, including segmentation granularity, parameter optimization, color saliency testing, and circle packing developments.
E N D
Fall 201011/12/2010 Jacob D’Avy
Outline • Semester overview • Details • Moving forward
Fall 2010 Segmentation GUI • Work with Alexander and Mischa • Developed interface to run batch segmentation Segmentation granularity • Varying parameters to control the amount of segmentation detail • Developed interface to test using watershed Unsupervised performance evaluation • Read and summarized papers • Implemented color saliency measure for testing Circle Packing • Began to investigate connection to segmentation 3D parameter space visualization • Working on a GUI to navigate a 3D parameter space • Functional but not complete Pixel pairing • Developing an idea for parameter space analysis • Under construction
Fall 2010 Segmentation GUI • Work with Alexander and Mischa • Developed interface to run batch segmentation Segmentation granularity • Varying parameters to control the amount of segmentation detail • Developed interface to test using watershed Unsupervised performance evaluation • Read and summarized papers • Implemented color saliency measure for testing Circle Packing • Began to investigate connection to segmentation 3D parameter space visualization • Working on a GUI to navigate a 3D parameter space • Functional but not complete Pixel pairing • Developing an idea for parameter space analysis • Under construction
Varying granularity • Controlling the coarseness of segmentation. • Finding the sweet spot between under and over segmentation.
Varying granularity Progress • Created a GUI for testing • Contains watershed and mean shift segmentation methods • Segmentation coarseness can be controlled by a slider bar Status • On hold
Fall 2010 Segmentation GUI • Work with Alexander and Mischa • Developed interface to run batch segmentation Segmentation granularity • Varying parameters to control the amount of segmentation detail • Developed interface to test using watershed Segmentation parameter optimization • Read and summarized papers • Implemented color saliency measure for testing Circle Packing • Began to investigate connection to segmentation 3D parameter space visualization • Working on a GUI to navigate a 3D parameter space • Functional but not complete Pixel pairing • Developing an idea for parameter space analysis • Under construction
Segmentation parameter optimization • Unsupervised evaluation methods rate a segmentation without using a ground truth. • Color saliency is a measure intended for use in parameter optimization. • It assigns a score to a segmentation result based on the colordifferencebetween neighboring regions. • There is a presentation on my website that gives more detail about the measure. G. Heidemann , “Region saliency as a measure for colour segmentation stability,” Image and Vision Computing, vol. 26, no. 2, pp. 211-227, 2008.
Observations • Color saliency was used for parameter optimization in [1] with some success. • The results for the test images show a tendency to give higher scores to undersegmented output. • In [2] the color saliency measure is used to optimize parameters for k-means segmentation. The results shown there also seem to favor undersegmentation. G. Heidemann , “Region saliency as a measure for colour segmentation stability,” Image and Vision Computing, vol. 26, no. 2, pp. 211-227, 2008. D. Ilea and P. Whelan, “Colour Saliency-Based Parameter Optimization for Adaptive Colour Segmentation,” International Conference on Image Processing, 2009.
Segmentation parameter optimization Progress • Read and summarized papers • Implemented and tested the color saliency measure Status • Ongoing • I will continue to research methods • Eventually some optimization and evaluation measures could be included in the segmentation GUI
Fall 2010 Segmentation GUI • Work with Alexander and Mischa • Developed interface to run batch segmentation Segmentation granularity • Varying parameters to control the amount of segmentation detail • Developed interface to test using watershed Unsupervised performance evaluation • Read and summarized papers • Implemented color saliency measure for testing Circle Packing • Began to investigate connection to segmentation 3D parameter space visualization • Working on a GUI to navigate a 3D parameter space • Functional but not complete Pixel pairing • Developing an idea for parameter space analysis • Under construction
Circle packing • Application to segmentation Progress • Studied the basics of circle packing theory • Downloaded and set up circle packing software Status • On hold http://www.math.utk.edu/~kens/
Fall 2010 Segmentation GUI • Work with Alexander and Mischa • Developed interface to run batch segmentation Segmentation granularity • Varying parameters to control the amount of segmentation detail • Developed interface to test using watershed Unsupervised performance evaluation • Read and summarized papers • Implemented color saliency measure for testing Circle Packing • Began to investigate connection to segmentation 3D parameter space visualization • Working on a GUI to navigate a 3D parameter space • Functional but not complete Pixel pairing • Developing an idea for parameter space analysis • Under construction
Parameter space visualization • The goal is to create a way to easily view and navigate segmentation results. • I am working on software that displays segmentation results in a 3D space. • Each axis represents the change in a parameter.
Parameter space visualization Demonstration Segmentation method: Mean shift Parameters: input image =5x5x5= 525 images
Parameter space visualization Progress • The GUI is functional • Zoom, rotate, and translate • Display selected image from cube (partially working) Status • Under construction
Fall 2010 Segmentation GUI • Work with Alexander and Mischa • Developed interface to run batch segmentation Segmentation granularity • Varying parameters to control the amount of segmentation detail • Developed interface to test using watershed Unsupervised performance evaluation • Read and summarized papers • Implemented color saliency measure for testing Circle Packing • Began to investigate connection to segmentation 3D parameter space visualization • Working on a GUI to navigate a 3D parameter space • Functional but not complete Pixel pairing • Developing an idea for parameter space analysis • Under construction
Pixel pairing • The goal is to automatically find a good result from a set of • segmentations produced by varying parameters. • The approach is based on the idea that each segmentation contains • some useful information about the ideal pixel grouping. • Each segmentation is scored based on its correspondence to • the pixel pairing of all the other segmentations. • The parameter values that produce segmentations with higher • scores are considered better. input seg1 seg2 seg3 seg4
Pixel pairing Progress • A presentation with more detail is available on my website. • Software implementation for testing • Tested for a few images Status • Unsure
Outline • Semester overview • Details • Moving forward
Moving forward • Finish parameter space visualizer • Continue to develop research focus (break & beginning of Spring 2010) • Literature search with focus on segmentation of face images and optimization. • Find areas of potential contribution. • Research (Spring 2010) • Begin to work on contributions • Regular meetings?