1 / 39

Comp 775: Graph Cuts and Continuous Maximal Flows

Comp 775: Graph Cuts and Continuous Maximal Flows. Marc Niethammer, Stephen Pizer Department of Computer Science University of North Carolina, Chapel Hill. Representations. Graph Cuts and Continuous Maximal Flows. Background.

peony
Download Presentation

Comp 775: Graph Cuts and Continuous Maximal Flows

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Comp 775: Graph Cuts and Continuous Maximal Flows Marc Niethammer, Stephen Pizer Department of Computer Science University of North Carolina, Chapel Hill

  2. Representations Graph Cuts and Continuous Maximal Flows Background Classifying individual pixels versus finding an optimal separating curve/surface between object and background.

  3. From curve evolution to pixel/voxel labeling Graph Cuts and Continuous Maximal Flows Background Example: Chan-Vese model Indicator function Relaxed indicator function Putting it all together:

  4. Convex vs. Non-Convex Graph Cuts and Continuous Maximal Flows Background Prone to locally optimal solutions. Non-convex Initial contour Final contour Convex Independent of initial condition, optimal solution is guaranteed. Convex Final contour Initial contour Images: Bresson et al.

  5. From Curve Evolution to Pixel/Voxel Labeling Graph Cuts and Continuous Maximal Flows Background non-convex convex Convex, continuous, constrained optimization problems. ... can also include region-based terms, appearance information, orientation-dependency Advantages: - Convex -> Globally optimal - No metrication artifacts - Straightforward parallel implementations

  6. Continuous Maximal Flow [Appleton] Graph Cuts and Continuous Maximal Flows Continuous Maximal Flow Continuous version of maximal flow [Appleton]. Results in a PDE and can be solved as such. Energy to be minimized: More general form (can easily include local classifiers):

  7. Segmentation with Continuous Max-Flow Graph Cuts and Continuous Maximal Flows Continuous Maximal Flow Thresholding Continuous max-flow with seeds. Images: Unger

  8. Continuous Maximal Flow Graph Cuts and Continuous Maximal Flows Continuous Maximal Flow Energy to be minimized: Introduce the auxiliary variable p, which we maximize for: Now solve this by gradient descent.

  9. Continuous Maximal Flow Graph Cuts and Continuous Maximal Flows Continuous Maximal Flow The variation is The gradient descent scheme becomes

  10. Chan-Vese (=Otsu-Thresholding w/ spatial regularity) Graph Cuts and Continuous Maximal Flows Continuous Max-Flow Iterative solution method is related to solving a wave equation.

  11. Ex.: Segmentation with Continuous Max-Flow Graph Cuts and Continuous Maximal Flows Continuous Max-Flow

  12. 3D Example Graph Cuts and Continuous Maximal Flows Continuous Max-Flow

  13. Segmentation by Graph-Cut Graph Cuts and Continuous Maximal Flows Graph-Cut Alternative approach through graph construction (vs. PDE) Example: Binary Segmentation Need to partition the picture into foreground and background. Images from ECCV Tutorial, Kumar/Kohli

  14. Segmentation by Graph-Cut Graph Cuts and Continuous Maximal Flows Graph-Cut Graph G=(V,E)‏ Approach: Interpret the image as a graph, where pixels are connected to its neighbors. Goal: Cut the graph into pieces to obtain the desired image partition. Assign a label to every pixel. Images from ECCV Tutorial, Kumar/Kohli

  15. Segmentation by Graph-Cut Graph Cuts and Continuous Maximal Flows Graph-Cut Optimization Problem: Minimize Looking at it on a pixel-by-pixel basis (where f is the labeling): Problem: We cannot try all possible pairings for the labels f. Need an efficient algorithm to solve this problem.

  16. Maximum Flow and Minimum Cut Graph Cuts and Continuous Maximal Flows Graph-Cut Solution: 1) Transform problem to maximizing nework flow 2) Use algorithms for network flows on images. Preview: Graph structure for binary labeling Images: Boykov Pixels are connected to neighbors (pairwise interaction cost) and to source and target vertices (data cost). Cut separating source (s) from sink (t) gives the segmentation.

  17. Max-Flow/Min-Cut Theorem Graph Cuts and Continuous Maximal Flows Graph-Cut For any network having a single origin and a single destination node, the maximum possible flow from origin to destination equals the minimum cut value for all the cuts in the network.

  18. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut Pixel weights: s to node flow: high if near source (bkg) class, low if not Pixel weights: Node to t flow: high if near target class, low if not Node to neighbor flow: high in both directions if near intensities

  19. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut One way to compute maximal flow: 1) Pick any viable path (no zero flow) 2) Subtract minimum flow from each segment on path 3) Add minimum flow on reverse path

  20. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut 1) Pick path (no zero flow)

  21. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut 2) Subtract minimum flow from each segment on path 3) Add minimum flow on reverse path

  22. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut

  23. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut 1) Pick path (no zero flow)

  24. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut 2) Subtract minimum flow from each segment on path 3) Add minimum flow on reverse path

  25. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut

  26. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut 1) Pick path (no zero flow)

  27. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut 2) Subtract minimum flow from each segment on path 3) Add minimum flow on reverse path

  28. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut

  29. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut 1) Pick path (no zero flow)

  30. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut 2) Subtract minimum flow from each segment on path 3) Add minimum flow on reverse path

  31. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut

  32. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut - Cut at zeros. - Cost of min-cut is 4. - Divides the nodes (pixels) into two groups. - Sum of original values of zeros equals the maximum flow.

  33. Example: Ford & Fulkerson Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut Look at the difference between initial and final capacities. Ignore negative capacities. This is where everything flows. Flow is conserved at nodes.

  34. Why update the backward flow? Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut Image: John Chinneck Can undo flows. Final flow does not include the central edge.

  35. Image Segmentation Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut Original Noisy Reconstructed Image: Boykov Allows (amongst many things) to compute binary segmentations.

  36. Multi-Label Case Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut Image: Boykov

  37. Multi-Label Case Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut Image: Boykov

  38. Influence of Neighborhood Choice Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut Minimum cost cut (standard 4-neighborhoods)‏ Minimum length geodesic contour (image-based Riemannian metric)‏ Images: Boykov Can choose different weighted neighborhood to reduce metrication errors. (Or use continuous maximal flow.)

  39. Interactive Segmentations Graph Cuts and Continuous Maximal Flows Segmentation by Graph Cut Images: Boykov

More Related