1 / 21

Mean-Field Theory and Its Applications In Computer Vision4

Mean-Field Theory and Its Applications In Computer Vision4. Motivation. Helps in incorporating region/segment consistency in the model. Pairwise CRF. Higher order CRF. Motivation. Higher order terms can help in incorporating detectors into our model. Without detector. With detector. Image.

lareina-giles
Download Presentation

Mean-Field Theory and Its Applications In Computer Vision4

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Mean-Field Theory and Its Applications In Computer Vision4

  2. Motivation Helps in incorporating region/segment consistency in the model Pairwise CRF Higher order CRF

  3. Motivation Higher order terms can help in incorporating detectors into our model Without detector With detector Image

  4. Marginal update General form of meanfield update Expectation of the cost given variable vi takes a label

  5. Marginal Update General form of meanfield update Expectation of the clique given variable vi takes a label • Summation over the possible states of the clique

  6. Marginal Update in Meanfield Some possible states labels Total number of possible states: 36

  7. Marginal Update in Meanfield Exponential # of possible states for clique of size |c| and labels L: |L|C Expectation evaluation (summation) becomes infeasible

  8. Marginal Update in Meanfield • Use restricted form of cost • Pattern based potential

  9. Marginal Update in Meanfield Restrict the number of states to certain number of patterns Simple patterns Segment takes a label from label set of 4 patterns Or none

  10. Marginal Update in Meanfield Expectation calculation is quite efficient

  11. Pattern based cost Segment takes one of the forms

  12. Pattern based cost Segment does not take one of the forms

  13. Pattern based cost • Simple patterns Simple patterns • Pattern based higher order terms

  14. PN Potts based patterns • PN Potts based patterns Potts patterns

  15. Potts cost • Potts cost Potts patterns

  16. Marginal Update in Meanfield General form of meanfield update Expectation of the cost given variable vi takes a label

  17. Expectation update Probability of segment taking that label Potts patterns

  18. Expectation update Probability of segment not taking that label Potts patterns

  19. Expectation update Expectation update Potts patterns

  20. Complexity • Expectation Updation: • Time complexity • O(NL) • Preserves the complexity of original filter based method

  21. PascalVOC-10 dataset • Inclusion of PN potts term: • Slight improvement in I/U score compared to more complex model which includes Pn Potts + cooccurrence terms • Almost 8-9 times faster than the alpha-expansion based method

More Related