130 likes | 265 Views
Let Computer Draw. Qingyuan Kong. Goal. Give me a picture “Obama stands in front of a pyramid”. Goal. Here you are!. Analogy. knowledge. Database/internet. What does obama look like?. Search obama. Search pyramid. What does pyramid look like?. Approach. A pproach.
E N D
Let Computer Draw Qingyuan Kong
Goal • Give me a picture “Obama stands in front of a pyramid”
Goal Here you are!
Analogy knowledge Database/internet What does obama look like? Search obama Search pyramid What does pyramid look like?
Approach • let computer learn to extract “Obama” out • Training an extractor with Labelme • Use segmentation algorithm just on the obtained data set Reference: [1] Tomasz Malisiewicz and Alexei A. Efros. Improving spatial support for ob jects via multiple segmentations. BMVC, 2007. [2] Bryan C. Russell, Alexei A. Efros, Josef Sivic, William T. Freeman, and Andrew Zis- serman. Using multiple segmentations to discover ob jects and their extent in image collections. CVPR, 2006.
Approach • Find the best background to place “obama”
Approach • Find the best position to place “Obama” • Compare the marginal pixels with the background • Adjust Reference: • James Hays and Alexei A. Efros. Scene completion using millions of photographs. SIGGRAPH, 2007. • Ce Liu, Jenny Yuen, Antonio Torralba, Josef Sivic, and William T. Freeman. Sift flow: dense correspondence across difference scenes. ECCV, 2004.
Data sets • Labelme • google image • bing image
Evaluation of Success • make the computer put some classes of objects, such like people, cars, into a background, the compound of which looks real and with few artifacts.
milestone • make the computer be able to draw at least one class of objects in at least one class of background.