October 15, 2009

Amazing Photosketch converts free hand sketches into realistic pictures

This is possibly one of the coolest thing I have ever seen



Photosketch is, a soon to be made available, web based application that can take a simple stick-figure like rough sketches with annotations, search the web for matching photos and then automagically combines them together into a single “Photoshopped” image.


Watch the video demonstrating the jaw-dropping technology.


We present a system that composes a realistic picture from a simple freehand sketch annotated with text labels. The composed picture is generated by seamlessly stitching several photographs in agreement with the sketch and text labels; these are found by searching the Internet. Although online image search generates many inappropriate results, our system is able to automatically select suitable photographs to generate a high quality composition, using a filtering scheme to exclude undesirable images. We also provide a novel image blending algorithm to allow seamless image composition. Each blending result is given a numeric score, allowing us to find an optimal combination of discovered images. Experimental results show the method is very successful; we also evaluate our system using the results from two user studies.





No comments: