Microsoft Research's Photo2Search: Finally a Good Use for a Phone Camera?

[Jason Dunn]

<div class='os_post_top_link'><a href='http://research.microsoft.com/displayArticle.aspx?id=1434' target='_blank'>http://research.microsoft.com/displ...le.aspx?id=1434</a><br /><br /></div><i>"There’s a new restaurant in town. Wonder what people are saying about it? Take a photo...Photo2Search works like this: Seeking information about something seen, a user takes a photo of the object and sends the photo, via e-mail or Multimedia Messaging Service, to a Web-based server, which searches an image database for matches. The server then delivers database information—whether it be a Web page featuring the object in the photo or information associated with the object—to the user, who can act on the information received: read a menu, enter a gallery, book a hotel room, make a purchase. Sounds simple, right? The devil, as always, is in the details."</i><br /><br />This is one of those examples of research that will likely take years to come into the mainstream, but holds fascinating possibilities for gaining useful data from the combination of a portable device and a camera. When I'm out shopping for something I'm often wishing I had more data about a product. Imagine something such as this linking into a product review service so you could easily read a review about the product you're about to buy. That would be excellent!

[Edgar_]

With the cam on this MPX220 I could take a picture of the Statue of Liberty and it would probably return a match to a porta-potty company. :? I'd think a match being made when I take the picture at a different angle would also be difficult - afterall I suspect this is done the same way they do facial structure matches by points of intersection in the picture.

Unlike "24" and "Las Vegas" where they take a picture and magically match it within seconds, this would be very difficult to do with the resolution on today's devices. Albeit, I still want Jack Bauer's phone &amp; carrier- never runs out of battery power and, always has an awesome data and voice connection, even 3 stories underground or in a sewer. Not to mention that guy's PDA must be XGA minimally! Darn spy equipment is so cool.

I would much rather have access to a UPC matching database, or some other use for the camera like that. Of course, that wouldn't do much good for a hotel or restaurant unless we start painting UPC's on the side of buildings.

[wirelessbeachbum]

“We hope, in the future, when a user submits a photo to, for example, MSN Spaces®, we can quickly figure out the latitude and the longitude of that photo by using our technology.”

The CIA's going to love that feature.

I'm sure in the future this may evolve and be usable, currently I think for shopping purposes, bar code's are pretty effective, and with T9 text entry and services such as Google mobile, I'm not sold on the fact a picture would be the best solution for a search for local information. Of course it would also be easier to implement voice to text than picture to search functionality.

[Sven Johannsen]

currently I think for shopping purposes, bar code's are pretty effective.
I was thinking the same thing. Much easier to process too. I actually have an SD Bar Code reader and it works pretty well. Any one know of a site you can send a UPC code to and it will return useful information?

[Edgar_]

Sven

THIS (http://www.upcdatabase.com/) is the only place I know. Its not as populated as I would like. There has to be a database somewhere that tracks to make sure there is not dupliactes. I figure the first five or so digits must be the manufacturer/distributor cose then the item number?

Cool, just found the HOWITWORKS article on UPC at http://www.howstuffworks.com/upc.htm

-Edgar
[/url]