E-commerce: is that time to invest in visual search?
Why do people shop online? Because it is easier to compare prices online (and so find a good bargain), search for information, convenient and quicker. That’s why search engine and comparators are so popular. Considering that - it is always with surprise that I notice how little e-tailers are investing in search technologies. Try to search for a blue shirt size 15 on a website and it is a safe bet to say that most results won’t meet your expectations. Most e-tailers will blame their search engine for this but it is likely that they do not even have people looking after their search engine on a daily basis. That’s a shame as search is probably the most used feature on a website therefore a good search engine is a quick way to stand out from the crowd! How? The first thing to do is obviously to get the basics right in indexing your attributes and make sure they are normalised, the second thing will be to start playing with the relevancy algorithm and look after your search reports (I won’t detail that here) and the third one will be to innovate. How? Visual search!
What is a visual search? I believe that you can split visual search into three categories: 
What is better then? Well actually I believe the capability to search with visual components as an input has a great future. Why? Because describing something is always an issue. Most of the words are inaccurate and translation is quite difficult - try to explain the difference between purple and lilac for example. So if I can just give a picture of something I like as an input there is a good chance that the results will suit me better (assumption being that the results are relevant). It is easier said than done, but I have noticed a few recent good things. Like.com (http://www.like.com/) have been one the first to offer a visual search feature where you can select a visual detail of a product that you like and try to find matching ones based on colour and/or shape. Etsy (http://www.etsy.com/) have created a really inspirational browsing experience in enabling a search where you can choose a colour through an actual rainbow. A bit sexier than searching with a keyword!
- Searching for an image through keyword - a la Google
- Searching through keyword but displaying the results more visually
- Searching through visual components to find what you are looking for.

What is better then? Well actually I believe the capability to search with visual components as an input has a great future. Why? Because describing something is always an issue. Most of the words are inaccurate and translation is quite difficult - try to explain the difference between purple and lilac for example. So if I can just give a picture of something I like as an input there is a good chance that the results will suit me better (assumption being that the results are relevant). It is easier said than done, but I have noticed a few recent good things. Like.com (http://www.like.com/) have been one the first to offer a visual search feature where you can select a visual detail of a product that you like and try to find matching ones based on colour and/or shape. Etsy (http://www.etsy.com/) have created a really inspirational browsing experience in enabling a search where you can choose a colour through an actual rainbow. A bit sexier than searching with a keyword!




Comments
Visual search sounds great! If there is any way to tieback the benefits of visual search to higher conversion rates and basket size, the payback would be easily justified. With the rich UI we need to recognize the need for high speed broadband connectivity to deliver that experience.
Posted by: ashish jandial | August 20, 2008 01:46 PM
The 'refine by visual detail' on Like.com is a great way of encouraging cross sell especially in apparel. I think this could be further used to refine by pattern or material.
The concept of a visual search is really good, perhaps the next step is taking a capture from a video source and using that to search the web?
Posted by: Jonathan Nobbs | August 21, 2008 01:48 PM
Interesting blog! Do you think this will have an impact on how online retailers merchandise their products?
Posted by: RYAN THOMAS HEWITT | August 22, 2008 09:55 AM
The main business benefits I see for visual search are tied to traffic acquisition and brand perception. Like.com has recently reached the monthly 5 million unique visitors mark so it seems that visual search catches an interest from potential customers.
Searching inside video content is something that we have started to see, but it is still considered a bit futuristic so searching with video inputs is probably far down the line.
Visual merchandising is something that is taking off, I will post something on this shortly.
Posted by: Guillaume Vingtier | August 22, 2008 11:38 AM
I agree that searching within video content is still 'futuristic', but it still has great potential within retail. Imagine if a product demo video is being displayed, the opportunity for cross is immense!
Posted by: Jonathan Nobbs | August 22, 2008 01:55 PM
Great post! The potential of visual search is huge..considering a picture speaks a thousand words :)
Posted by: Sita Bhatt | August 26, 2008 08:53 AM
It is just a matter of time that we see visual search sitting next to the keyword search box. Infact, new version of Internet explorer (IE 8.0, still in beta) allow various visual search providers to be embedded in the browser and there are already beta visual search providers for Amazon and ebay. See
http://www.ieaddons.com/en/searchproviders/
Also, with people like vunow ( http://www.vunow.com ) trying to bring online videos onto TV, the need for visual search will be paramount.
To me,it is a natural evolution. Next thing could be to search, based on other senses i.e. how would it be if i can search something based on touch, smell or hear. We might reach there by 2050 when semantic web takes on the world :-)
However, at this moment, in retail context, i think it will work in cases where there are large assortments to search on. i.e. amazon, ebay etc or a speciality retailer such as IKEA. The last thing you want is to drive away a customer by not showing the merchandise you have. Remember that, searching on color, shape and texture tends to return most relevant and hence less search results!
Posted by: Harish Kashyap | September 2, 2008 11:09 AM