Microsoft has just released a new search engine entitled Bing (but it’s not Google). The philosophy behind it is something that Bill Gates has talked about for a long time. Today, Search returns a lot of results (regardless of whether it’s Google, Yahoo or Live). However, it’s too much information. There are too many results to go through and it can be frustrating to find what you want. Sometimes the first returned result is what you want, but many times it isn’t and you have to hunt through pages of irrelevant links. Think back to how many times you’ve searched for something and the first result is a dead link.
The idea behind Bing is that it sifts through the irrelevancy to bring you stuff you actually want to see. It is designed to improve the user experience such that when you search for something, the results you get back are actually the results that have meaning to you. Less search with Search. The overall philosophy is sound.
Spam processing is similar. There is a lot of noise when looking for the signal. It is difficult to separate random spams and messages that aren’t spam when attempting to find the stuff you actually want to find.
How do we Bing spam data?