Quote:
Originally Posted by AdultKing
Yes, basically what DuckDuckGo does is collects structural information which it uses to order search results, so it grabs information from places like wikipedia, bing, etc and reprocesses them to display results. Duck Duck Go doesn't actually independently crawl the entire web like Bing and Google do. It is dependent on other search engines to do that and store the huge amounts of data. Apparently he uses less than 1TB of disk for the entire platform.
|
Well he is doing a much better job of it then ixquick.com. I suspect its only a matter of time before we see a few more search engines like these two enter the market doing the same thing. I guess you could call them scrappers. In the end, I must admit I like them. And if I had the ability Id be looking to do the same.