Quote:
Originally Posted by tonyparra
the meltdown would be on my end  i been toying with this idea for awhile nice job not exactly what im doing but close... we also bought the same premium theme, nice work though not easy task to start or maintain.... |
The rss feeds is just to fill out the search engine landing page to give people other quick, easy clickable links. The actual search engine is the point of the whole thing.
Running a real search engine and crawler is a *very* difficult undertaking, requiring lots of CPU, Disk, Database Servers and a multitude of scripts. Making one which mainly indexes porn sites is very much harder. We are having a go at it, with some success, we ran the early versions of the crawler and indexer on pornobug.com with nothing on it but a search form and didn't publicize it. Even these betas are not the final product but the database being built by these beta sites will form the database used in the final site.
I might add that slight weighting is given to sites which have been in the search engine by length of time, there are numerous weighting factors but site age according to the index is one of them, so adding urls now is very slightly advantageous.