New Porn Search Engines
 

We have launched an early beta of two porn only search engines. These are real search engines, with a robot which is constantly crawling the web. The search component uses several algorithms to determine ranking and allows you to view all results from one site.

Anyone is free to add their site by going to the bottom of the main page and entering their url. Please be patient and don't close the page until the spider has successfully added your site. The first crawl is almost instant , however a complete index of your site may take a while depending on it's size and other factors. There is no guarantee your site will make it into the index, we have anti spam measures in place and unless the site meets certain criteria it will not end up in the index.

We will soon also release an API which will let you place a search form on your site and automatically embed your affiliate codes when people perform a search from your site. This will be announced when it is ready.

Feel free to have a play with them and add your own sites.

www.PornoBug.com

www.PornSpider.net

If you find a bug please let me know.:thumbsup

kool adding mine now :)

same here :thumbsup

what does this output mean?

Working…..
Please wait, do not refresh this page.

You entered camgirlshide.com to be crawled by Porno Bug

We have validated the domain and will now crawl the domain.

It may take some time before every page on your
site is indexed.

Results of our web crawler are output below:
{01} URL: http://camgirlshide.com
{01} Deleting http://camgirlshide.com
{01} Done (2 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec.)
{00} Total 13 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec, 0.00 sec/doc, 0 bytes/doc.
{00} Neo PopRank: 0 documents, 0 pas, 0.00 Kpas/sec, 0.00 sec/doc, 0.00 pas/doc.
{00} Mon 21 04:12:13 [3656] Flushing all buffers…

It means that the url has gone in a queue to be indexed but no pages were indexed immediately. Every two hours sites which weren't indexed immediately are run through the spiders queue.

Bookmarked it.

looks great.
best of luck with it

same here...

Might be an error here..

Results of our web crawler are output below:
{01} URL: http://hornyjoe.com
{01} Deleting http://hornyjoe.com
{01} Can?t open/create file /home/ps/search/var/url/info0005.i for write [base.c:96] ? 13 (Permission denied)
{01} Done (1 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec.)
{00} Total 19 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec, 0.00 sec/doc, 0 bytes/doc.
{00} Neo PopRank: 0 documents, 0 pas, 0.00 Kpas/sec, 0.00 sec/doc, 0.00 pas/doc.

Added to ban list :)

Great news!
But same error for my sites..

added :thumbsup

Good news :)

Results of our web crawler are output below:
{01} URL: http://
{01} Deleting http://
{01} Can’t open/create file /home/pornobug/search/var/url/info0005.i for write [base.c:96] — 13 (Permission denied)
{01} Done (1 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec.)
{00} Total 9 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec, 0.00 sec/doc, 0 bytes/doc.
{00} Neo PopRank: 0 documents, 0 pas, 0.00 Kpas/sec, 0.00 sec/doc, 0.00 pas/doc.

Is everything okay ??? Will my site get indexed

not really working when i try to add ..

its a bug it will be fixed talked to him this morning :)

Working good here added another bigger site still working will et u know :)

ok worked fine :thumbsup

As people have noted there is a bug with the site submission component. The problem is due to the way the site is locked down for security, we are working on a fix now. Please remember this is a beta still.

lol this looks very familiar i feel a pornstarglobal style meltdown coming....btw hows that wordpress seach engine working for you lol

We believe we have solved the bug with adding sites.

Please feel free to add your sites now and please reply back to the thread if there are any more bugs encountered.

Do not expect your entire site to appear in the search results immediately, the web crawler uses a number of complex algorithms to determine how it crawls

To see if the crawler has been to your site look for these user agents in your web server logs

"User-Agent: Mozilla/5.0 (compatible; PornoBug/1.2; +http://www.pornobug.com)"

or

"User-Agent: Mozilla/5.0 (compatible; PornSpider/1.0; +http://www.pornspider.net)"

Once your site is crawled it takes around 5 hours for results to start appearing in the index.

As with any real search platform, the databases are huge as is the traffic, we also try to limit our crawler from overloading your site.

Please let me know if you have any questions.

You have only been looking at the front end, obviously you don't understand what is behind it.

The search engine is not Wordpress. The container for the front end is wordpress based as it gives us a level of control over the rss feeds also displayed on the site. It also allows us to quickly change the layout as required. The search form is embedded into the front page however the search forms you see on result pages are generated by the search daemons which were written in C and access the database cluster.

The search engine's web crawler is written in C and runs multithreaded sharing load between databases and also load limiting CPU and disk resources. There are also caching daemons, crossword daemons and link popularity daemons all written in C which work on the databases to keep search results accurate.

Then there is a separate ranking engine, which ranks results which is java based.

If you think a meltdown is coming, then sorry you're going to be sorely disappointed. These beta sites are separate to test two versions of our crawler and search result engine so we can improve them for use on another site when we merge the databases.

Every site added to either of the two search engines www.pornobug.com or www.pornspider.net will be in the final search engine product, so feel free to add your sites.

you snooze you lose.

yeah thats how it works...

the meltdown would be on my end :) i been toying with this idea for awhile nice job not exactly what im doing but close... we also bought the same premium theme, nice work though not easy task to start or maintain....

post your site tony. let gfy decide.

no way jose...but im sure you could find it ...nothing gets past the Agent 488!

The rss feeds is just to fill out the search engine landing page to give people other quick, easy clickable links. The actual search engine is the point of the whole thing.

Running a real search engine and crawler is a *very* difficult undertaking, requiring lots of CPU, Disk, Database Servers and a multitude of scripts. Making one which mainly indexes porn sites is very much harder. We are having a go at it, with some success, we ran the early versions of the crawler and indexer on pornobug.com with nothing on it but a search form and didn't publicize it. Even these betas are not the final product but the database being built by these beta sites will form the database used in the final site.

I might add that slight weighting is given to sites which have been in the search engine by length of time, there are numerous weighting factors but site age according to the index is one of them, so adding urls now is very slightly advantageous.

weird blank blank is the name :) i remember it.

playa hata! :)

I wonder if people could give me some feed back.

www.pornobug.com has rather plain search result pages

however

www.pornspider.net has image previews of sites

which do you prefer ?

thanks in advance and don't forget to add your sites.

Tried both of them about 6-8 times today and NOTHING happens ... sez

Waiting for http://pornbug.com/addsite/

then NOTHING

added a few of our sites... lets see what happens

added on my favs... when my site be ready ;)

It can take a while for add site to come back with a response, it does work but sometimes it can take a while. We are still in beta and trying to speed up the submission process, however the number of checks that are done before a site is crawled for the first time do slow down the realtime process.

Your site is crawled immediately, the spider visits the page you submit and runs some tests to see if it is an eligible porn site.

The site then goes into the indexing queue and it can take anywehre from 1 day to a month to be fully indexed. We deal with massive numbers of urls that are spidered and then they need to be indexed and ranked. This process takes time.

You also have ads of yours on rotation, because we became an affiliate a couple of days ago.

I think you may have PornstarGlobal.com confused with another site. We have never experienced a 'meltdown', only investment protection. I agree though, please post a link so we can judge.

Are the databases shared? If I add a site to one should I add to the other?

fail....

sorry i dont have a website ....i was just thinking of doing something

i'm sure i even have link trades with it.

no comment. i dont have any links. :)

The databases will be merged later this year when the full scale site is launched, the databases do exchange crawl data though, it just means you will be indexed quicker in the one you add your site to. You can add to both and it won't matter.

If that is directed at us, I'd like to know whether you have the money and resources to start building a full scale search engine. I'm not talking about some fake search engine either, I'm talking about a complete platform for crawling, indexing, database management, massive disk arrays, ranking systems and all that goes along with that.

We're having a go, finding good adult sites on Google is like going to spam city, we're trying to develop an alternative, 0.1% of Google's adult search traffic would make us happy.

I find both sites extremely slow and the colors, well im sorry, not a fan.

Hey

Documents shown 1-10 of 1238 found.
Search time: 4.688 sec.

What happened when you'll have 100M documents?

ps. Google have about 767,000,000 results (0.09 seconds) for "porn"

Interesting links man!! adding my websites.. ;)

It will be good if you can work on its speed.. and little bit of design.. thanks

This is a *beta* which is being built into a much larger system, which will be fully supported by a large number of servers. You can't expect us to have google like search speed when we are running on only 4 servers.

Looking at the average search result stats it appears that "Average Search time: 0.263 sec." If we are running rebuilds to fine tune the database server then it can take longer.

The main thing is we are building the database, as spam free as possible. Again on search speed, I just did a few complex searches and all came under 1 second.

The reason we released the two sites as betas is to get feedback. So I am happy to hear suggestions.

There will be an end user benefit to webmasters when we release the API as you will be able to dynamically insert your own affiliate codes into links out if you put a search form on your site.

I admit speed is variable, that is mainly because we are doing some heavy duty database back end work as we respond to issues we are finding now it's being more widely searched.

The eventual site which will merge from both of these beta sites will be on a cluster of machines engineered for speed of queries.