Is there another site like this on the internet? I am getting errors with these guys.
waybackmachine.org/archive.org
Collapse
X
-
Tags: None
-
-
LinkSpun - Premier Adult Link Trading Community - ICQ - 464/\281/\250
Be Seen By New Webmasters/Affiliates * Target out webmasters/affiliates based on niches your sites are for less than $20 a month.
AmeriNOC - Proudly hosted @ AmeriNOC!Comment
-
this doesn't answer your question, but I thought it would be a good tip to post for people that don't want any of their sites on archive.org, it's an easy fix to just throw in all of your robots.txt files and they will remove all of your sites off of there
To remove your site from the Wayback Machine, place a robots.txt file at the top level of your site (e.g. www. yourdomain.com/robots.txt) and then submit your site below.
The robots.txt file will do two things:
It will remove all documents from your domain from the Wayback Machine.
It will tell us not to crawl your site in the future.
To exclude the Internet Archive?s crawler (and remove documents from the Wayback Machine) while allowing all other robots to crawl your site, your robots.txt file should say:
User-agent: ia_archiver
Disallow: /Last edited by d-null; 04-26-2010, 04:49 PM.
__________________
Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs
Check out the #1 WordPress SEO Plugin: CyberSEO SuiteComment
-
-
-
yes thats it, complete internet archiveComment



Comment