Thread: Can someone explain this robots.txt for me
View Single Post
Old 09-02-2004, 05:03 AM  
Project-Shadow
Confirmed User
 
Industry Role:
Join Date: Feb 2003
Posts: 7,340
ia_archiver = www.archive.org
Basically means it'll delete/block any archiving of the site.
Project-Shadow is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote