| 
		
			
			
				
			
			
				 
			
			
				
			
		 | 
		
			
			
				 
			
				
			
		 | 
	||||
| 
				Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.  You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us.  | 
		
		 
		![]()  | 
	
		
			
  | 	
	
	
		
		|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. | 
| 
		 | 
	Thread Tools | 
| 
			
			 | 
		#1 | 
| 
			
			
			
			 Confirmed User 
			
		
			
			
			Join Date: Dec 2003 
				Location: 1123,6536,5231 
				
				
					Posts: 3,397
				 
				
				
				
				 | 
	
	
	
	
		
			
			 
				
				500 error on robots.txt? not a 404.
			 
			I can access robots.txt fine from my directory. I see it, it's not a 404. However when I access it via a script, I always get a 500 error. What would cause this? 
		
	
		
		
		
		
		
	
	 | 
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 | 
| 
			
			 | 
		#2 | 
| 
			
			
			
			 Pounding Googlebot 
			
		
			
			
			Industry Role:  
				Join Date: Aug 2002 
				Location: Canada 
				
				
					Posts: 34,487
				 
				
				
				
				 | 
	
	
	
	
		
		
		
		 Do you have a trailing / at the end of the request? 
		
	
		
		
		
		
			How are you accessing the robots.txt via script? WG 
				__________________ 
		
		
		
		
	
	I play with Google.  | 
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 | 
| 
			
			 | 
		#3 | 
| 
			
			
			
			 Confirmed User 
			
		
			
			
			Join Date: Dec 2003 
				Location: 1123,6536,5231 
				
				
					Posts: 3,397
				 
				
				
				
				 | 
	
	
	
	
		
		
		
		 submitting a sitemap to a certain you-know-who 
		
	
		
		
		
		
		
	
	NEVER had this issue before with a site, doing it the same way as always. I have about 100 sites above it with no errors, but this one has an error. Says robots.txt couldn't be accessed due to a 500 internal script error. Odd... so odd.  | 
| 
		 | 
	
	
	
		
                 
		
		
		
		
		
		
		
			
			
		
	 |