|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
05-21-2007, 01:00 AM
|
#1 |
|
Confirmed User
Join Date: Apr 2007
Posts: 1,292
|
Robots.txt SE Question
Hey, we're using directories to list our sample images for each site we list, usually around 8 sample images per site, but some upwards of 16.
http://www.pornsumer.com/sites/8th-s...pics/picture4/ That's an example. So we have like picture1, 2, 3, to 8 usually per site. We expect to list thousands of sites using this system. Is this too many URL's for google? My feeling is that we should add them to the robots.txt, but I'm not sure the syntax we'd use considering the dynamic directory structure. Perhaps we should leave them out of the robots for some other reason? We could still leave this page in. This is an extreme example with 19 pics = 19 directories. http://www.pornsumer.com/sites/8th-s...nas/free-pics/ Thoughts? Comments? Syntax?  |
|
|
|
05-21-2007, 01:21 AM
|
#2 |
|
Confirmed User
Industry Role:
Join Date: Jun 2002
Location: cloud number 9
Posts: 4,396
|
some tips: add some text.. you won't get good ranks only with pics.
you should add them to the sitemap, not to robots.txt the site needs some serious work done... hit me on icq if interrested
__________________
SEO Mogul | ICQ: 163671223 |
|
|
|
