Robots.txt Help

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • OzMan84
    Confirmed User
    • Nov 2003
    • 4740

    #1

    Robots.txt Help

    Hi,

    Not sure if ive set this up incorrect but there are still pages getting indexed
    User-Agent: *
    Disallow: /*page/

    User-agent: *
    Disallow: /*?
    domain.com/455/report.php?id=455
    domain.com/316/page/popular_likes/0-20/

    are two examples of the type pages that are getting indexed

    any tips/suggestions would be great
    XferClick - 300,000 UV daily and growing quickly. Majority US, EU, CA and AU traffic. Contact me for more information
    ICQ: 304568058
  • Inter-Sex
    Confirmed User
    • Nov 2005
    • 2231

    #2
    It seems due to your .htaccess your post is indexed in the wrong forum.
    Or you'd planning to sell your .htaccess ?

    Bump 4 U

    Comment

    Working...