GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   disallowing a dynamic page with robots.txt? (https://gfy.com/showthread.php?t=985551)

roly 09-05-2010 01:47 PM

disallowing a dynamic page with robots.txt?
 
hi

i want to disallow a dynamic page from SE robots with robots text. if i have pages like:

domain.com/page.php?pn=1

will putting:

disallow: /page.php

be enough or do i have to put a wildcard on the end, and if so how?

any advice appreciated.

thanks

pocketkangaroo 09-05-2010 01:52 PM

It should work. Can you put a meta robots on the page too with noindex, nofollow?

You can also sign up for Google webmaster tools and set parameters that you don't want indexed. So pn would be one of them.

roly 09-05-2010 03:18 PM

Quote:

Originally Posted by pocketkangaroo (Post 17470933)
It should work. Can you put a meta robots on the page too with noindex, nofollow?

You can also sign up for Google webmaster tools and set parameters that you don't want indexed. So pn would be one of them.

thanks, yeah i didn't think about noindex, nofollow i'll use that.

thanks again


All times are GMT -7. The time now is 05:25 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123