GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   robots.txt question (https://gfy.com/showthread.php?t=697540)

Cyrano 01-19-2007 11:56 PM

robots.txt question
 
Is it possible to use robots.txt to prevent search engines from indexing certain areas of text on specific pages? If not, is there another method of accomplishing this?

baddog 01-20-2007 12:01 AM

Quote:

Originally Posted by Cyrano (Post 11759101)
Is it possible to use robots.txt to prevent search engines from indexing certain areas of text on specific pages? If not, is there another method of accomplishing this?

You can use it to keep spiders from certain pages, but I am not sure how I would hide just certain text . . . . unless you put it in a .gif or something

Elixir 01-20-2007 02:39 AM

User-agent: *
Disallow: /images/

you can use this.

bigalownz 01-20-2007 02:49 AM

but robots.txt dont work with some bots and spiders

darksoul 01-20-2007 03:23 AM

use iframes for that text and deny access to the page


All times are GMT -7. The time now is 09:35 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123