![]() |
![]() |
![]() |
||||
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
![]() ![]() |
|
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
Thread Tools |
![]() |
#1 |
. . .
Industry Role:
Join Date: Apr 2007
Location: NY
Posts: 13,724
|
![]() I guess a proactive approach is best, but I noticed that a couple of my blogs have had the wp-admin login page indexed, as well as the lost password etc from that page
what is the best way to unindex those pages? I am worried that if I do a robots exclusion on those pages that my site will somehow be penalized by google for the broken link doing a 301 is also a problem because I still want to use the wp-admin links myself what is the best way to handle this problem, as the wp-admin login page is ranking higher than some of the other pages in my wp
__________________
__________________ Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs Check out the #1 WordPress SEO Plugin: CyberSEO Suite |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#2 |
Confirmed User
Join Date: May 2003
Posts: 140
|
If you have a webmaster account with Google there is an option inside your account area to have certain url's taken out of the index.
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#3 |
So Fucking Banned
|
Am I the only one who has ever heard of Robots.txt? Google does follow it...
http://www.icwt.us/robots.txt # Stop indexing forbidden directories User-agent: * Disallow: /wp-content/ Disallow: /wp-admin/ Disallow: /wp-includes/ |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#4 |
. . .
Industry Role:
Join Date: Apr 2007
Location: NY
Posts: 13,724
|
what's the link for that? I checked webmaster tools and couldn't find anything there for it
__________________
__________________ Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs Check out the #1 WordPress SEO Plugin: CyberSEO Suite |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#5 |
. . .
Industry Role:
Join Date: Apr 2007
Location: NY
Posts: 13,724
|
I mention in my post the reason why robots.txt might not be the way to go in this situation... re-read the original post
__________________
__________________ Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs Check out the #1 WordPress SEO Plugin: CyberSEO Suite |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#6 | |
So Fucking Banned
|
Quote:
<META HTTP-EQUIV="CACHE-CONTROL" CONTENT="NO-CACHE"> <META HTTP-EQUIV="PRAGMA" CONTENT="NO-CACHE"> <META NAME="ROBOTS" CONTENT="NONE"> The following seems to be a bastardized hack: <META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW"> And there is also: <META NAME="GOOGLEBOT" CONTENT="NOARCHIVE"> |
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#7 |
. . .
Industry Role:
Join Date: Apr 2007
Location: NY
Posts: 13,724
|
thanks
reading your file, what is your reasoning for excluding rinkworks and whois.sc? also archive.org?
__________________
__________________ Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs Check out the #1 WordPress SEO Plugin: CyberSEO Suite |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#8 |
Damn Right I Kiss Ass!
Industry Role:
Join Date: Dec 2003
Location: Cowtown, USA
Posts: 32,409
|
Penalized for having broken links... haha...
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#9 |
. . .
Industry Role:
Join Date: Apr 2007
Location: NY
Posts: 13,724
|
I guess I thought wrongly that google only would spider files that are linked from your index.html or index.php .....
so is it safe to say then that google may all of the sudden decide to spider and index any file or folder that is found in your root directory?
__________________
__________________ Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs Check out the #1 WordPress SEO Plugin: CyberSEO Suite |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#10 |
So Fucking Banned
|
For all three, I dislike sites that take my content and use it in any way without asking first. Whois.sc has some digging features I don't want people using. Archive.org, I never gave them permission to rip off copies of my sites including graphics and all.
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#11 |
Confirmed User
Join Date: Aug 2003
Location: Hoy Suecia, mañana Nirvana
Posts: 1,594
|
jetjet:
No, in that regard you're not thinking very wrong... All files in your directories that are NOT *linked to*, from *anywhere*, can *never* get indexed - those are invisible to spiders. And BTW, it doesn't matter *where* from a file is linked to - if there's a link on a forum to some textfile on your server... that'll get it indexed too. (As long as the origin is/gets indexed in the search engine.)
__________________
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#12 |
Masterbaiter
Industry Role:
Join Date: Feb 2006
Posts: 26,229
|
remove the link to your login page.
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#13 |
Too lazy to set a koala
Industry Role:
Join Date: Jan 2007
Location: CZ/EU forever!
Posts: 16,139
|
just rename on your pages "/wp-admin/" to something like "/my_adm1n-5634Z8/" or anything what is not so normal and you have no more problems with indexed wp-admin link ;)
__________________
|
![]() |
![]() ![]() ![]() ![]() ![]() |