Any google masters here?
 

Google dropped hundreds of relevant pages to wickedpictures.com. It was bio pages on girls who were in wicked movies. Anyone know what the F@CK is going on with google?

If you go to http://www.wickedpictures.com you will see all the bio pages linked there.

Your suggestions are greatly appreciated.

Ez

I wouldnt call myself a master... (ok yes I would)


But yea I still see some there

http://www.google.com/search?sourcei...pictures%2Ecom

Can you find them there? or are the GONE alltogether out of the index?

I noticed tons of relevant pages on one of my sites dropping from #1 #2 spots to like 400-500 last week... I'm not sure whats up...


I think google has really been dropping the ball lately. In many ways.

Seems to be you don't want any pages listed in Google. At least that's what your robots.txt file indicates:

http://www.wickedpictures.com/robots.txt
user-agent: *
disallow: /

This says, no search engines should ever spider anything on your site.

WG

:1orglaugh :1orglaugh Thats hysterical....

Sence the pages are listed I never even thought to check the robots.txt

Would that robots file casue the pages google already have drop in rank???? (don't know becasue I've never disalowed the googlebot)


I wouldnt think so.

hey - jc - do you answer your icq's ?

Nah dude.. I'm taking friday OFF... not signing on to ICQ today, but I will respond to it tomrrow. :)

The PR would probably be unaffected but if the pages are dropped from Google then I would say their rank has diminished to nothing. Seems weird that someone would not want Google traffic but this is exactly what Wicked Pictures has done, disallowed all search engines from listing their pages.

WG

:1orglaugh

I do NOT claim to be a google master at all.

There are some obvious events that help explain what's going on I think. That is google has added 1 billion pages to their index. They are known to operate on thousands of small Linux boxes.

To index and rank that many pages takes some serious infrastructure! I have some sites and optimize to specific keywords. I am also a user of the SE. So I've been watching google results daily for a long while. I?ve owned a keyword or two, only to see it drop off the ranking. Anything over 100 for sure doesn?t count to me. Actually off the first couple pages and result drop way off.

Another interesting point worth mention is that, I changed the title of one of my sites a month ago. Some keywords show the new title. The cash words didn?t catch up and stick to the new title and description until a couple of days ago. Fortunately for me, I?m not seeing the big swings in placement on the cash words that were occurring two weeks ago. On the non-cash words, I still see major movement daily. By cash words I mean those that generate 100K searches a day+.

Speculation on my part is that google bit off a lot to chew and the infrastructure can index only so fast. They may be experimenting with different algos. Ideas that come to mind include different results for a search depending on where you are. Search for pussy in the US and find pussyluvers.com. Search in France and find the city Pussy in addition to other sites.

What about different results on time of day. During school hour?s local time, you search on pussy and find cat sites. Search at 9:00 pm and find pussyluvers.com. Maybe even pussy.org.. I don?t think google has reached this level of sophistication yet, but maybe they are thinking about it this and another things. So trying different alogos to see what happens.

Maybe the concept of the dance has given way to a constant indexing of all sites ? naw. One thing is clear and that is they are more secretive and trying to find ways to beat the black hats. It is clear that black hat still works however. There are just a couple of examples where I?ve seen a major player drop to PR0 with no back links ? a google drop or ban.

Google has many key servers that I?ve watched, trying to see if they provided clues to a method. In other words a forecast of what is to come. They closed those down to public access, but ya can still get to them by IP. Well at least a few days ago.

If you look at results, the obvious things that count big time are amount of content and links to your site. Still there are exceptions that boggle my mind anyway. Like a do nothing site with no PR power and no back links showing hitting the top ten on a cash word. These only seem to stick for a few days. I look at it as google shaking the bugs out of the new algo.

Enough rambling.

I wouldn't fuck with a robots.txt file at all! Tried that once and lost big time. While it looks simple to do, one screw up and you are screwed.

I did what I thought was a correct robots.txt file and lost a PR point. they are now harder to get back.

My suggestion is index all. wanna hide something, password protect it or do it in .htaccess.

Robots files are not hard to do correctly, And i can gurentee you your robots file did not make you lose a PR point... PR is calculated from scratch every time... Its not like a scoreboard of points that you keep or lose. Theres many good articles out there on PR and robots files... just take the time to look for them. PR is mosly a products of WHO links to the site.... You could deny all spiders from your site and still have a high PR if many relavant High PR sites link to you.

anyone have a good robots txt file handy?
what would be the correct text?

the one i have is

# /robots.txt for http://www.domain.com/
# comments to [email protected]/

User-agent: *
Disallow:
Allow: *

Thanks for the input people... I will have to figure out why we have the robots.txt file that says disallow: / must be some gremlins in the server.

Ez

I found out why our robot file was setup like that. It should never have been setup like that. They didn?t want a certain directory picked up so they put that file in there without specifying the directory :(

Ez

Lesson learnt... hope you can get your rankings back, might take a few weeks before google looks back at your site because of that robots.txt definition.

WG

What I did with the robots.txt file JC was to cause the bot to skip over some files. PR is based on the amount of content IN PART I THINK and who links to you as you point out. By taking content away that the SE MAY be using to determine PR in part, I may have hurt myself? More import than PR is keywrod placement. The thought was higher PR = higher keyword placement. I am not at all sure of that anymore.

I read the articles you refer to before I did the robots.txt file. They included the warnings. Have no problem studing more :-)

Are you saying that the amount of content does not count towards PR?

One more Q. Pray tell, do you wear a white or black hat Jesus?