SEO test - GoFuckYourself.com - Adult Webmaster Forum

X

SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#1

SEO test

07-20-2008, 09:27 PM

If you register a new domain put up a site with 5 pages , the main page and 4 pages linked from the main domain

the 4 pages are named

apple.html
pear.html
squash.html
tomato.html

what page will google spider first ?

hatisblack at yahoo.com
Tags: None
stickyfingerz

Doin fine

Join Date: Oct 2005

Posts: 24984
Share

Post
#2

07-20-2008, 09:28 PM

The index?
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#3

07-20-2008, 09:29 PM

Originally posted by stickyfingerz

The index?

lol i was just thinking i should elaborate or some smartass will reply " the index "

assuming the index is already listed has one backlink and none of the other pages have backlinks other than from the main page of the domain

hatisblack at yahoo.com
Comment
stickyfingerz

Doin fine

Join Date: Oct 2005

Posts: 24984
Share

Post
#4

07-20-2008, 09:30 PM

Originally posted by SmokeyTheBear

lol i was just thinking i should elaborate or some smartass will reply " the index "

assuming the index is already listed has one backlink and none of the other pages have backlinks other than from the main page of the domain

Glad to be at your smartass service.
Comment
baddog

So Fucking Banned

Join Date: Apr 2001

Posts: 107089
Share

Post
#5

07-20-2008, 09:35 PM

Which page is the first link Google sees on the main page?
Comment
WiredGuy

Pounding Googlebot

Join Date: Aug 2002

Posts: 34515
Share

Post
#6

07-20-2008, 09:37 PM

Robots.txt
WG

I play with Google.
Comment
fallenmuffin

Confirmed User

Join Date: Nov 2005

Posts: 8170
Share

Post
#7

07-20-2008, 09:41 PM

If listed in order.. apple.html ?
Comment
Makingcoin

Confirmed User

Join Date: Aug 2002

Posts: 8919
Share

Post
#8

07-20-2008, 09:42 PM

grape.html ;-)

Smokey, hit me up please.

www.MAKINGCOIN.com
icq. 166-662-831
"Start making large coin!"

Daddy I Get Paid To Be A Whore - Coming Soon
Comment
d-null

. . .

Join Date: Apr 2007

Posts: 13724
Share

Post
#9

07-20-2008, 10:07 PM

all four simultaneously

__________________

Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs
Check out the #1 WordPress SEO Plugin: CyberSEO Suite
Comment
Iron Fist

Too lazy to set a custom title

Join Date: Dec 2006

Posts: 23400
Share

Post
#10

07-20-2008, 10:38 PM

What ever fruit Google Labs says is more popular at the time...

i like waffles
Comment
Iron Fist

Too lazy to set a custom title

Join Date: Dec 2006

Posts: 23400
Share

Post
#11

07-20-2008, 10:43 PM

Okay i'll back that up.... Apple would be first to index...

i like waffles
Comment
AlienQ - BANNED FOR LIFE

best designer on GFY

Join Date: Mar 2003

Posts: 30307
Share

Post
#12

07-21-2008, 12:56 AM

Use Robot.txt

Why leave things to chance? Tell the fucker where to go.

NAKED HOSTING FTW!11 I'm On The INSANE PLAN $9.95/mo!
| The Alien Blog Adult News Worth Reading Updated Daily
| Content For Sale! 641 PICS 216 MINUTES OF VIDEO $350.00 |ICQ: 78943384 |
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#13

07-21-2008, 01:12 AM

Originally posted by baddog

Which page is the first link Google sees on the main page?

same order as listed lets say

hatisblack at yahoo.com
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#14

07-21-2008, 01:13 AM

Originally posted by WiredGuy

Robots.txt
WG

no robots.txt

hatisblack at yahoo.com
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#15

07-21-2008, 01:14 AM

Originally posted by AlienQ

Use Robot.txt

Why leave things to chance? Tell the fucker where to go.

as far as i am aware you cant tell google what order to crawl your site

hatisblack at yahoo.com
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#16

07-21-2008, 01:21 AM

i will narrow it down .

5 choices.

#1 Google will spider the links in alphabetical order.
#2 Google will spider the links by length.
#3 Google will spider the links in the order it found them.
#4 Google will spider the links by importance of keyword
#5 Google will spider them randomly.

hatisblack at yahoo.com
Comment
Violetta

Affiliate

Join Date: Jul 2004

Posts: 28735
Share

Post
#17

07-21-2008, 01:27 AM

Originally posted by SmokeyTheBear

#1 Google will spider the links in alphabetical order.

M&A Queen
Comment
d-null

. . .

Join Date: Apr 2007

Posts: 13724
Share

Post
#18

07-21-2008, 01:35 AM

whichever shows up first in the page source so #3

__________________

Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs
Check out the #1 WordPress SEO Plugin: CyberSEO Suite
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#19

07-21-2008, 02:43 AM

the answer is PEAR.html

reason = #2

hatisblack at yahoo.com
Comment
Traf

Confirmed User

Join Date: Mar 2006

Posts: 132
Share

Post
#20

07-21-2008, 02:48 AM

Google will crawl the first link indicated in your index page.

IF this is the order you used in your index page then google will crawl apple.html first.

apple.html
pear.html
squash.html
tomato.html

SEO Problem? Email: [email protected]
ICQ: 686736528
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#21

07-21-2008, 03:11 AM

Originally posted by Traf

Google will crawl the first link indicated in your index page.

IF this is the order you used in your index page then google will crawl apple.html first.

apple.html
pear.html
squash.html
tomato.html

in my experience google uses the url length . it starts with the shortest urls first

I just did a test to confirm this. I dropped 500 links to a dynamic page, each page crawled creates a hardfile containing the first person to view it. when i sort the hardfiles by date they also are sorted by length. i.e. google crawled the shortest urls first in order to longest

hatisblack at yahoo.com
Comment
beta-tester

Rock 'n Roll Baby!

Join Date: Sep 2004

Posts: 22562
Share

Post
#22

07-21-2008, 03:20 AM

We can't be 100% sure which url it'll spider first. But I pretty much think it uses heuristic method in doing that.

Sig for sale. Affordable prices. Contact me and get a great deal ;)

My contact:
ICQ: 944-320-46
e-mail: manca {AT} HotFreeSex4All.com
Comment
DatingGameExpert

Confirmed User

Join Date: Jun 2008

Posts: 1089
Share

Post
#23

07-21-2008, 03:49 AM

Originally posted by SmokeyTheBear

i will narrow it down .

5 choices.

#1 Google will spider the links in alphabetical order.
#2 Google will spider the links by length.
#3 Google will spider the links in the order it found them.
#4 Google will spider the links by importance of keyword
#5 Google will spider them randomly.

Borrrrrrrrrrrrrring.
Comment
WiredGuy

Pounding Googlebot

Join Date: Aug 2002

Posts: 34515
Share

Post
#24

07-21-2008, 05:48 AM

Is this just from self-testing or something more formal?

My last test I had about 800 pages in total, all pages were of the format:
http://www.domain.com/Category_Name/
http://www.domain.com/Category_Name/index1 - index5 (.shtml)
http://www.domain.com/Category_Name/8-Character-Code (.shtml)

I noticed the first 80 pages indexed were full from the last set, domain, category, 8-character-code.shtml. It was never the category or index pages that got indexed first.

WG

I play with Google.
Comment
nico-t

emperor of my world

Join Date: Aug 2004

Posts: 29901
Share

Post
#25

07-21-2008, 06:42 AM

Originally posted by WiredGuy

Is this just from self-testing or something more formal?

My last test I had about 800 pages in total, all pages were of the format:
http://www.domain.com/Category_Name/
http://www.domain.com/Category_Name/index1 - index5 (.shtml)
http://www.domain.com/Category_Name/8-Character-Code (.shtml)

I noticed the first 80 pages indexed were full from the last set, domain, category, 8-character-code.shtml. It was never the category or index pages that got indexed first.

WG

those are dirs, not all same leveled pages in smokeys example. So maybe the deepest dir pages get indexed first? And then their parents?

So the shortest, deepest leveled pages, get indexed first?
Comment
V_RocKs

Damn Right I Kiss Ass!

Join Date: Nov 2003

Posts: 32451
Share

Post
#26

07-21-2008, 07:08 AM

longer names get love last.
Comment
Deej

I make pixels work

Join Date: Jun 2005

Posts: 24386
Share

Post
#27

07-21-2008, 09:16 AM

assuming google does spider each link... within a timely manner for each...

is there an advantage to having google spider certain pages first?

Deej's Designs n' What Not
Hit me up for Design, CSS & Photo Retouching

Icq#30096880
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#28

07-21-2008, 09:28 AM

Originally posted by Deej

is there an advantage to having google spider certain pages first?

unfortunately no lol, or none i can think of offhand

hatisblack at yahoo.com
Comment
Deej

I make pixels work

Join Date: Jun 2005

Posts: 24386
Share

Post
#29

07-21-2008, 09:57 AM

Originally posted by SmokeyTheBear

unfortunately no lol, or none i can think of offhand

Then quit wasting our god damned time smokey the fucking bear!!!

You insignificant trivia feedin mother fucker!!!

Your deck looks like shit!!!!

Deej's Designs n' What Not
Hit me up for Design, CSS & Photo Retouching

Icq#30096880
Comment
SCORE Ralph

Confirmed User

Join Date: Mar 2003

Posts: 2090
Share

Post
#30

07-21-2008, 10:39 AM

Originally posted by Deej

Then quit wasting our god damned time smokey the fucking bear!!!

You insignificant trivia feedin mother fucker!!!

Your deck looks like shit!!!!

Funny, I was thinking the same thing but was going to be a bit more diplomatic about it

GetSCORECash.com | In the Biz Since 1991
Big Tits | Granny & MILFs | Amateurs | Big Booty | Foot Fetish | BBW | Teens
Hosted Embeds | MP4s | RSS Feeds | FHGs | Model Directory
Comment
baddog

So Fucking Banned

Join Date: Apr 2001

Posts: 107089
Share

Post
#31

07-21-2008, 11:17 AM

So you are suggesting that the spider takes the time to look at all the links, then sort in order of length?
Comment
pussyserver - BANNED FOR LIFE

So Fucking Banned

Join Date: Oct 2005

Posts: 5133
Share

Post
#32

07-21-2008, 11:26 AM

you are all wrong

Google will spider the link most relative to the content of the index page first...

that being said... there is no such thing as spider first sice the google bot is in fact millions of bots that all spider constantly

then 2 pages or 20 pages on a site can all be indexed at the same time

the page most relative to the index snd thus the backlink pointing to the index will recieve the most 'love"
Comment
baddog

So Fucking Banned

Join Date: Apr 2001

Posts: 107089
Share

Post
#33

07-21-2008, 11:32 AM

Originally posted by pussyserver

you are all wrong

Google will spider the link most relative to the content of the index page first...

that being said... there is no such thing as spider first sice the google bot is in fact millions of bots that all spider constantly

then 2 pages or 20 pages on a site can all be indexed at the same time

the page most relative to the index snd thus the backlink pointing to the index will recieve the most 'love"

How will it know which is most relevant without spidering all first?
Comment
pussyserver - BANNED FOR LIFE

So Fucking Banned

Join Date: Oct 2005

Posts: 5133
Share

Post
#34

07-21-2008, 11:37 AM

Originally posted by baddog

How will it know which is most relevant without spidering all first?

I meant to say index first not spider first

it spiders everything by default ... but the algo decides on what gets indexed and in what order
Comment
Viper.X08

Confirmed User

Join Date: Nov 2007

Posts: 275
Share

Post
#35

07-21-2008, 11:41 AM

the first page who will give way for Google to visit your page.

Make Money In Adult
http://www.pantybucks.com/

http://www.richfetish.com/
Comment
baddog

So Fucking Banned

Join Date: Apr 2001

Posts: 107089
Share

Post
#36

07-21-2008, 12:56 PM

Originally posted by pussyserver

I meant to say index first not spider first

That wasn't the question.

http://www.gofuckyourself.com/showpo...88&postcount=1
Comment
pussyserver - BANNED FOR LIFE

So Fucking Banned

Join Date: Oct 2005

Posts: 5133
Share

Post
#37

07-21-2008, 12:59 PM

Originally posted by baddog

That wasn't the question.

http://www.gofuckyourself.com/showpo...88&postcount=1

yes i know that wasnt the question... but since the original question didnt make any sense .... I assumed the OP meant index... not spider
Comment
d-null

. . .

Join Date: Apr 2007

Posts: 13724
Share

Post
#38

07-21-2008, 01:07 PM

Originally posted by pussyserver

I meant to say index first not spider first

it spiders everything by default ... but the algo decides on what gets indexed and in what order

actually I'm not sure about that "spidering everything".... googlebot's algorithm makes decisions on what to spider, especially with newer sites..... a site that gets huge fast will not be completely spidered right away, or completely over and over, it would take up too much bandwidth and I think googlebot puts a relevancy factor on sites to decide how much time to spend on them

I've noticed a major shift in googlebot's spidering activities seems to occur with some sites when they hit a certain stage.... eg. site with 10,000 pages that google doesn't have trust in yet might only get 20% spidered and 5% indexed; then all of the sudden some months down the road much more will get spidered and indexed

(just from what I have seen, other factors like penalties may have been involved I guess, but no way of knowing that from where I'm sitting.... try it if you want to test it, start a brand new site and add 10,000 pages to it right away and see if googlebot spiders the whole works... I doubt that it will, at least not right away, and for sure google won't index all 10,000 pages right away either)

__________________

Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs
Check out the #1 WordPress SEO Plugin: CyberSEO Suite
Comment
pussyserver - BANNED FOR LIFE

So Fucking Banned

Join Date: Oct 2005

Posts: 5133
Share

Post
#39

07-21-2008, 01:18 PM

Originally posted by jetjet

actually I'm not sure about that "spidering everything".... googlebot's algorithm makes decisions on what to spider, especially with newer sites..... a site that gets huge fast will not be completely spidered right away, or completely over and over, it would take up too much bandwidth and I think googlebot puts a relevancy factor on sites to decide how much time to spend on them)

again you are talking about indexing

in order for a url to be process by the algorithm it has to be spidered

The googlebot spiders ( crawls ) everything

But not everything is added to the index

you see in order to really understand SEO you must first understand what google is

Google is a massive automated index... nothing more

just an index

But I should proably stop as I get passionate about SEO and wouldnt want to give anything away
Comment
d-null

. . .

Join Date: Apr 2007

Posts: 13724
Share

Post
#40

07-21-2008, 01:23 PM

I was talking about spidering and indexing

I think googlebot will not completely spider a new site that grows extremely fast, at least not right away

I've noticed that before but I wasn't paying close enough attention to say it with certainty and there are always other possible variables to consider

maybe things have changed now and googlebot will completely spider a brand new 10,000 page site immediately, just saying what I noticed in the past

__________________

Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs
Check out the #1 WordPress SEO Plugin: CyberSEO Suite
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#41

07-21-2008, 10:36 PM

Originally posted by jetjet

things have changed now and googlebot will completely spider a brand new 10,000 page site immediately,

hatisblack at yahoo.com
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#42

07-21-2008, 10:41 PM

Originally posted by pussyserver

that being said... there is no such thing as spider first sice the google bot is in fact millions of bots that all spider constantly

wtf ? obviously something gets hit first , google does not simultaniously spider multiple pages, yes they do use multiple bots but they dont all pound your site at the same time or it would crash your site. Your server works the same way , it doesnt handle all tasks at once, it processes them at the same time yes , but it still takes them in an order

hatisblack at yahoo.com
Comment
SmokeyTheBear

►SouthOfHeaven

Join Date: Jun 2004

Posts: 28609
Share

Post
#43

07-21-2008, 10:44 PM

Originally posted by baddog

So you are suggesting that the spider takes the time to look at all the links, then sort in order of length?

exactly.

basically if it finds 200 new pages it records the urls , then schedules the order they will be spidered by length.

hatisblack at yahoo.com
Comment
Snake Doctor

I'm Lenny2 Bitch

Join Date: Mar 2001

Posts: 13449
Share

Post
#44

07-21-2008, 11:31 PM

The answer to the question is

There is no money in SEO

sig too big
Comment
2012

So Fucking What

Join Date: Jul 2006

Posts: 17189
Share

Post
#45

07-21-2008, 11:36 PM

the spider does whatever it wants, whenever it wants , however way it wants to do it that day/hour/min/sec

... enjoy

Last edited by 2012; 07-21-2008, 11:39 PM.

best host: Webair | best sponsor: Kink | best coder: 688218966 | Go Fuck Yourself
Comment
Marky333

Confirmed User

Join Date: Jun 2006

Posts: 974
Share

Post
#46

07-22-2008, 03:29 AM

Originally posted by SmokeyTheBear

exactly.

basically if it finds 200 new pages it records the urls , then schedules the order they will be spidered by length.

Anyone tested this?
Comment

Previous template Next

Working...