[SEO Question] Do Search Engine spiders read compressed (.gz) files ? - GoFuckYourself.com

beta-tester · 05-21-2006, 02:00 PM

Yo guys,

Here's my SEO question for the guys who KNOW the RIGHT and correct answer.

My question is do search engine spiders read read .gz files...So let's say I have something.xml.gz , will it be read by se spiders , I mean the content of that file?

THank you yo!

BeTa!~~

beta-tester · 05-21-2006, 02:22 PM

bump for meeeeee

woj · 05-21-2006, 02:40 PM

I wouldn't count on it....

Theo · 05-21-2006, 02:41 PM

they dont

beta-tester · 05-21-2006, 02:48 PM

Hmm, some 100% accurate information ? I want to be absolutely sure....cuz some of my sitemaps are compressed...and that google sitemap tool does allow, you can configure a sitemap to be compressed with gzip compresion....so I think they (SE spiders) can still see content of file.html.gz file....as browsers can.

Theo · 05-21-2006, 02:52 PM

actually now i see they can

Theo · 05-21-2006, 02:56 PM

this 3min editing shit sucks...anyhow

try to find such a file indexed

open it and copy/paste a part of the text on google and see if this appears

thing is i see a lot of .gz files indexed,but they are not actually compessed, they are either text files or pdf

baddog · 05-21-2006, 03:01 PM

We think they do.

beta-tester · 05-21-2006, 03:02 PM

that is right. THEY ARE compressed but we don't see that. They don't take so much disk space if they are pure txt and compressed....For example 10MB txt file could be compressed with gzip compression and it'll be 10KB,or so....

I am not sure whether or not SEs can read .gz files, but I am sure that browsers can!

baddog · 05-21-2006, 03:06 PM

Well, Google indicates that they do:

Q: Where do I place my Sitemap?

It is strongly recommended that you place your Sitemap at the root directory of your HTML server; that is, place it at http://example.com/sitemap.xml.gz.

baddog · 05-21-2006, 03:13 PM

http://www.google.com/webmasters/sit...temap_location

beta-tester · 05-21-2006, 03:14 PM

Yep, I saw Google do. But those are the sitemaps generated with official google sitemap generator tool, and they have a header like this:

Quote:

The question is, do the rest of SEs can read and support the sitemaps generated with google sitemap tool ?

woj · 05-21-2006, 03:17 PM

you won't get any solid answers here anyway dude, especially on any topic involving SEO, I would do your own research if I were you...

beta-tester · 05-21-2006, 03:28 PM

Well, I'd agree with you woj, but some stand-up guys, as baddog are the people who you can trust and be sure they won't spread misinformation. So far I found out that google DOES support .gz compressed files....

I am not sure about the rest of Search Engines though ;(

baddog · 05-21-2006, 03:28 PM

Quote:

Originally Posted by beta-tester

The question is, do the rest of SEs can read and support the sitemaps generated with google sitemap tool ?

Good question. Let us know what you find out.

baddog · 05-21-2006, 03:31 PM

Wish I could give you a definitive answer, but we don't know.

beta-tester · 05-21-2006, 04:12 PM

I shall do some more searching on this subject. Looks like very interesting question.

beta-tester · 05-21-2006, 04:22 PM

And looks like I've found the answer:

Quote:

The XML sitemaps use open standards on the creative commons license, so Google has left the format open for other search engines to use the same file. Right now Yahoo! only appears to use text files full of URLs, but maybe the Google sitemap file will be useful for reporting links to other engines like Y! eventually. It can't hurt to be ready.

baddog · 05-21-2006, 05:29 PM

Quote:

Originally Posted by beta-tester

And looks like I've found the answer:

As goes Google, goes the world?

beta-tester · 05-21-2006, 05:34 PM

Probably you're right baddog...Google sets standards these days....

05-21-2006, 02:00 PM	#1
beta-tester Rock 'n Roll Baby! Join Date: Sep 2004 Location: USA, temporarly Posts: 22,562	[SEO Question] Do Search Engine spiders read compressed (.gz) files ? Yo guys, Here's my SEO question for the guys who KNOW the RIGHT and correct answer. My question is do search engine spiders read read .gz files...So let's say I have something.xml.gz , will it be read by se spiders , I mean the content of that file? THank you yo! BeTa!~~ __________________ Sig for sale. Affordable prices. Contact me and get a great deal ;) My contact: ICQ: 944-320-46 e-mail: manca {AT} HotFreeSex4All.com

05-21-2006, 02:22 PM	#2
beta-tester Rock 'n Roll Baby! Join Date: Sep 2004 Location: USA, temporarly Posts: 22,562	bump for meeeeee __________________ Sig for sale. Affordable prices. Contact me and get a great deal ;) My contact: ICQ: 944-320-46 e-mail: manca {AT} HotFreeSex4All.com

05-21-2006, 02:40 PM	#3
woj <&(©¿©)&> Industry Role: Join Date: Jul 2002 Location: Chicago Posts: 47,882	I wouldn't count on it.... __________________ Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000 Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager

05-21-2006, 02:48 PM	#5
beta-tester Rock 'n Roll Baby! Join Date: Sep 2004 Location: USA, temporarly Posts: 22,562	Hmm, some 100% accurate information ? I want to be absolutely sure....cuz some of my sitemaps are compressed...and that google sitemap tool does allow, you can configure a sitemap to be compressed with gzip compresion....so I think they (SE spiders) can still see content of file.html.gz file....as browsers can. __________________ Sig for sale. Affordable prices. Contact me and get a great deal ;) My contact: ICQ: 944-320-46 e-mail: manca {AT} HotFreeSex4All.com

05-21-2006, 03:02 PM	#9
beta-tester Rock 'n Roll Baby! Join Date: Sep 2004 Location: USA, temporarly Posts: 22,562	that is right. THEY ARE compressed but we don't see that. They don't take so much disk space if they are pure txt and compressed....For example 10MB txt file could be compressed with gzip compression and it'll be 10KB,or so.... I am not sure whether or not SEs can read .gz files, but I am sure that browsers can! __________________ Sig for sale. Affordable prices. Contact me and get a great deal ;) My contact: ICQ: 944-320-46 e-mail: manca {AT} HotFreeSex4All.com

05-21-2006, 02:41 PM	#4
Theo HAL 9000 Industry Role: Join Date: May 2001 Posts: 34,515	they dont

05-21-2006, 02:52 PM	#6
Theo HAL 9000 Industry Role: Join Date: May 2001 Posts: 34,515	actually now i see they can

05-21-2006, 02:56 PM	#7
Theo HAL 9000 Industry Role: Join Date: May 2001 Posts: 34,515	this 3min editing shit sucks...anyhow try to find such a file indexed open it and copy/paste a part of the text on google and see if this appears thing is i see a lot of .gz files indexed,but they are not actually compessed, they are either text files or pdf

05-21-2006, 03:01 PM	#8
baddog So Fucking Banned Industry Role: Join Date: Apr 2001 Location: the beach, SoCal Posts: 107,089	We think they do.

05-21-2006, 03:06 PM	#10
baddog So Fucking Banned Industry Role: Join Date: Apr 2001 Location: the beach, SoCal Posts: 107,089	Well, Google indicates that they do: Q: Where do I place my Sitemap? It is strongly recommended that you place your Sitemap at the root directory of your HTML server; that is, place it at http://example.com/sitemap.xml.gz.

05-21-2006, 03:13 PM	#11
baddog So Fucking Banned Industry Role: Join Date: Apr 2001 Location: the beach, SoCal Posts: 107,089	http://www.google.com/webmasters/sit...temap_location

05-21-2006, 03:17 PM	#13
woj <&(©¿©)&> Industry Role: Join Date: Jul 2002 Location: Chicago Posts: 47,882	you won't get any solid answers here anyway dude, especially on any topic involving SEO, I would do your own research if I were you... __________________ Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000 Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager

05-21-2006, 03:28 PM	#14
beta-tester Rock 'n Roll Baby! Join Date: Sep 2004 Location: USA, temporarly Posts: 22,562	Well, I'd agree with you woj, but some stand-up guys, as baddog are the people who you can trust and be sure they won't spread misinformation. So far I found out that google DOES support .gz compressed files.... I am not sure about the rest of Search Engines though ;( __________________ Sig for sale. Affordable prices. Contact me and get a great deal ;) My contact: ICQ: 944-320-46 e-mail: manca {AT} HotFreeSex4All.com

05-21-2006, 03:31 PM	#16
baddog So Fucking Banned Industry Role: Join Date: Apr 2001 Location: the beach, SoCal Posts: 107,089	Wish I could give you a definitive answer, but we don't know.

05-21-2006, 04:12 PM	#17
beta-tester Rock 'n Roll Baby! Join Date: Sep 2004 Location: USA, temporarly Posts: 22,562	I shall do some more searching on this subject. Looks like very interesting question. __________________ Sig for sale. Affordable prices. Contact me and get a great deal ;) My contact: ICQ: 944-320-46 e-mail: manca {AT} HotFreeSex4All.com

05-21-2006, 05:34 PM	#20
beta-tester Rock 'n Roll Baby! Join Date: Sep 2004 Location: USA, temporarly Posts: 22,562	Probably you're right baddog...Google sets standards these days.... __________________ Sig for sale. Affordable prices. Contact me and get a great deal ;) My contact: ICQ: 944-320-46 e-mail: manca {AT} HotFreeSex4All.com