Anyone know of a script to help format & implement CSV or XML FULL SITE feeds/dumps? - GoFuckYourself.com

Pornwolf · 11-25-2007, 05:45 PM

I have a question for you geniuses out there. I have a site that is to be fed strictly from a company's full site product catalog. The company is offering XML feeds and CSV dumps of the catalog.

Is there a script that helps format and implement that into a site? Will a standard cart script do this effectively?

I will admit I've never done this before so any info you guys can give will be greatly appreciated.

Pornwolf · 11-25-2007, 08:23 PM

Bump for the brains of GFY

WiredGuy · 11-25-2007, 08:49 PM

Well, the CSV format is plain text. So something like perl can open the file and manipulate it to your needs pretty easily. What do you want to do with the data once you read it?
WG

Pornwolf · 11-25-2007, 08:54 PM

Quote:

Originally Posted by WiredGuy

Well, the CSV format is plain text. So something like perl can open the file and manipulate it to your needs pretty easily. What do you want to do with the data once you read it?
WG

Insert it into categories and such. It's a lot of data so doing it piece by piece is not an option. We are talking over 40,000 pieces of content.

WiredGuy · 11-25-2007, 09:00 PM

Quote:

Originally Posted by Pornwolf

Insert it into categories and such. It's a lot of data so doing it piece by piece is not an option. We are talking over 40,000 pieces of content.

Perl can handle the processing / parsing no problem. What you want to do with it is likely where the bottleneck would be.
WG

kovacs · 11-25-2007, 11:21 PM

Nice post

Pornwolf · 11-25-2007, 11:34 PM

Quote:

Originally Posted by WiredGuy

Perl can handle the processing / parsing no problem. What you want to do with it is likely where the bottleneck would be.
WG

Interesting. There has to be an easier way. There has to be a script that is used to handling the csv or xml info that allows categorization and presentation capabilities? No?

Pornwolf · 11-26-2007, 02:55 AM

Bump for the American vampires and international pimps.

WiredGuy · 11-26-2007, 03:38 AM

Quote:

Originally Posted by Pornwolf

Interesting. There has to be an easier way. There has to be a script that is used to handling the csv or xml info that allows categorization and presentation capabilities? No?

Perl = Practical Extraction and Reporting Language. If your looking for something to format and reparse data, perl is probably the easiest approach.
WG

11-25-2007, 05:45 PM	#1
Pornwolf Drunk and Unruly Join Date: Jan 2002 Location: Hollywood Posts: 22,712	Anyone know of a script to help format & implement CSV or XML FULL SITE feeds/dumps? I have a question for you geniuses out there. I have a site that is to be fed strictly from a company's full site product catalog. The company is offering XML feeds and CSV dumps of the catalog. Is there a script that helps format and implement that into a site? Will a standard cart script do this effectively? I will admit I've never done this before so any info you guys can give will be greatly appreciated. __________________ I've trusted my sites to them for over a decade... Webair, bitches.

11-25-2007, 08:23 PM	#2
Pornwolf Drunk and Unruly Join Date: Jan 2002 Location: Hollywood Posts: 22,712	Bump for the brains of GFY __________________ I've trusted my sites to them for over a decade... Webair, bitches.

11-25-2007, 08:49 PM	#3
WiredGuy Pounding Googlebot Industry Role: Join Date: Aug 2002 Location: Canada Posts: 34,482	Well, the CSV format is plain text. So something like perl can open the file and manipulate it to your needs pretty easily. What do you want to do with the data once you read it? WG __________________ I play with Google.

11-26-2007, 02:55 AM	#8
Pornwolf Drunk and Unruly Join Date: Jan 2002 Location: Hollywood Posts: 22,712	Bump for the American vampires and international pimps. __________________ I've trusted my sites to them for over a decade... Webair, bitches.

11-25-2007, 11:21 PM	#6
kovacs So Fucking Banned Join Date: Nov 2007 Posts: 248	Nice post