FHG producer please read.
 

I'm trying to make a data warehouse with all the FHGs out there and I'm having an hard time building a system to gather all those infos.

Some sponsors have csv export witch are good for one time update but requires manual interaction for each update.

Then some sponsors have the RSS feed which contain too less galleries to import (On most sponsors)

I though of building a spyder but it's a lot of work and some FHG are protected againt that kind of bot.

So am I missing an easy way to gather all those FHGs ? What would be the best way to do so ?

the URL in your sig - did you let the domain expire?

The more I check different sponsors the more I see new way of exporting data...

Isn't there a standard for XML and CSV exportation ! Barnak

Hint: use your own software to gather and process the data :2 cents: :winkwink:

Well I do ... I programmed my own piece of software but what I though would cover 80% covers 20% of the market and I have to do manually the 80% ...

Two cie would have 3 ways of doing things in this industrie :helpme