FHG producer please read.

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • qw12er
    Confirmed User
    • Apr 2004
    • 799

    #1

    FHG producer please read.

    I'm trying to make a data warehouse with all the FHGs out there and I'm having an hard time building a system to gather all those infos.

    Some sponsors have csv export witch are good for one time update but requires manual interaction for each update.

    Then some sponsors have the RSS feed which contain too less galleries to import (On most sponsors)

    I though of building a spyder but it's a lot of work and some FHG are protected againt that kind of bot.

    So am I missing an easy way to gather all those FHGs ? What would be the best way to do so ?
    I have nothing to advertise ... yet.
  • Mutt
    Too lazy to set a custom title
    • Sep 2002
    • 34431

    #2
    the URL in your sig - did you let the domain expire?
    I moved my sites to Vacares Hosting. I've saved money, my hair is thicker, lost some weight too! Thanks Sly!

    Comment

    • qw12er
      Confirmed User
      • Apr 2004
      • 799

      #3
      The more I check different sponsors the more I see new way of exporting data...

      Isn't there a standard for XML and CSV exportation ! Barnak
      I have nothing to advertise ... yet.

      Comment

      • just a punk
        So fuckin' bored
        • Jun 2003
        • 32385

        #4
        Originally posted by qw12er
        I'm trying to make a data warehouse with all the FHGs out there and I'm having an hard time building a system to gather all those infos.

        Some sponsors have csv export witch are good for one time update but requires manual interaction for each update.
        Hint: use your own software to gather and process the data
        Obey the Cowgod

        Comment

        • qw12er
          Confirmed User
          • Apr 2004
          • 799

          #5
          Originally posted by cyberxxx
          Hint: use your own software to gather and process the data
          Well I do ... I programmed my own piece of software but what I though would cover 80% covers 20% of the market and I have to do manually the 80% ...

          Two cie would have 3 ways of doing things in this industrie
          I have nothing to advertise ... yet.

          Comment

          Working...