Quote:
Originally posted by clickhappy
How do you screen scrape? so you pull text off of 1 page and put it on to another?
I sometimes see tgps do this where they automatically get links off of other tgps and put the links on their own, but I dont know how to do it.
|
Most probably it's done with a spider script. It may be custom written, depending on which TGP. Recenly, I know for a fact, some MGP's have grown large in size based soley on such a spider script.
It is crawling through a specific list of sites and then following all the links on that site, and evaluating the content. Then building it's own database of links, and updating the page with these links. Personally, I think it's a little dirty. Especially when you're stealing descriptions that someone is taking the time to hahahahaha each day.
There is probably some pre packaged script like software available, but you'd probably want to do something like this through some custom programming.