Tech how to scrape wordpress site ?

[freecartoonporn]

what are you guys using ?


i have list of urls , i need to scrape, images and or videos from.
target site is using wordpress.

i can create crawler myself using php simple html dom., but why reinvent the wheel.,

what is best out there ?

with scheduling and keeping watch on target site. , auto create categories, tags, auto scrape images , include them in our posts and set post as draft.

thanks for your time.

[k0nr4d]

Why not just use the RSS feed?

[freecartoonporn]

Originally Posted by k0nr4d

Why not just use the RSS feed?

there are old posts, on target site, and i am not sure., they will be in feed., as basically feed has limit to last 10 posts , i guess.

is thre way i can access old posts using feed ?

[klinton]

Cyberseo

[freecartoonporn]

i have list of thousands of urls, i need to scrape. and create posts in draft mode., then i can only publish it after checking each post. for valid image links.

[freecartoonporn]

Originally Posted by klinton

Cyberseo

i have list of thousands of urls, i need to scrape. and create posts in draft mode., then i can only publish it after checking each post. for valid image links.


is it possible with cyberseo.,
which version, cheap or expensive one ?

[klinton]

which version of it is cheap ?
im talking about normal version.
all options that you mentioned are default, the last one either is default (if i understand you correctly) or need some small simple parser to be written in php.
speak with Cyberseo, he posts here.

Originally Posted by freecartoonporn

i have list of thousands of urls, i need to scrape. and create posts in draft mode., then i can only publish it after checking each post. for valid image links.


is it possible with cyberseo.,
which version, cheap or expensive one ?

[freecartoonporn]

Originally Posted by klinton

which version of it is cheap ?
im talking about normal version.
all options that you mentioned are default, the last one either is default (if i understand you correctly) or need some small simple parser to be written in php.
speak with Cyberseo, he posts here.

i meant, the one which has lower price that other one.

i am still looking for more options, so i can decide .

[cordoba]

Originally Posted by klinton

Cyberseo

Surely Google is clever enough these days to scan (and penalize) sites for using an overtly blackhat plugin?

[brassmonkey]

i can scrape it for a fee

[Smack dat]

There are loads of nulled cyberseo around.

[freecartoonporn]

Originally Posted by brassmonkey

i can scrape it for a fee

i can create crawler myself using php simple html dom., but why reinvent the wheel.,

Originally Posted by Smack dat

There are loads of nulled cyberseo around.

nulled = bugged.

[brassmonkey]

Originally Posted by freecartoonporn

nulled = bugged.

free = go fuck yourself! nulled my software is paid for

[Barry-xlovecam]

So you want help stealing the other guy's shit ... NO

Not only that but you want to hotlink to the stolen shit too?

Even dumber than dumb -- you post a thread to leave a record of your malfeasance.

Congratulations, you get the GFY dumb-fuck of the month award -- a bag of poop from?

Get a new fuckin' plan

[freecartoonporn]

Originally Posted by Barry-xlovecam

So you want help stealing the other guy's shit ... NO

i am stealing from thief, i know two wrong does not make one right but still , i wanna try before i die.

Not only that but you want to hotlink to the stolen shit too?

where i said, that i want to hotlink ?

i want to downlod content to my server.

Even dumber than dumb -- you post a thread to leave a record of your malfeasance.

nobody cares.

Congratulations, you get the GFY dumb-fuck of the month award -- a bag of poop from?

thanks.

Get a new fuckin' plan

not until this plan fails.

[just a punk]

Originally Posted by freecartoonporn

there are old posts, on target site, and i am not sure., they will be in feed., as basically feed has limit to last 10 posts , i guess.

is thre way i can access old posts using feed ?

Originally Posted by freecartoonporn

what are you guys using ?

1) Install CyberSEO.
2) Add a link to WordrPress RSS feed.
3) Enable "Parse WordPress archives" option.

The target site will be fully scraped - doesn't matter how many posts it has in the RSS feed (1, 10 or none), the plugin will scrape just EVERYTHING - yes, including all old posts that you can't see in the RSS feed. It will even copy all the media to your host if you want it.

Originally Posted by cordoba

Surely Google is clever enough these days to scan (and penalize) sites for using an overtly blackhat plugin?

My plugin is undetectable. The script file gives 404 error if you try to open it. The same does the plugin's folder.

Originally Posted by freecartoonporn

nulled = bugged.

The version of 2012 which is floating on the net is very old, buggy and there is a backdoor added by hackers. No updates and no support too (you can't even read the official forum).

[just a punk]

Originally Posted by Barry-xlovecam

So you want help stealing the other guy's shit ...

I won't be so radical here. There are many promo blogs that belong to affiliate programs and made to promote their paysites. The problem is that their RSS feeds include the most recent posts only. My plugin allows to scrape the old posts too.

[freecartoonporn]

Originally Posted by CyberSEO

1) Install CyberSEO.
2) Add a link to WordrPress RSS feed.
3) Enable "Parse WordPress archives" option.

The target site will be fully scraped - doesn't matter how many posts it has in the RSS feed (1, 10 or none), the plugin will scrape just EVERYTHING - yes, including all old posts that you can't see in the RSS feed. It will even copy all the media to your host if you want it.



My plugin is undetectable. The script file gives 404 error if you try to open it. The same does the plugin's folder.



The version of 2012 which is floating on the net is very old, buggy and there is a backdoor added by hackers. No updates and no support too (you can't even read the official forum).

will it auto scrape new posts too ?

looks like i missed the boat, theres no lite version ?

[just a punk]

Originally Posted by freecartoonporn

will it auto scrape new posts too ?

Yes, of course. It will do it automatically.

Originally Posted by freecartoonporn

looks like i missed the boat, there no lite version?

There is no lite version anymore. Only the unlimited one.

[freecartoonporn]

Originally Posted by CyberSEO

Yes, of course. It will do it automatically.



There is no lite version anymore. Only the unlimited one.

can i use delete id feeds to delete the specific id posts from our site ?

i mean like MGP/TGP2 guys do it. big tubes provide deleted id feed.

[just a punk]

Originally Posted by freecartoonporn

can i use delete id feeds to delete the specific id posts from our site ?

i mean like MGP/TGP2 guys do it. big tubes provide deleted id feed.

You mean to use an RSS feed with id of posts that have to be deleted? With CyberSEO - you can't do it. I can write a special plugin for that.

[freecartoonporn]

Originally Posted by CyberSEO

You mean to use an RSS feed with id of posts that have to be deleted? With CyberSEO - you can't do it. I can write a special plugin for that.

okie., can it rename file names ?
and save using new file names.

[just a punk]

Originally Posted by freecartoonporn

okie., can it rename file names ?
and save using new file names.

Sure, why not? By default CyberSEO uses the original post title to rename the downloaded media. E.g.: Playboy Playmates

[freecartoonporn]

Originally Posted by CyberSEO

Sure, why not? By default CyberSEO uses the original post title to rename the downloaded media. E.g.: Playboy Playmates

is there str replace ., so in case , post content has domain name, i would like to replace it with mine.

something like that ?