GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   Is there a FREE online scraper that does this? (https://gfy.com/showthread.php?t=1140722)

$5 submissions 05-15-2014 05:08 AM

Is there a FREE online scraper that does this?
 
Enter the url of a blog
Online service spits out all the urls of posts that blog has

Anyone know of a free online scraper that has this feature?

I know SB has an add on for this but is there an online version?

just a punk 05-15-2014 05:13 AM

http://fivefilters.org/content-only/

$5 submissions 05-26-2014 08:16 PM

Quote:

Originally Posted by CyberSEO (Post 20087555)

This isn't what I had in mind.

For example:

You enter a url: domain.com/blog

The tool will output

domain.com/blog/post1 TITLE
domain.com/blog/post2 TITLE
domain.com/blog/post3 TITLE
domain.com/blog/post4 TITLE

etc etc

If it can output in CSV format even better

sexybabe 05-26-2014 08:36 PM

I had a script named linktator 2 , it does it. But now it is gone.

DBS.US 05-26-2014 09:40 PM

Isn't that like stealing?:pimp

freecartoonporn 05-26-2014 10:44 PM

Quote:

Originally Posted by CyberSEO (Post 20087555)

thanks for the link man.

sobecash 05-26-2014 11:20 PM

Quote:

Originally Posted by sexybabe (Post 20101027)
I had a script named linktator 2 , it does it. But now it is gone.

It is a relatively short script on linux, using basic commands on the terminal: wget and grep. The commands would also work on OS X. On Windows you would need curl.

carlosse 05-27-2014 12:41 PM

try xenu


All times are GMT -7. The time now is 09:12 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123