Question for LINUX pros - GoFuckYourself.com

web4x · 02-10-2003, 06:41 PM

I have a 1GB large file on my apache server and would like to extract only the URLs out of this file.

What's the best way to do it?

echo465 · 02-10-2003, 06:48 PM

grep http filename

?

NetRodent · 02-10-2003, 06:55 PM

That would depend on the format of the file. What other data is in the file besides urls? Are the urls all properly formated or do they sometimes break to the next line?

fletcher · 02-10-2003, 07:22 PM

cat filename | tr '[ "<>]' '\12' | grep -e 'http\:\/\/'

02-10-2003, 06:41 PM	#1
web4x Will everyone please review my newest site? Join Date: May 2002 Posts: 841	Question for LINUX pros I have a 1GB large file on my apache server and would like to extract only the URLs out of this file. What's the best way to do it?

02-10-2003, 06:48 PM	#2
echo465 Confirmed User Join Date: Mar 2001 Location: Indiana Posts: 265	grep http filename ? __________________ Currently Promoting: Adult Movie Club

02-10-2003, 06:55 PM	#3
NetRodent Confirmed User Join Date: Jan 2002 Location: In the walls of your house. Posts: 3,985	That would depend on the format of the file. What other data is in the file besides urls? Are the urls all properly formated or do they sometimes break to the next line? __________________ "Every normal man must be tempted, at times, to spit on his hands, hoist the black flag, and begin slitting throats." --H.L. Mencken

02-10-2003, 07:22 PM	#4
fletcher Confirmed User Join Date: Jan 2003 Location: Austin, TX Posts: 698	cat filename \| tr '[ "<>]' '\12' \| grep -e 'http\:\/\/' __________________   [email protected] ICQ: 6411138