![]() |
![]() |
![]() |
||||
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
![]() ![]() |
|
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
Thread Tools |
![]() |
#1 |
Will everyone please review my newest site?
Join Date: May 2002
Posts: 841
|
Question for LINUX pros
I have a 1GB large file on my apache server and would like to extract only the URLs out of this file.
What's the best way to do it? |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#2 |
Confirmed User
Join Date: Mar 2001
Location: Indiana
Posts: 265
|
grep http filename
?
__________________
Currently Promoting: Adult Movie Club |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#3 |
Confirmed User
Join Date: Jan 2002
Location: In the walls of your house.
Posts: 3,985
|
That would depend on the format of the file. What other data is in the file besides urls? Are the urls all properly formated or do they sometimes break to the next line?
__________________
"Every normal man must be tempted, at times, to spit on his hands, hoist the black flag, and begin slitting throats." --H.L. Mencken |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#4 |
Confirmed User
Join Date: Jan 2003
Location: Austin, TX
Posts: 698
|
cat filename | tr '[ "<>]' '\12' | grep -e 'http\:\/\/'
|
![]() |
![]() ![]() ![]() ![]() ![]() |