|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
05-14-2003, 05:16 PM
|
#1 |
|
Confirmed User
Join Date: Jul 2002
Location: Magrathea
Posts: 6,493
|
Effective batch WHOIS program or script?
I'd like to find a program for looking up large (anywhere from hundreds to thousands) of domain names. I have my own program that does this, but it is purely a comnand-line *nix program. I would really like to find something that will run server-side or even under Windows. I am not looking for anything super-fancy (I don't care if it supports non-standard TLDs, I don't need a billion fancy options), I just want a reliable "Yes" or "No" on availability.
If you know of a program or script that does effective batch WHOISing, I'd appreciate it if you'd point me toward it. Thanks, SpaceAce |
|
|
|
05-14-2003, 05:20 PM
|
#2 |
|
Zph7YXfjMhg
Industry Role:
Join Date: Nov 2002
Location: In Your Skull
Posts: 15,306
|
analogx.com has one called whois ultra.. i've been using it forever.
will do single/lists/wildcards/etc.. |
|
|
|
|
05-14-2003, 05:21 PM
|
#3 | |
|
Confirmed User
Join Date: Jul 2002
Location: Magrathea
Posts: 6,493
|
Quote:
Anyone who knows of another, please post it, still. Thanks, SpaceAce |
|
|
|
|
|
05-14-2003, 05:23 PM
|
#4 |
|
Chafed.
Join Date: May 2002
Location: Face Down in Pussy
Posts: 18,041
|
SpaceAce, I wrote a windows client that does it based on a thread YOU wrote a couple of months ago.
Goes through any number of search engines, reads through a list of search terms, extracts all the matching domains on the top 5 or so pages, then runs a whois on 'em and dumps the output into a textfile or DB. I could polish it up for you or just the whois portion if you want. How much are you looking to pay? 
__________________
 icq:159548293 |
|
|
|
|
05-14-2003, 05:36 PM
|
#5 |
|
Pounding Googlebot
Industry Role:
Join Date: Aug 2002
Location: Canada
Posts: 34,482
|
Get the analog-x one, it's fast as hell and free.
WG
__________________
I play with Google. |
|
|
|
05-14-2003, 05:43 PM
|
#6 | |
|
Confirmed User
Join Date: Jul 2002
Location: Magrathea
Posts: 6,493
|
Quote:
 The only part I need is the WHOIS. I still use my search engine leeching script once in a while and I actually wrote an advanced PERL module for spidering. I did the entire adult tree on a certain directory site using my new module. The problem is, I want something that doesn't run from a Linux command line. SpaceAce |
|
|
|
|
|
05-14-2003, 05:43 PM
|
#7 | |
|
Confirmed User
Join Date: Jul 2002
Location: Magrathea
Posts: 6,493
|
Quote:
SpaceAce |
|
|
|
|
|
05-14-2003, 05:47 PM
|
#8 | |
|
Pounding Googlebot
Industry Role:
Join Date: Aug 2002
Location: Canada
Posts: 34,482
|
Quote:
WG
__________________
I play with Google. |
|
|
|
|
|
05-14-2003, 05:53 PM
|
#9 |
|
Confirmed User
Industry Role:
Join Date: Aug 2002
Location: Sunny Fucking California
Posts: 1,575
|
|
|
|
|
|
05-14-2003, 06:04 PM
|
#10 |
|
Beer Money Baron
Industry Role:
Join Date: Jan 2001
Location: brujah / gmail
Posts: 22,157
|
AnalogX does a nice job, be sure you use the Ultra Scan option.
__________________
|
|
|
|
|
05-17-2003, 09:25 AM
|
#11 |
|
Confirmed User
Join Date: Jul 2002
Location: Magrathea
Posts: 6,493
|
I am bumping this to see if there are any others. AnalogX is a decent program but it seems to have some sort problem that causes it to gradually bog down while running large projects. By the time it's checked a few thousand, it is only doing one search every few seconds as opposed to completing several searches per second as it does in the beginning. It really bites the big one and crashes with a memory error around 10,000-12,000.
Nasty, I think I used DNA before. I will go download it, again. Thanks for the link. SpaceAce |
|
|
|
|
05-17-2003, 09:49 AM
|
#12 | |
|
Confirmed User
Join Date: Jul 2002
Location: Magrathea
Posts: 6,493
|
Quote:
1) It is pretty damn slow. I wish it had an "UltraSearch" mode of operation. 2) It won't let me import a list of words into the "generate domains" panel. It wants me to type them in one at a time whihc is not going to fly. The padding feature is nice, but useless if I have to type in all the main keywords by hand. It's almost what I want... SpaceAce |
|
|
|
|
|
05-17-2003, 10:39 AM
|
#13 |
|
Pounding Googlebot
Industry Role:
Join Date: Aug 2002
Location: Canada
Posts: 34,482
|
Ever considered trying to split your input file into smaller batches for analog-x? I never tried batches that large but you could just split it couldn't you?
WG
__________________
I play with Google. |
|
|
|
|
05-17-2003, 11:03 AM
|
#14 | |
|
Confirmed User
Join Date: Jul 2002
Location: Magrathea
Posts: 6,493
|
Quote:
So, as you see, even using a small list of 200 words and a small list of words for padding purposes, it adds up very quickly. I would have to split my word lists up into chunks of about 5 words each which is very time consuming. I like the way AnalogX works, but that bog-down problem is terrible. It's probably something silly, too, like not closing down a thread after a connection or a massively inefficient listbox control. SpaceAce |
|
|
|
|
