... or at least the major TLDs? I presume some registrars offer a bulk WHOIS arrangement. T.I.A.
Anyone know where I can get a list of EVERY domain on the planet?
Collapse
X
-
-
I also know Alexa sells lists of top domains with rankings etc.. They sell them pretty pricey..
Top 100,000 domain lists for $6500.00I'm here for the violence!Comment
-
The root servers? Good luck getting access to them.
Seriously, I don't think there would be such a list. Even if one register agreed to let you access their whois servers on an unlimited basis, they'd still have to query servers outside their net and those would not permit such bulk activity I am sure.Last edited by minusonebit; 12-23-2007, 09:32 AM.Comment
-
WHOIS data would be a nice addition, but all I really need is the domain name.The root servers? Good luck getting access to them.
Seriously, I don't think there would be such a list. Even if one register agreed to let you access their whois servers on an unlimited basis, they'd still have to query servers outside their net and those would not permit such bulk activity I am sure.Comment
-
Maybe write a script to crawl across the net and dig every IP and record all the domains there? Gonna be a big file...
Comment
-
Comment
-
Comment
-
Just re-read this, I misunderstood your suggestion. Doing a reverse lookup on all IPs from 0.0.0.1 to 255.255.255.255 is going to result in a lot of DNS fails, and there's no way it will find every single domain... at least with a HTTP based crawler it will find (on average) at least a few new hostnames for each site it fetches.Comment
-
You need the registry zonefiles. Most have a system to allow you to apply for access. If you just need a one-time deal, contact me.- Free Premium Domain Lists and Tools at Clickmojo.com
- For Sale: Obscenity.com
Comment
-
I sale short Planet domain lists

FUBAR Webmasters - The FUBAR Times - FUBAR Webmasters Mobile - FUBARTV.XXX
For promo opps contact jfk at fubarwebmasters dot comComment
-
-
Thanks, I might contact you further into the future.
Any hints at how many domains there are in total? I've "budgeted" for about 500 million in my database.Comment
-
There are somewhere around 70 million in the .com zone.- Free Premium Domain Lists and Tools at Clickmojo.com
- For Sale: Obscenity.com
Comment
-
If you have a reseller account with a registrar like tucows you can request a weekly dump.Comment
-
-
Network Solutions used to offer this, back in 2001/2002 I used to have access to their program that did this and the files were absolutely massive. Just the .net database was about 2-3 gigs of gzip files containing nothing more than the domain name. Today these files have got to be enormous.
WGI play with Google.Comment
-
Comment
-
Those search results will include hostnames (eg "inurl:blogspot.com" returns 9 million results alone) and most likely multiple pages from a particular hostname. I'm more inclined to believe Brujah's figure of 70 mil .com domains
BTW inurl:.com returns a bunch of well known sites - who needs to pay for Alexa's top 1,000?
Comment
-
Comment
-
Comment
-
The com/net zone files can be obtained for free via FTP by applying to:
http://www.verisign.com/information-...ge_001052.html
For .org, the relevant link is:
http://www.pir.org/RegistrarResource...ileAccess.aspx
Some other TLD operators have similar programs, but the above will give you a good start.I buy good domain names. Send lists to George (at) LOFFS.comComment



Comment