To those of you using version 1.25 or lower - with the new .us .biz .ca .org domains, if you hit the dictionary script removing lastdate checks to many times, Google will blacklist your IP for 24hrs. v1.25 and above has 328 dictionary domains in the database (out of a total of 290,961 domains)
I tested it with 5 concurrent hits, and got my server ass banned
Implemented new throttling to throw off Google and added script locks so the script cannot be run more than 1 at a time. I'll test the throttling tomorrow once my IP becomes unbanned.
If you want to download it yourself and try, the new version is 1.26
The new alphabetically sorted dictionary .com .net .info .biz .us .ca .org .edu list (with no Google counts due to blacklist!!) can be viewed
HERE
**Note this list will remain static and will not update as new domains become available - you need to buy the script for that!!**
This is the version history for those that want to know:
Code:
===============
Version History
===============
****
1.26
****
2007/02/18
Added alphabetical sorting of domains
Added script locking of dictionary.php so that two concurrent processes cannot exist to prevent SE blacklisting
Got the server blacklisted with Google after hitting the full dictionary script with 5 concurrent connection.
- Alexa, Google PR, Yahoo, and MSN held up to the test
=> Added random time throttling to backlink checking to try confuse Google's bothit detector - to test tomorrow
****
1.25
****
2007/02/17
Added support for .biz .us .ca .org domains
Major revision of dictionary.php to search snapnames' and pool's databases to log only uniques
Added Pool.com's database to script - domains now at ~250k unique domains
****
1.2
****
2007/02/15
Added index.php to be able to search the database for user-defined terms
****
1.1
****
2007/02/15
Added nifty way of checking Google PR from command line
=> unlimited hits against Google DB and no need for API key :)
Seperated download/search from dictionary.php
****
1.05
****
2007/02/12
Alexa rank, and Google/Yahoo/MSN backlinks are now logged for dictionary domains
Only new domains appearing in the database will now be logged and mailed
- no point readvising user of domains they already know about!
- also reduces significantly the number of SE queries
- ~50 new dicitonary domains/day come up
****
1.00
****
2007/02/10
Cron job to run dictionary.php and mail html output to defined email
dictionary.php downloads Snapnames dbase and (~200k domains) searches for dictionary words