|
I have a crawler running that speed in nodejs, it's up to the task as well. You'd want to use some something like cluster or run multiple instances with pm2.
You could always scale up your existing solution by splitting the urls in half and getting another server.
|