My buddies, Frank and Mike, and I were finally able to get one of my additional servers up-and-running smoothly.
It is now helping to offload (effectively speeding up captures by 75%) some burden off the main server. It won't be long before we are able to "image" the remaining nine(9) servers I bought last year and get those up-and-running also.
Once that happens, we will most likely delegate the server resources as follows:
One(1) server dedicated to re-trying invalid and broken domains
Two(2) servers dedicated to re-freshing existing, good thumbnails
Seven(7) servers dedicated to helping clear the queue
If that is what we end up going with, I estimate that we can easily handle 2,500 new thumbnails per hour while simultaneously serving out cached thumbnails, re-trying broken thumbnails, and re-freshing existing thumbnails on a monthly basis. That's going to be quite impressive.
I think that should hold us for awhile, but eventually, we may modify the code to handle multiple instances on each server and that could yield 2-3 times the capacity on the same servers.
Needless to say, this is quite an expensive undertaking for me to be offering all of this for free, so I hope everyone enjoys the benefits and spreads the word to help make this worth my while! lol. If I become famous, then I have accomplished my goal.
At any rate, I'm sure you'll understand when I say that I won't be sending any more emails or updating anything else over the next month while I work on some "paying" projects to help pay these massive server bills! haha. I will, however, still check in daily to be sure the system is running smoothly.
To your success!