|
what I meant by a simple php page was that the page contains practically nothing.. just a sitemap that parses the URL for PATH_INFO and uses the results in the Title of the page. No MySQL or anything.
I'm using mod_gzip, as far as compression goes.
The crawler I mentioned earlier was using HTTP/1.1 requests.
Apache has MaxRequestsPerChild 600.
So the HTTP/1.1 connection combined with mod_gzip could be the issue, and they're just hammering away at the same simple php page repeatedly which could be consuming the memory until it finally crashes ? Isn't there something in Apache to get it to kill a process that consumes too much memory or hangs for too long ?
|