PHP - Max Execution Time - 48 Hours - Problems?

[Dusen]

I'm generating stats from huge files. The script I'm running, if I extrapolate the time correctly will need about 44 hours of execution time in php.

I'll set it up in a "screen" session and let it rip, but are there any adverse effects to seeting up a HUGE execution time in php.ini?

Given that, does anyone have any tips on how I could parse HUGE files with php and have it use multiple "executions"?

[woj]

use "set_time_limit" function to set the time limit in the script itself rather than globally with php.ini...

[KC]

I'd suggest using something other than PHP for this.

[fr8]

Originally posted by KC
I'd suggest using something other than PHP for this.

Yes I dont see how php would be the best for this.

[AndrewKanuck]

Originally posted by KC
I'd suggest using something other than PHP for this.

Word - who in gods name would parse that large of a file with PHP; my god man.

[KC]

It's a little like painting a house with a fingernail polish brush. You could probably do it, but it's not the right tool for the job!

[Brujah]

48 hours.. wow.

[Varius]

How big are those files?? 48 hours is insane, we have PHP scripts doing all kinds of things to large logfiles but doesn't take anywhere close to that!!

You sure your code is optimized ??

If it is, then as others said try another language like Python.

[Fukeneh]

1. split the file

2. use perl

3. use c

4. or use a quick shell script(what i would do)