Import CSV file (with all the raws) before time out in one time ?

[Jules Vau]

Hello !

I use Batch child editor (1.8.10) to import a CSV file (6500 raws) to create new pages. It's works ! But the module only import 5500 raws. My screen display "504 Gateway Time-out".
There is a way to import all the raws in one time AND before the time out?

Thanks in advance

Web host config:
PHP version 7.1
MySQL : v.5.5

ProcessWire:
3.0.96.

 

 

 

[dragan]

You can try this (temporarily) https://easyengine.io/tutorials/php/increase-script-execution-time/

or this https://modules.processwire.com/modules/tasker/ together with https://github.com/mtwebit/DataSet/

(and of course, you could split it up into smaller chunks...)

[flydev]

2 hours ago, Jules Vau said:

There is a way to import all the raws in one time AND before the time out?

 

If you are on a unix based system then you should give a try to Tasker/DataSet as @dragan said or look at the pcntl extension used in conjunction with the lib PHP League CSV. On windows (because the pcntl extension is not supported) I am used to write a custom import script with the same lib (PHP League)  and calling `set_time_limit()` in the loop after importing X records. I import and create something like ~15k pages each night, it work pretty good.

[Jules Vau]

Thank you for all these suggestions !
I will have a look.