Admin execution timeout & filecompiler

[RyanJ]

I have quite the pickle. 

The admin no matter where I am at in it, times out constantly. I either get a 504 gateway or and execution timeout. I am banging my head why its across the board. The frontend of the site works great.

The site does have a lot of pages, 164,889 to be exact.  Most of that is due to image pages created by media manager and having repeater matrix installed which is used on most of the pages. For some reason, if I can manage  click the "Clear file compiler" without it timing out, the site perks back up and I can access the admin again and it is quite speedy. However if I walk away leaving the browser sitting for about an hour and come back, I have to start the process all over again.

The site has 52 various fields. Not every field is assigned to every template. a lot of the fields are used by the matrix to create a page builder.

I can't accept that PW can't handle such. I have other sites that run triple the amount of pages, but don't rely on the matrix to build the layout.

I have disabled any custom module that I thought could possibly cause an issue. I have overwrote every module and the wire core thinking something may have got corrupted. I guess my next step is starting with a fresh install, but I thought I would reach out to see if I am missing something. 

Some background on pages:

All the pages are imported using the command line which bootstraps PW and uses the api. This is a dev site, so I blow away the pages if I need to reimport them, until I get it correct.

PW Version 3.0.172, PHP 7.3, Innodb 5.7.27-30.

I appreciate any suggestions or thoughts. 

 

 

[szabesz]

Hello, Have you tried to bump up the max execution time as a starter? Usually I set it to max_execution_time = 60

[RyanJ]

@szabesz

Thanks for the suggestion. Bumping up the execution time is only a short term solution. I need to figure out why its crashing the entire admin. I am having a hard time believing PW can't handle this data load. Not to mention the site is only going to grow in pages, so I need to ensure it will scale. My fear is that it maybe related to the Repeater Matrix or repeaters overall, but I just don't know yet.

Does anyone know if the admin pages are cached? It is strange to me that sometimes I can get it to work, then others it just times out. My next steps are to blow away all the data and try to piece my import in and see where the bottle neck occurs. 

[szabesz]

4 hours ago, RyanJ said:

Repeater Matrix

Since you are using ProFields, have you thought of asking Ryan for help? (Provided you currently have an active license, of course). Anyway, I do not think the number of pages and fields are causing the issue. You should not blame the system for this, as it it highly unlikely that the system itself is the root of the cause.

[RyanJ]

Hi @szabesz

Thanks for checking back in. No, I have not. I want to determine that is the cause before reaching out to Ryan. I would agree with you and would be surprised that the number of pages is the issue. I can't rule anything out at this time.

 There is no blaming the system, I am just trying to determine the issue. I am curious if the admin pages are cached at any point.

[RyanJ]

Just in case anyone else runs across this topic. I finally found the culprit. It was the Seo Maestro module which was trying to generate a sitemap. Reading the docs (which I apparently overlooked) states that this could be an issue on large sites. 

I ended up bootstrapping the module to render the sitemap, so it has no affect on the cms side of things. Great module by the @Wanze