☁️ Duplicator: Backup and move sites

[arjen]

I just sent a PM.

[Autofahrn]

@arjen quickly seeked the log and do not found anything wrong. In that log closing happens at 0.5s and opening at 2.7s so everything seems to work fine a the time between close and open indicates the time for zip operations to take place. You may give it a try and place the backups in some other location (i.e. next to the .../public folder or in .../public/backup), but I doubt this helps, since the logfiles are there.

I can only guess that the $zip->close() fails for some reason, so please try changing that block to read:

		$zipLog->verbose("CLOSING ZIP: {$zipfile}");
		$res = $zip->close();
		if($res !== true)
			{
			$zipStatus = $zip->getStatusString();
			$zipLog->verbose("CLOSE ZIP FAILED: {$zipStatus} in {$zipfile}");
			throw new WireException("Unable to close ZIP ({$zipfile}): {$zipStatus}");
			}
		$zipLog->verbose("OPENING ZIP: {$zipfile}");

Since I expect the close to fail I've read the complete log and saw, that it tries to zip temporary files generated by ProCache. So its probably worth to add an exclude for ProCache:

%/ProCache-[^/]+$%  # Ignore ProCache directory

and maybe the pwpc directory as well:

/site/assets/pwpc/

Edit: forgot that exclusion directories must be site-relative (so its /site/assets/pwpc/  not /pwpc/)

[arjen]

@AutofahrnDanke for your hard work on this. I really appreciate it. 

I've excluded both pwpc and added the regex to the config. No luck. I then changed the "Absolute path of the directory where packages are saved." to the ../public folder. No luck either. Funny thing is though that the log says it still wants to save in the "default" folder. 

When I add your code I'm getting a "Parse error: syntax error, unexpected '$res' (T_VARIABLE)". I've double check the syntax, but it seems to be okay. Not sure what is going on there as well.

I also removed all filecompiler files and let it recompile again. No luck.

[Autofahrn]

2 hours ago, arjen said:

When I add your code I'm getting a "Parse error: syntax error, unexpected '$res' (T_VARIABLE)".

Did you check for bad characters? Had this sometimes with copy&paste code from the forum.

Modified the script a little to hopefully display a reasonable error message.

[Beluga]

15 hours ago, Autofahrn said:

Did you check for bad characters? Had this sometimes with copy&paste code from the forum.

Due to the tooltip problem, the only safe way to copy anything from the forum is to quote the message and then copy from the message composing area.

[Autofahrn]

Finally fixed @arjen's issue, culprit was a non-readable file within the pwpc directory which wasn't excluded since I forgot exclusion paths need to be site relative (/site/assets/pwpc/ for all ProCache users).

[bernhard]

On 1/28/2017 at 2:34 PM, flydev said:

Good point. How about a simple button "Backup Now" to do it ?

Hi flydev,

just needed to use this module and didn't find that button until i found that I need to install the process module. In one of your screencasts there was the "event trigger" dropdown which is not there any more in newer versions. Why is the process module not installed on installation? I was looking under "setup" before installing the process module and there was of course no duplicator page until i found out that I had to install the process module manually.

Maybe you could also add a hint on the duplicator config screen?

Thx for you module!

[flydev]

Hi @bernhard cool to see that you needed this module for your case.

About your question, I quote myself :

Quote

The Process module is not really required because Duplicator could be, if needed, only run from CRON task.

 

That's not the first time this question is asked, I will make the Process module installed automatically on the next version (which should be ready for the end of august).

[bernhard]

19 hours ago, flydev said:

That's not the first time this question is asked, I will make the Process module installed automatically on the next version (which should be ready for the end of august).

A hint on the module config page would also be fine ? "Install Process Module" or "Process Module is (not) installed"

PS: Sorry, didn't follow this 14 pages thread closely enough ? 

[Ivan Gretsky]

On 7/18/2019 at 1:43 PM, bernhard said:

A hint on the module config page would also be fine ? "Install Process Module" or "Process Module is (not) installed"

PS: Sorry, didn't follow this 14 pages thread closely enough ? 

Yep) There is a link to process module that is broken "by default" if the process module is not installed.
And I would guess most of the time users would expect an admin page to be in place after installation for such a module.
Maybe reconsider and make it auto installed?

[Alpine418]

Does the duplicator also duplicate the database? If yes, how does it work?

[Alpine418]

3 hours ago, rjgamer said:

Does the duplicator also duplicate the database? If yes, how does it work?

Learning by doing. Could find it out by myself ?

But...

On 3/19/2019 at 7:58 AM, flydev said:

There is a work in progress on a development version (v1.3.10-ATO) - ...

What does ATO mean? Any plans for the next final release?

[Marcel]

Hey I use DUPLICATOR for backups.

In all of a sudden my cronjob don't work anymore.

I get the following error in Duplicator.module line 663:   

 PHP Warning: ZipArchive::Close(): Internal error

I use the cron.php file.

Has anyone an idea why this happens and what I can do?

Thanks in advance.

Marcel

[flydev]

Hi @Marcel, please tell me which version of Duplicator, ProcessWire and PHP you are on.

[Marcel]

Hey @flydev thanks for you reply!

1. PHP 5.6.38

2. Duplicator 1.2.9

3. Processwire 3.0.123 (dev, master)

 

EDIT: So far I cannot tell if it is a Duplicator issue or a server administration issue. I am not so familiar with server administration. Still learning this by doing this.

 

 

[Nick Belane]

On 9/30/2019 at 11:22 AM, Marcel said:

Hey @flydev thanks for you reply!

1. PHP 5.6.38

2. Duplicator 1.2.9

3. Processwire 3.0.123 (dev, master)

 

EDIT: So far I cannot tell if it is a Duplicator issue or a server administration issue. I am not so familiar with server administration. Still learning this by doing this.

 

 

PHP 5.6.38 ??
Are you serious?! ?

[wbmnfktr]

Hey @flydev just tried to backup an almost abandoned project of mine with your Duplicator module.

Installation (recent version from the modules directory via PW), setup and initial backup (local folder, no FTP or cloud) worked fine and I was curious about how the installer.php would work and gave it a try.

Then at some point it became weird.

The installer looked for config.php in a folder that does not exist at that point and path.

I repeated everything, moved the files around but there was no config.php anywhere in the backup. Neither the script created one.

Am I missing something here or ... changed something somewhere else that doesn't work well with your module?

I created a backup of an PW 3.0.132 instance. Both, remote and local, use PHP 7.2.x-

 

This question isn't urgent or anything!

 

[flydev]

Hi @wbmnfktr

It seem that your are using the wrong version - try the 1.3.12-ATO version on the dev branch please, it work as expected.

 

 

Edited December 8, 2019 by flydev
1.3.12-ATO I mean..

[wbmnfktr]

Thank you @flydev. I somehow missed that road to 1.3.12-ATO but I just installed and tried it again.

Backup and reinstall runs buttery smooth. Perfect!

[dragan]

@flydev I installed Duplicator today (ATO version). Local backups work fine, but FTP does nothing.

In the log I just see:

Quote

2019-12-30 22:25:14:  - package build failed.
2019-12-30 22:25:14:  - package build failed,  doesn't exist

What exactly "doesn't exist"? I have entered /public_html/pwb in "upload directory". This folder definitely exists, and the FTP credentials are correct. Any pointers where to look? Do I have to enter server path without leading / ? Something else I missed?

[Autofahrn]

@dragan: are you working on a shared server or do you indeed have a /public_html directory right at filesystem's root?

"absolute path" relates to filesystem not webroot, so you are free to locate the backup destination somewhere else.

It probably would be a good idea to support the regular home prefix, so path may be entered relative to webroot (something like "~/backup-folder"), at the moment you have to prefix the path with the location of your webroot.

[dragan]

31 minutes ago, Autofahrn said:

are you working on a shared server

Shared.

I tried absolute paths, and also tried ~, but so far without success.

[Autofahrn]

~ syntax is not implemented yet. What absolute path did you use? Should equal whatever is stored in $config->paths->root to be located inside your webroot.

[dragan]

11 hours ago, Autofahrn said:

What absolute path did you use?

The absolute path of the remote destination server (where I want the backup to be stored via FTP).

11 hours ago, Autofahrn said:

Should equal whatever is stored in $config->paths->root to be located inside your webroot.

Why is that? PW is not even installed on the destination server. I am talking about the field "FTP Settings: Upload directory: Directory on the server where the packages will be stored." Why is that supposed to be the same as my local path "D:/laragon/www/pw/"? That makes no sense.

[Autofahrn]

Sorry, I somehow missed the FTP part since already the package build seems to fail. And there should be the name of the zipfile in the "package build failed, <ZipNameExpectedHere> doesn't exist" message.

Seems to be a Windows system, guess there could be an issue with the backslash path separator.

Edit: The attached version 1.3.13 fixes the (false) package build error, supports custom package name and allows prefixing local path with ~/ to refer to webroot.

 

Duplicator-ATO1.3.13.zip