images upload fails when uploading multiple, it seems random but about half?

[joe_g]

Here is a new thread about image upload problems. I think it's a new one, I've been through all the old threads I could find.

• When uploading multiple images at once (dragging) SOME fails. It's about 50%.
• Tried debug=true and false (remember this solving the problem in the past)
• It's not always the same images that fails
• Successful uplads gets JSON back
• Failed uploads get HTML back
• Nothing interesting from errors.log or the other logs
• No logs from Tracy
• ONCE I've gotten a SQL error: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry '3947-0' for key 'PRIMARY' (in /wire/core/FieldtypeMulti.php line 305)
• ProcessWire 3.0.148 © 2020
• PHP 7.3

Success JSON:

[{"error":false,"message":"Added file: run3_3382889b-2.jpg","file":"\/beta\/site\/assets\/files\/3942\/run3_3382889b-2.jpg","size":86775,"markup":"<li id='file_c55bcbd2fa4f1a2517b1a2ba0c025920' class='ImageOuter gridImage ui-widget'><div class='gridImage__tooltip'><table><tr><th>Dimensions<\/th><td>620x399<\/td><\/tr><tr><th>Filesize<\/th><td>85 kB<\/td><\/tr><tr><th>Variations<\/th><td>0<\/td><\/tr><\/table><\/div>\n\t\t\t<div class='gridImage__overflow'>\n\t\t\t\t<img src=\"\/beta\/site\/assets\/files\/3942\/run3_3382889b-2.0x260.jpg?nc=1598018196\" alt=\"\" data-w=\"620\" data-h=\"399\" data-original=\"\/beta\/site\/assets\/files\/3942\/run3_3382889b-2.jpg?nc=10\" data-focus=\"50 50 0\"  \/>\n\t\t\t<\/div>\n\t\t\t\n\t\t\t\t<div class='gridImage__hover'>\n\t\t\t\t\t<div class='gridImage__inner'>\n\t\t\t\t\t\t<label for='' class='gridImage__trash'>\n\t\t\t\t\t\t\t<input class='gridImage__deletebox' type='checkbox' name='delete_images_c55bcbd2fa4f1a2517b1a2ba0c025920' value='1' title='Delete' \/>\n\t\t\t\t\t\t\t<span class='fa fa-trash-o'><\/span>\n\t\t\t\t\t\t<\/label>\n\t\t\t\t\t\t<a class='gridImage__edit'>\n\t\t\t\t\t\t\t<span>Edit<\/span>\n\t\t\t\t\t\t<\/a>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\n\t\t\t\t<div class='ImageData'>\n\t\t\t\t\t<h2 class='InputfieldImageEdit__name'><span contenteditable='true'>run3_3382889b-2<\/span>.jpg<\/h2>\n\t\t\t\t\t<span class='InputfieldImageEdit__info'>85 kB, 620×399 <\/span>\n\t\t\t\t\t<div class='InputfieldImageEdit__errors'><\/div>\n\t\t\t\t\t<div class='InputfieldImageEdit__buttons'><small><button type='button' data-href='\/beta\/processwire\/page\/image\/edit\/?id=3942&file=3942,run3_3382889b-2.jpg&rte=0&field=images' class='InputfieldImageButtonCrop uk-button uk-button-small uk-button-text uk-margin-small-right pw-modal-large pw-modal' data-buttons='#non_rte_dialog_buttons button' data-autoclose='1' data-close='#non_rte_cancel'><i class='fa fa-crop'><\/i> Crop<\/button><button type='button' class='InputfieldImageButtonFocus uk-button uk-button-small uk-button-text uk-margin-small-right'><i class='fa fa-circle-o' data-toggle='fa-circle-o fa-dot-circle-o'><\/i> Focus<\/button><button type='button' data-href='\/beta\/processwire\/page\/image\/variations\/?id=3942&file=run3_3382889b-2.jpg&modal=1&varcnt=varcnt_images_c55bcbd2fa4f1a2517b1a2ba0c025920' class='uk-button uk-button-small uk-button-text uk-margin-small-right pw-modal-large pw-modal' data-buttons='button'><i class='fa fa-files-o'><\/i> Variations <span class='ui-priority-secondary'>(1)<\/span><\/button><\/small> <select class='uk-select uk-form-small InputfieldFileActionSelect' name='act_images_c55bcbd2fa4f1a2517b1a2ba0c025920'><option value=''>Actions<\/option><option value='dup'>Duplicate<\/option><option value='fv'>Flip vert<\/option><option value='fh'>Flip horiz<\/option><option value='fb'>Flip both<\/option><option value='r90'>Rotate 90°<\/option><option value='r180'>Rotate 180°<\/option><option value='r270'>Rotate 270°<\/option><option value='r-90'>Rotate -90°<\/option><option value='r-180'>Rotate -180°<\/option><option value='r-270'>Rotate -270°<\/option><option value='bw'>B&W<\/option><option value='sep'>Sepia<\/option><\/select> <span class='InputfieldFileActionNote detail'>Action applied at save.<\/span><\/div>\n\t\t\t\t\t<div class='InputfieldImageEdit__core'><div class='InputfieldFileDescription'><label for='description_images_c55bcbd2fa4f1a2517b1a2ba0c025920' class='detail pw-hidden'>Description<\/label><input type='text' name='description_images_c55bcbd2fa4f1a2517b1a2ba0c025920' id='description_images_c55bcbd2fa4f1a2517b1a2ba0c025920' placeholder='Description…' value='' \/><\/div><\/div>\n\t\t\t\t\t<div class='InputfieldImageEdit__additional'><\/div>\n\t\t\t\t\t<input class='InputfieldFileSort' type='text' name='sort_images_c55bcbd2fa4f1a2517b1a2ba0c025920' value='1' \/>\n\t\t\t\t\t<input class='InputfieldFileReplace' type='hidden' name='replace_images_c55bcbd2fa4f1a2517b1a2ba0c025920' \/>\n\t\t\t\t\t<input class='InputfieldFileRename' type='hidden' name='rename_images_c55bcbd2fa4f1a2517b1a2ba0c025920' \/>\n\t\t\t\t\t<input class='InputfieldImageFocus' type='hidden' name='focus_images_c55bcbd2fa4f1a2517b1a2ba0c025920' value='50 50 0' \/>\n\t\t\t\t<\/div>\n\t\t\t<\/li>","replace":false,"overwrite":0}]

HTML returned when failed

<form id="ProcessLoginForm" class="InputfieldFormFocusFirst InputfieldFormNoWidths InputfieldFormVertical uk-form-vertical InputfieldForm" method="post" action="./?id=3942" data-colspacing="0"><script>if(!navigator.cookieEnabled) document.write('<p class=ui-state-error-text>Cookie check failed: please enable cookies to login.</p>');</script><noscript><p class=ui-state-error-text>Javascript check failed: please enable Javascript to login.</p></noscript><ul class='Inputfields uk-grid-collapse uk-grid-match' uk-grid uk-height-match='target: > .Inputfield:not(.InputfieldStateCollapsed) > .InputfieldContent'><li class='Inputfield InputfieldText Inputfield_login_name collapsed9 uk-width-1-1' id='wrap_login_name'><label class='InputfieldHeader uk-form-label' for='login_name'>Username</label><div class='InputfieldContent uk-form-controls'><input id="login_name" class="ProcessLoginName uk-input InputfieldMaxWidth" name="login_name" type="text" maxlength="2048" /></div></li><li class='Inputfield InputfieldText Inputfield_login_pass collapsed9 uk-width-1-1' id='wrap_login_pass'><label class='InputfieldHeader uk-form-label' for='login_pass'>Password</label><div class='InputfieldContent uk-form-controls'><input id="login_pass" class="ProcessLoginPass uk-input InputfieldMaxWidth" name="login_pass" type="password" maxlength="2048" /></div></li><li class='Inputfield InputfieldSubmit Inputfield_login_submit uk-width-auto uk-margin-top' id='wrap_Inputfield_login_submit'><div class='InputfieldContent uk-form-controls'><button id="Inputfield_login_submit" class="ui-button ui-widget ui-state-default ui-corner-all" name="login_submit" value="Login" type="submit"><span class='ui-button-text'>Login</span></button></div></li><li class='Inputfield InputfieldHidden Inputfield_login_hidpi uk-width-1-1' id='wrap_login_hidpi'><label class='InputfieldHeader uk-form-label' for='login_hidpi'>login_hidpi<i title='Toggle open/close' class='toggle-icon fa fa-fw fa-angle-down' data-to='fa-angle-down fa-angle-right'></i></label><div class='InputfieldContent uk-form-controls'><input id="login_hidpi" name="login_hidpi" value="0" type="hidden" /></div></li><li class='Inputfield InputfieldHidden Inputfield_login_touch uk-width-1-1' id='wrap_login_touch'><label class='InputfieldHeader uk-form-label' for='login_touch'>login_touch<i title='Toggle open/close' class='toggle-icon fa fa-fw fa-angle-down' data-to='fa-angle-down fa-angle-right'></i></label><div class='InputfieldContent uk-form-controls'><input id="login_touch" name="login_touch" value="0" type="hidden" /></div></li><li class='Inputfield InputfieldHidden Inputfield_login_width uk-width-1-1' id='wrap_login_width'><label class='InputfieldHeader uk-form-label' for='login_width'>login_width<i title='Toggle open/close' class='toggle-icon fa fa-fw fa-angle-down' data-to='fa-angle-down fa-angle-right'></i></label><div class='InputfieldContent uk-form-controls'><input id="login_width" name="login_width" value="0" type="hidden" /></div></li></ul><input type='hidden' name='TOKEN1019986142X1598018203' value='6pe86O2MtD6nttH6QOfKyYQYFyuo45rP' class='_post_token' /></form><p><div><a href='/beta/'><i class='fa fa-home'></i> Home</a></div></p>

many thanks!

 

 

[dragan]

The HTML you get is the login form. It looks like you get logged out randomly. Did you try to delete all cookies from your site, logout and login again? I have no clue how this might be related to file/image uploads though. Here's a forum thread with login issues that might give you some hints how to troubleshoot. Also, is there anything special about pages with ID 3942 + 3947? (those appear in the SQL error and the HTML action attribute). Perhaps the database got corrupted somehow?

[joe_g]

Thanks! Your link is about disabling fingerprinting. I remember that being an issue in the past, but didn't help this time

Because it happens with some regularity, but with different images, it almost feels like it's some form of throttling on the servers. Maybe a security measure not to allow too many authenticated connections at once? Sounds weird, and I've never seen anything similar before.

It's the same across browsers and computers, so not a client side issue probably. The host is TSO (UK).

 

[horst]

As a workaround on servers that behave like that, you may wrap your images into a single ZIP archive for a single file upload.

[joe_g]

@horst For a second I thought there was a built in zip unpack in PW, but it doesn't seem like it. Uploading a zip gives 'invalid image'.

The client (or me) drags 20 images to an images field, but about 10 makes it after save. Are you sure there is a way to do this via zip?

[horst]

18 minutes ago, joe_g said:

Uploading a zip gives 'invalid image'.

You first must enable / allow the upload and processing of zip files in the images inputfield settings screen!

[joe_g]

@horst ...Wow!! I had no idea and I've been using PW since about forever.

thank you!