A lot of /http404/ hits from bots like Facebook

[alexm]

Does anyone else get a lot on /http404/ from crawlers like facebook? See screenshot.

I'm just trying to think why I'd be getting so many and replicate the issue.

[horst]

You should inspect what the bots tried to find. Maybe this will shed some light?

You can use the jumplinks module for this, for example.

[alexm]

Perfect! Cheers @horst Jumplinks looks to be perfect for monitoring it. If it's anything of interest, I'll report back.

Otherwise thankyou and have a good evening!

[wbmnfktr]

Just in case it gets worse:

https://processwire.com/blog/posts/optimizing-404s-in-processwire/

[alexm]

@wbmnfktr Ah awesome, thank you! That's a great post. I've taken those steps now as they definitely seem like good additions!

[alexm]

Digging around in logs, I think I've managed to figure what's happening. If you type a URL on Facebook rather than paste the complete correct URL, it tries to request the URL as you type. So until the full, valid URL is completed it's trying to request a page that doesn't exist.