I started this resource as a way to have a centralised way of updating the answer.
I then decided to create a Joomla Magazine article with fuller information (and a video).
Please note my blog is more recently updated.
I also created a blog on my own website. As the Joomla Magazine article has an approval process, and decided it was quicker for me to add additional items to my own blog.
You can find my blog here: it contains the most up-to-date information https://squareballoon.co.uk/blog/tutorials/how-to-solve-the-joomla-sorry-there-was-a-problem-we-could-not-recover-from