While trying to generate a sitemap with a crawler, it is finding some really weird URLs which is not giving a 404 and displaying incorrect content on the wrong section.
So for example, I have a Menu called fiction with sub item used-fiction/offers. The fiction section has it's own template which makes it look different from Autobiography section but somehow the crawler is finding the URL below and the loading content of the id=124 under the fiction template which is completely wrong. There are no menu items pointing to that article that is in the Fiction Menu. That article ID has a menu item in 'Autobiography' Menu which is working fine.
I wondering if there is a way I could identify where these links might be in content table but checking in the database, I can't find anything that is remotely like this. Any suggestions would be great!