Seeing Googlebot crawling a lot of urls based on strings in JavaScript? Via : Google will prioritize urls for crawling & random urls like that will not be the priority. We'll crawl the most important pages first & then get to the others if we can: youtube.com/watch?v=wmqrr7
Conversation
Replying to
More: If you feel this is important and causing problems, then you can also put those strings in a JavaScript file that you block via robots.txt. Then Google won't see the JS file and the urls in the strings. Just make sure it doesn't impact rendering: youtube.com/watch?v=wmqrr7
GIF
2
Reading between the lines...
If Googlebot is spending time on weird/random JS based URLs before/rather-than actual pages you want crawled/indexed,
somethings gone wrong :D
1
2
One more thing about not-indexed pages, he also said maybe it's still not indexed yet because Google wants to see the overall process instead of hoping for sth happens magically:
The following media includes potentially sensitive content. Change settings
View