Crawl once with JS enabled and once with it disabled and then diff the URLs in the two results?
-
-
-
Ya - this is what I would normally do. Looking for something a bit faster though.
Einde van gesprek
Nieuw gesprek -
-
-
Crawl with JS and custom extract the non HTML links patterns.
-
Ya - this is the plan, there are just lots of weird patterns in legacy code.
- Antwoorden weergeven
Nieuw gesprek -
-
-
Do a custom crawl for those typical JS link patterns
Bedankt, Twitter gebruikt dit om je tijdlijn te verbeteren. Ongedaan makenOngedaan maken
-
-
-
Curious, why would you need to do that?
-
I have a client that asked for it.
- Antwoorden weergeven
Nieuw gesprek -
-
-
I can't find it in the crawlers I normally use. Wondering if it might be in Bing Webmaster Tools, or maybe some of the other crawlers - I tried
@ScreaminFrog and@Ryte, and the@OnelyCom WWJD tool is cool but only does one page at a time.pic.twitter.com/8NjvStgKWd - Antwoorden weergeven
Nieuw gesprek -
-
Do you mean links with no valid href? I have adapted this bookmarklet code I did in the past and used it to create custom extractions in deepcrawl (using the custom JS feature)https://tamethebots.com/blog-n-bits/handy-chrome-javascript-bookmarklets#blankhrefs …
-
That does miss those oh so creative <div onclick="goto('/just-no')">I'm a link, honest</a> style things though.
- Antwoorden weergeven
Nieuw gesprek -
Het laden lijkt wat langer te duren.
Twitter is mogelijk overbelast of ondervindt een tijdelijke onderbreking. Probeer het opnieuw of bekijk de Twitter-status voor meer informatie.