@patrickstox you can use NOINDEX meta tag if you don't want it to be indexed... nofollowed links do not tell Google to stop indexing, so... #vcbuzz
Right, but blocking crawling in robots.txt would prevent them from seeing a page marked noindex. If they aren't allowed to crawl, they can't see the noindex tag, so a page blocked from crawling with a noindex tag on it may still get indexed. #vcbuzz
-
-
Yes. Basically you have to pick one or the other. Do you want the page not crawled, or not indexed? Because it’s pretty much impossible to have both unless there are zero links (including internal) pointing to the page.
#vcbuzz -
And meta robots=“index,nofollow” is only useful in very specific edge cases (like penalty recovery). If you want links nofollowed, it’s best to do it with the link rel command.
#vcbuzz - Antwoorden weergeven
Nieuw gesprek -
-
-
Actually a page with no index doesn’t get indexed, the url does AFAIK
Bedankt, Twitter gebruikt dit om je tijdlijn te verbeteren. Ongedaan makenOngedaan maken
-
Het laden lijkt wat langer te duren.
Twitter is mogelijk overbelast of ondervindt een tijdelijke onderbreking. Probeer het opnieuw of bekijk de Twitter-status voor meer informatie.