Google Bot identifizieren
Verfasst: 22.09.2006, 07:50
Hier in diesem Posting ( https://googlewebmastercentral.blogspot ... lebot.html ) zitiert Matt Cutts einen Kollegen, wie man den Google Bot identifiziert:
Danke
Kann mir das jemand erläutern. Ich habe kein Sprachproblem, sondern mir fehlt das technische Verständnis.Telling webmasters to use DNS to verify on a case-by-case basis seems like the best way to go. I think the recommended technique would be to do a reverse DNS lookup, verify that the name is in the googlebot.com domain, and then do a corresponding forward DNS->IP lookup using that googlebot.com name; eg:
> host 66.249.66.1
1.66.249.66.in-addr.arpa domain name pointer crawl-66-249-66-1.googlebot.com.
> host crawl-66-249-66-1.googlebot.com
crawl-66-249-66-1.googlebot.com has address 66.249.66.1
I don't think just doing a reverse DNS lookup is sufficient, because a spoofer could set up reverse DNS to point to crawl-a-b-c-d.googlebot.com.
Danke
