Googlebot neuerdings mit über 100 verschiedenen IPs ....
Verfasst: 10.03.2004, 15:56
Hi Leute,
ich habe gerade die Logs analysiert.... Auf einer Domain war der Bot letzte Nacht recht fleißig - allerdings war der Bot unter mehr als 100 verschiedenen IPs spidern.....
Ist das schon länger?????? Ist mir bisher nicht aufgefallen.....
Was mag Google damit bezwecken???? Hat jemand einen Ansatz???
64.68.92.147 - - [09/Mar/2004:12:02:48 +0100] "GET /robots.txt HTTP/1.0" 404 - "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.147 - - [09/Mar/2004:12:02:48 +0100] "GET /HTTP/1.0" 200 7808 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.162 - - [09/Mar/2004:12:13:16 +0100] "GET HTTP/1.0" 200 7879 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.161 - - [09/Mar/2004:12:44:13 +0100] "GET HTTP/1.0" 200 8311 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.178 - - [09/Mar/2004:13:02:59 +0100] "GET HTTP/1.0" 200 7920 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.151 - - [09/Mar/2004:13:08:07 +0100] "GET HTTP/1.0" 200 7918 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.194 - - [09/Mar/2004:13:48:17 +0100] "GET HTTP/1.0" 200 7887 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.152 - - [09/Mar/2004:13:52:01 +0100] "GET HTTP/1.0" 200 7770 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.176 - - [09/Mar/2004:13:52:58 +0100] "GET HTTP/1.0" 200 7852 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.197 - - [09/Mar/2004:13:56:06 +0100] "GET HTTP/1.0" 200 8052 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.193 - - [09/Mar/2004:14:03:21 +0100] "GET HTTP/1.0" 200 8079 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
ich habe gerade die Logs analysiert.... Auf einer Domain war der Bot letzte Nacht recht fleißig - allerdings war der Bot unter mehr als 100 verschiedenen IPs spidern.....
Ist das schon länger?????? Ist mir bisher nicht aufgefallen.....
Was mag Google damit bezwecken???? Hat jemand einen Ansatz???
64.68.92.147 - - [09/Mar/2004:12:02:48 +0100] "GET /robots.txt HTTP/1.0" 404 - "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.147 - - [09/Mar/2004:12:02:48 +0100] "GET /HTTP/1.0" 200 7808 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.162 - - [09/Mar/2004:12:13:16 +0100] "GET HTTP/1.0" 200 7879 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.161 - - [09/Mar/2004:12:44:13 +0100] "GET HTTP/1.0" 200 8311 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.178 - - [09/Mar/2004:13:02:59 +0100] "GET HTTP/1.0" 200 7920 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.151 - - [09/Mar/2004:13:08:07 +0100] "GET HTTP/1.0" 200 7918 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.194 - - [09/Mar/2004:13:48:17 +0100] "GET HTTP/1.0" 200 7887 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.152 - - [09/Mar/2004:13:52:01 +0100] "GET HTTP/1.0" 200 7770 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.176 - - [09/Mar/2004:13:52:58 +0100] "GET HTTP/1.0" 200 7852 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.197 - - [09/Mar/2004:13:56:06 +0100] "GET HTTP/1.0" 200 8052 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"
64.68.92.193 - - [09/Mar/2004:14:03:21 +0100] "GET HTTP/1.0" 200 8079 "-" "Googlebot/2.1 (+https://www.googlebot.com/bot.html)"