Bot-Aktivität

[Armi]

Hi,

ich habe bei zwei größeren Portalen von mir eine extrem starke Googlebot-Aktivität (nicht der Mozilla-Bot!).

In den letzten 12 Stunden hat Google schon die 6-7fache Menge gezogen, wie sonst immer täglich. Und ich spreche hier nicht von ein paar Hundert Seiten - sondern inzwischen von einer 6stelligen Zahl!

Beobachtet Ihr ebenfalls eine stark erhöhte Bot-Aktivität heute?

(hat bei einem Projekt übrigens definitiv nichts mit ner Google Sitemap zu tun!)

[shapeshifter]

Grast bei mir grade ALLES ab

[Paulus]

+https://www.google.com/bot.html)"
66.249.66.11 - - [24/Jun/2005:10:17:40 +0200] "GET / HTTP/1.1" 200 6067 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
66.249.66.11 - - [24/Jun/2005:10:17:41 +0200] "GET /robots.txt HTTP/1.1" 200 317 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
66.249.66.11 - - [24/Jun/2005:10:17:41 +0200] "GET / HTTP/1.1" 200 6437 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
66.249.66.11 - - [24/Jun/2005:10:17:43 +0200] "GET /robots.txt HTTP/1.1" 200 317 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
66.249.66.11 - - [24/Jun/2005:10:17:43 +0200] "GET / HTTP/1.1" 200 6515 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
66.249.66.11 - - [24/Jun/2005:10:17:45 +0200] "GET /robots.txt HTTP/1.1" 200 317 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
66.249.66.11 - - [24/Jun/2005:10:17:45 +0200] "GET / HTTP/1.1" 200 6258 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
66.249.66.11 - - [24/Jun/2005:10:17:46 +0200] "GET /robots.txt HTTP/1.1" 200 317 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
66.249.66.11 - - [24/Jun/2005:10:17:46 +0200] "GET / HTTP/1.1" 200 6311 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)"
66.249.64.4 - - [24/Jun/2005:10:18:37 +0200] "GET /robots.txt HTTP/1.0" 200 317 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.64.4 - - [24/Jun/2005:10:18:37 +0200] "GET / HTTP/1.0" 200 5908 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.71.47 - - [24/Jun/2005:10:20:10 +0200] "GET /robots.txt HTTP/1.0" 200 317 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.71.47 - - [24/Jun/2005:10:20:11 +0200] "GET / HTTP/1.0" 200 6361 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.64.44 - - [24/Jun/2005:10:20:27 +0200] "GET /robots.txt HTTP/1.0" 200 317 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.64.44 - - [24/Jun/2005:10:20:28 +0200] "GET / HTTP/1.0" 200 6413 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.71.13 - - [24/Jun/2005:10:20:45 +0200] "GET /robots.txt HTTP/1.0" 200 317 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.71.13 - - [24/Jun/2005:10:20:45 +0200] "GET / HTTP/1.0" 200 6198 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.71.42 - - [24/Jun/2005:10:20:46 +0200] "GET /robots.txt HTTP/1.0" 200 317 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.71.42 - - [24/Jun/2005:10:20:47 +0200] "GET / HTTP/1.0" 200 6428 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.64.4 - - [24/Jun/2005:10:21:21 +0200] "GET /robots.txt HTTP/1.0" 200 317 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.64.4 - - [24/Jun/2005:10:21:23 +0200] "GET / HTTP/1.0" 200 6838 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.64.13 - - [24/Jun/2005:10:21:24 +0200] "GET /robots.txt HTTP/1.0" 200 317 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.64.13 - - [24/Jun/2005:10:21:25 +0200] "GET / HTTP/1.0" 200 6106 "-" "Googlebot/2.1 (+https://www.google.com/bot.html)"
66.249.71.53 - - [24/Jun/2005:10:21:38 +0200] "GET /robots.txt HTTP/1.0" 200 317 "-" "Googlebot/2.1

so sieht es bei mir aus, also mozilla und ohne

[Steffi]

die letzten Monate wars ruhig, seit Mai/Juni verstärkte Aktivität, jedoch ohne den Rahmen zu sprengen

[Steffi]

ach ja, sehr verwunderlich, der Bot versucht auf einer Subdomain schon seit 2 Tagen Dateien aufzurufen die es seit mindesten März/April nicht mehr gibt. Damals wollte er sie nicht, jetzt anscheinend schon.... hmm hätt ich die mal drauf gelassen ....aaarrrggg