Du befindest Dich im Archiv vom ABAKUS Online Marketing Forum. Hier kannst Du Dich für das Forum mit den aktuellen Beiträgen registrieren.

Massenweise robots.txt-Abfragen/Sek von verschiedenen IPs

Alles zum Thema: Robots, Spider, Logfile-Auswertung und Reports
Neues Thema Antworten

 Hat t-online nen bot?

mod_rewrite und IP aussperren

 
Georgi
PostRank 4
PostRank 4
Beiträge: 123
Registriert: 29.03.2006, 23:49

Beitrag von Georgi » 11.05.2006, 12:15

Hallo Forum,

ich habe gerade massenweise Abrufe nur der "/robots.txt" von verschiedensten IPs aber immer mit dem selben User-Agent:

156.56.103.62 - - [11/May/2006:13:03:04 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.10) Gecko/20050720 Fedora/1.0.6-1.1.fc3 Firefox/1.0.6"

Die Abrufe (User-Agent rausgenommen), welche teilweise im unter-Sekunden-Takt kommen:

156.56.103.62 - - [11/May/2006:13:03:04 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
156.56.103.61 - - [11/May/2006:13:03:04 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
141.161.20.33 - - [11/May/2006:13:03:44 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
138.100.12.148 - - [11/May/2006:13:04:15 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
138.100.12.149 - - [11/May/2006:13:04:16 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
216.165.109.79 - - [11/May/2006:13:04:18 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
216.165.109.81 - - [11/May/2006:13:04:18 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
216.165.109.82 - - [11/May/2006:13:04:20 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
141.161.20.32 - - [11/May/2006:13:04:21 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
199.77.128.193 - - [11/May/2006:13:05:13 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
199.77.128.194 - - [11/May/2006:13:05:14 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
128.31.1.13 - - [11/May/2006:13:05:48 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
128.31.1.16 - - [11/May/2006:13:05:48 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
128.31.1.14 - - [11/May/2006:13:05:48 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
128.31.1.12 - - [11/May/2006:13:05:48 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
128.31.1.11 - - [11/May/2006:13:05:48 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
128.31.1.15 - - [11/May/2006:13:05:49 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
138.23.204.232 - - [11/May/2006:13:05:53 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
138.23.204.133 - - [11/May/2006:13:05:54 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
130.245.145.150 - - [11/May/2006:13:06:17 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
130.245.145.152 - - [11/May/2006:13:06:17 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
152.3.138.3 - - [11/May/2006:13:07:03 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
152.3.138.2 - - [11/May/2006:13:07:04 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
128.83.122.181 - - [11/May/2006:13:07:14 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
128.83.122.180 - - [11/May/2006:13:07:14 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
169.229.50.10 - - [11/May/2006:13:07:21 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
169.229.50.8 - - [11/May/2006:13:07:21 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
169.229.50.13 - - [11/May/2006:13:07:21 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
12.46.129.21 - - [11/May/2006:13:07:21 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
12.46.129.23 - - [11/May/2006:13:07:21 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
169.229.50.17 - - [11/May/2006:13:07:22 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
12.46.129.22 - - [11/May/2006:13:07:22 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
169.229.50.16 - - [11/May/2006:13:07:23 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"
169.229.50.12 - - [11/May/2006:13:07:24 +0200] "GET /robots.txt HTTP/1.1" 200 0 "-"


Kann sich jemand darauf einen Reim machen?

Vodka, Georgi
Nach oben
Anzeige von ABAKUS

von Anzeige von ABAKUS »

Nach oben