Diesen Spidern wird keine SID zugewiesen:
Code: Alles auswählen
$Id: spiders.txt,v 1.2b.o 2004/03/02 00:23:17 dgw_ Exp $
AbachoBOT
Allesklar
almaden.ibm.com
AltaVista
appie 1.1
architext
ask jeeves
asterias2.0
augurfind
baiduspider
bannana_bot
bdcindexer
BSDSeek
crawler
crawler@fast
docomo
Fast
fast-webcrawler
fdse robot
Firefly/1.0
fluffy the spider
Francis/1.0
frooglebot
geobot
googlebot
grub-client
gsa-crawler
gulliver
henrythemiragorobot
ia_archiver
infoseek
kit_fireball
lachesis
lycos_spider
mantraagent
Martini
Mediapartners-Google/2.1
mercator
moget/1.0
msnbot
muscatferret
nationaldirectory-webspider
naverrobot
ncsa beta
netresearchserver
ng/1.0
osis-project
Overture
polybot
pompos
preisroboter
scooter
seventwentyfour
sidewinder
sleek spider
slurp/si
slurp@inktomi.com
steeler/1.3
szukacz
t-h-u-n-d-e-r-s-t-o-n-e
teoma
turnitinbot
ultraseek
vagabondo
voilabot
w3c_validator
WebCrawler
Yahoo
Yahoo-VerticalCrawler-FormerWebCrawler
zao/0
zyborg/1.0
