Du befindest Dich im Archiv vom ABAKUS Online Marketing Forum. Hier kannst Du Dich für das Forum mit den aktuellen Beiträgen registrieren.

.htaccess schliesst auch gute UA aus - why?

Alles zum Thema: Robots, Spider, Logfile-Auswertung und Reports
Neues Thema Antworten
sofasurfin
PostRank 1
PostRank 1
Beiträge: 3
Registriert: 22.11.2005, 16:17

Beitrag von sofasurfin » 22.11.2005, 16:31

Hallo,

ich schliesse mit folgender .htaccess erfolgreich einige böse Bots u.a. aus, nur leider zu erfolgreich, da nun 2 wahrscheinlich normale User Agents auch draussenbleiben:

Code: Alles auswählen

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; iebar; acc=jocker)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; 1&1 Internet AG by USt; CustomToolbar.com; SV1)
... ich finde aber selbst nach einschlägigem studium meiner .htaccess nicht die Regel welche dafür verantwortlich ist. Vielleich hat einer von euch den Tipp, ich bin nun nach meinem letzten Versuch ziemlich ratlos...

Code: Alles auswählen

RewriteEngine On
RewriteRule !sandbox\.php - [C] 

# -----------------------------------------------------------------------------
RewriteCond %{HTTP_USER_AGENT} ^.*attach.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*BackWeb.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Baiduspider.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Bandit.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*BatchFTP.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*BlackWidow.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Bot\mailto:craftbot@yahoo.com.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Buddy.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*ChinaClaw.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Collector.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Copier.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*cupriBOT.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Custo.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*DISCo.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Download\Demon.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Download\Wonder.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Downloader.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Drip.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*eCatch.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*EirGrabber.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*EmailSiphon.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*EmailWolf.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*EuripBot.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Express\WebPictures.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*ExtractorPro.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*EyeNetIE.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*FileHound.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*FlashGet.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*GetRight.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*GetSmart.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*GetWeb!.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Go!Zilla.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Go-Ahead-Got-It.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*gotit.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Grabber.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*GrabNet.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Grafula.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*grub-client.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*HMView.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*HTTrack.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Image\ Stripper.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Image\ Sucker.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*InterGET.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Internet\Ninja.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Iria.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Jakarta.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*JetCar.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*JOC.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*JustView.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*larbin.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*LeechFTP.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*lftp.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*libwww-perl.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*likse.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*LinkWalker.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Mag-Net.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Magnet.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Mass\Downloader.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Memo.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*MIDown\tool.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Mirror.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Mister\PiX.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Navroad.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*NearSite.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Net\Vampire.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*NetAnts.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*NetSpider.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*NetZIP.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Ninja.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*NPBot.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Octopus.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Offline\ Explorer.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Offline\ Navigator.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*PageGrabber.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Papa\Foto.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*pavuk.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*pcBrowser.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Pockey.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Pompos.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Poppelsdorf.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*psbot.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Pump.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*RealDownload.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Reaper.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Recorder.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*ReGet.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Siphon.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*sitecheck\.internetseer\.com.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*SiteSnagger.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*SmartDownload.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Snake.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*SpaceBison.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Stripper.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Sucker.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*SuperBot.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*SuperHTTP.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Surfbot.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*SurveyBot.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*tAkeOut.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Teleport.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Vacuum.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*VoidEYE.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*VoilaBot.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Web\Image\Collector.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Web\Sucker.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebAuto.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebCopier.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebFetch.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebGo\ IS.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebLeacher.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebReaper.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebSauger.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Website\ eXtractor.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Website\ Quester.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Webster.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebStripper.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebWhacker.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebZIP.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Wget.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Whacker.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Widow.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WWWOFFLE.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Xaldon.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Zeus.*$ [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^.*ZipppBot.*$ [NC,OR]
# Omni-Explorer
RewriteCond %{REMOTE_ADDR} ^64.71.131.113. [OR]
RewriteCond %{REMOTE_ADDR} ^65.19.150.218. [OR]
RewriteCond %{REMOTE_ADDR} ^65.19.150.242. [OR]
RewriteCond %{REMOTE_ADDR} ^65.19.150.253.
#
RewriteRule ^(.*)$ http://www.domain.de/sandbox.php [R=301]

Anzeige von ABAKUS

von Anzeige von ABAKUS »

SEO Consulting bei ABAKUS Internet Marketing
Erfahrung seit 2002
  • persönliche Betreuung
  • individuelle Beratung
  • kompetente Umsetzung

Jetzt anfragen: 0511 / 300325-0.


Caterham
PostRank 5
PostRank 5
Beiträge: 329
Registriert: 20.09.2004, 19:12

Beitrag von Caterham » 23.11.2005, 13:56

Ja,
RewriteCond %{HTTP_USER_AGENT} ^.*JOC.*$ [NC,OR]
und
RewriteCond %{HTTP_USER_AGENT} ^.*Custo.*$ [NC,OR]

sofasurfin
PostRank 1
PostRank 1
Beiträge: 3
Registriert: 22.11.2005, 16:17

Beitrag von sofasurfin » 24.11.2005, 13:54

:D vielen, vielen Dank!

Antworten
  • Vergleichbare Themen
    Antworten
    Zugriffe
    Letzter Beitrag