Du befindest Dich im Archiv vom ABAKUS Online Marketing Forum. Hier kannst Du Dich für das Forum mit den aktuellen Beiträgen registrieren.

Was ist denn das? ...dynamic...

Alles zum Thema: Robots, Spider, Logfile-Auswertung und Reports
easycool
PostRank 2
PostRank 2
Beiträge: 61
Registriert: 22.09.2004, 12:15

Beitrag von easycool » 28.04.2006, 14:43

So habe hier mal eine Liste der Bösewichter. Vielleicht kann jemand mal drüber schauen ob hier vielleicht einer drin ist, den man lieber lassen sollte.

#SetEnvIfNoCase User-Agent "^Mozilla/??$" banned
SetEnvIfNoCase User-Agent "^(google|i?explorer?\.exe|(MS)?IE( [0-9.]+)?[ ]?(Compatible( Browser)?)?)$" banned
SetEnvIfNoCase User-Agent "^(Mozilla( [0-9.]+)?[ ]?\((Windows|Linux|(IE )?Compatible)\))$" banned
SetEnvIfNoCase User-Agent "^[A-Z]+$" banned
SetEnvIfNoCase User-Agent "^DA d.d+" banned
SetEnvIfNoCase User-Agent "^Download" banned
SetEnvIfNoCase User-Agent "^IE d.d Compatible.*Browser$" banned
SetEnvIfNoCase User-Agent "^Internet Explore" banned
SetEnvIfNoCase User-Agent "^Mozilla/.+[. ]+$" banned
SetEnvIfNoCase User-Agent "^Mozilla/[0-9.]+ \(compatible; MSIE [0-9.]+; Windows( NT)?( [0-9.]*)?;[0-9./ ]*\)?$" banned
SetEnvIfNoCase User-Agent "^Mozilla/4.0$" banned
SetEnvIfNoCase User-Agent "^Mozilla/5\.0 \(X11; U; Linux i686; en-US; rv\:0\.9\.6\+\) Gecko/2001112$" banned
SetEnvIfNoCase User-Agent "^MSIE\ 6\.0 \(compatible;" banned
SetEnvIfNoCase User-Agent "^NG" banned
SetEnvIfNoCase User-Agent "4\.0 Robot\) Microsoft.*$" banned
SetEnvIfNoCase User-Agent "adressendeutschland.*$" banned
SetEnvIfNoCase User-Agent "AmigaOs/MC680x0.*$" banned
SetEnvIfNoCase User-Agent "anarchie" banned
SetEnvIfNoCase User-Agent "Atomz" banned
SetEnvIfNoCase User-Agent "biz-Spider_for.*$" banned
SetEnvIfNoCase User-Agent "BlackWidow" banned
SetEnvIfNoCase User-Agent "Bot\ mailto:craftbot@yahoo.com" banned
SetEnvIfNoCase User-Agent "Check\&Get.*$" banned
SetEnvIfNoCase User-Agent "cherry.?picker" banned
SetEnvIfNoCase User-Agent "ChinaClaw" banned
SetEnvIfNoCase User-Agent "Cobra Development.*$" banned
SetEnvIfNoCase User-Agent "compatible ; MSIE 6.0?" banned
SetEnvIfNoCase User-Agent "compatible; MSIE 4\.5; Windows.*$" banned
SetEnvIfNoCase User-Agent "Crazy Browser" banned
SetEnvIfNoCase User-Agent "crescent" banned
SetEnvIfNoCase User-Agent "Custo" banned
SetEnvIfNoCase User-Agent "DISCo" banned
SetEnvIfNoCase User-Agent "Download\ Demon" banned
SetEnvIfNoCase User-Agent "DTS Agent" banned
SetEnvIfNoCase User-Agent "e?mail.?(collector|magnet|reaper|siphon|sweeper|h arvest|collect|wolf)" banned
SetEnvIfNoCase User-Agent "EasyDL/d.d+" banned
SetEnvIfNoCase User-Agent "eCatch" banned
SetEnvIfNoCase User-Agent "efp@gmx.net" banned
SetEnvIfNoCase User-Agent "EirGrabber" banned
SetEnvIfNoCase User-Agent "email" banned
SetEnvIfNoCase User-Agent "EmailSiphon" banned
SetEnvIfNoCase User-Agent "EmailWolf" banned
SetEnvIfNoCase User-Agent "Enterprise_Search" banned
SetEnvIfNoCase User-Agent "express" banned
SetEnvIfNoCase User-Agent "Express\ WebPictures" banned
SetEnvIfNoCase User-Agent "extractor" banned
SetEnvIfNoCase User-Agent "ExtractorPro" banned
SetEnvIfNoCase User-Agent "EyeNetIE" banned
SetEnvIfNoCase User-Agent "fake\-agent" banned
SetEnvIfNoCase User-Agent "Fetch API Request" banned
SetEnvIfNoCase User-Agent "flashget" banned
SetEnvIfNoCase User-Agent "FlickBot" banned
SetEnvIfNoCase User-Agent "FrontPage" banned
SetEnvIfNoCase User-Agent "getright" banned
SetEnvIfNoCase User-Agent "GetWeb!" banned
SetEnvIfNoCase User-Agent "Go-Ahead-Got-It" banned
SetEnvIfNoCase User-Agent "Go!Zilla" banned
SetEnvIfNoCase User-Agent "go.?zilla" banned
SetEnvIfNoCase User-Agent "grabber" banned
SetEnvIfNoCase User-Agent "GrabNet" banned
SetEnvIfNoCase User-Agent "Grafula" banned
SetEnvIfNoCase User-Agent "harvest" banned
SetEnvIfNoCase User-Agent "HMView" banned
SetEnvIfNoCase User-Agent "httrack" banned
SetEnvIfNoCase User-Agent "Image\ Stripper" banned
SetEnvIfNoCase User-Agent "Image\ Sucker" banned
SetEnvIfNoCase User-Agent "imagefetch" banned
SetEnvIfNoCase User-Agent "Indy\ Library" banned
SetEnvIfNoCase User-Agent "InterGET" banned
SetEnvIfNoCase User-Agent "Internet Explorer" banned
SetEnvIfNoCase User-Agent "Internet\ Ninja" banned
SetEnvIfNoCase User-Agent "JetCar" banned
SetEnvIfNoCase User-Agent "JOC\ Web\ Spider" banned
SetEnvIfNoCase User-Agent "larbin" banned
SetEnvIfNoCase User-Agent "LeechFTP" banned
SetEnvIfNoCase User-Agent "LinkExplore" banned
SetEnvIfNoCase User-Agent "LINKS ARoMATIZED" banned
SetEnvIfNoCase User-Agent "Mass\ Downloader" banned
SetEnvIfNoCase User-Agent "Maxthon.*$" banned
SetEnvIfNoCase User-Agent "Microsoft Data Access.*$" banned
SetEnvIfNoCase User-Agent "Microsoft URL Control" banned
SetEnvIfNoCase User-Agent "MIDown\ tool" banned
SetEnvIfNoCase User-Agent "mister pix" banned
SetEnvIfNoCase User-Agent "Mister\ PiX" banned
SetEnvIfNoCase User-Agent "MSIECrawler" banned
SetEnvIfNoCase User-Agent "Navroad" banned
SetEnvIfNoCase User-Agent "NearSite" banned
SetEnvIfNoCase User-Agent "net.?(ants|mechanic|spider|vampire|zip)" banned
SetEnvIfNoCase User-Agent "Net\ Vampire" banned
SetEnvIfNoCase User-Agent "NetAnts" banned
SetEnvIfNoCase User-Agent "NetSpider" banned
SetEnvIfNoCase User-Agent "NetZIP" banned
SetEnvIfNoCase User-Agent "nicerspro" banned
SetEnvIfNoCase User-Agent "ninja" banned
SetEnvIfNoCase User-Agent "NPBot" banned
SetEnvIfNoCase User-Agent "Octopus" banned
SetEnvIfNoCase User-Agent "offline" banned
SetEnvIfNoCase User-Agent "Offline\ Explorer" banned
SetEnvIfNoCase User-Agent "Offline\ Navigator" banned
SetEnvIfNoCase User-Agent "PageGrabber" banned
SetEnvIfNoCase User-Agent "Papa\ Foto" banned
SetEnvIfNoCase User-Agent "pavuk" banned
SetEnvIfNoCase User-Agent "pavuk/[0-9.]+" banned
SetEnvIfNoCase User-Agent "pcBrowser" banned
SetEnvIfNoCase User-Agent "pd02_[09.]+.*$" banned
SetEnvIfNoCase User-Agent "PersonaPilot" banned
SetEnvIfNoCase User-Agent "port-agent" banned
SetEnvIfNoCase User-Agent "pranks4fun" banned
SetEnvIfNoCase User-Agent "Program Shareware.*$" banned
SetEnvIfNoCase User-Agent "Proxtrans" banned
SetEnvIfNoCase User-Agent "RealDownload" banned
SetEnvIfNoCase User-Agent "ReGet" banned
SetEnvIfNoCase User-Agent "SAFEXPLORER TL.*$" banned
SetEnvIfNoCase User-Agent "SiteSnagger" banned
SetEnvIfNoCase User-Agent "SmartDownload" banned
SetEnvIfNoCase User-Agent "snagger" banned
SetEnvIfNoCase User-Agent "Snoopy_v" banned
SetEnvIfNoCase User-Agent "Sqworm" banned
SetEnvIfNoCase User-Agent "SuperBot" banned
SetEnvIfNoCase User-Agent "SuperHTTP" banned
SetEnvIfNoCase User-Agent "Surfbot" banned
SetEnvIfNoCase User-Agent "SurveyBot" banned
SetEnvIfNoCase User-Agent "tAkeOut" banned
SetEnvIfNoCase User-Agent "tele(port|soft)" banned
SetEnvIfNoCase User-Agent "Teleport\ Pro" banned
SetEnvIfNoCase User-Agent "TurnitinBot" banned
SetEnvIfNoCase User-Agent "vayala" banned
SetEnvIfNoCase User-Agent "VoidEYE" banned
SetEnvIfNoCase User-Agent "web.?(auto|bandit|collector|copier|devil|download er|fetch|hook|mole|miner|mirror|reaper|sauger|suck er|site|snake|stripper|weasel|zip)" banned
SetEnvIfNoCase User-Agent "Web\ Image\ Collector" banned
SetEnvIfNoCase User-Agent "Web\ Sucker" banned
SetEnvIfNoCase User-Agent "WebAuto" banned
SetEnvIfNoCase User-Agent "WebCopier" banned
SetEnvIfNoCase User-Agent "WebDAV" banned
SetEnvIfNoCase User-Agent "WebFetch" banned
SetEnvIfNoCase User-Agent "WebGo\ IS" banned
SetEnvIfNoCase User-Agent "WebLeacher" banned
SetEnvIfNoCase User-Agent "WebReaper" banned
SetEnvIfNoCase User-Agent "WebSauger" banned
SetEnvIfNoCase User-Agent "Website\ eXtractor" banned
SetEnvIfNoCase User-Agent "Website\ Quester" banned
SetEnvIfNoCase User-Agent "WebStripper" banned
SetEnvIfNoCase User-Agent "WebWhacker" banned
SetEnvIfNoCase User-Agent "WebZIP" banned
SetEnvIfNoCase User-Agent "Wget" banned
SetEnvIfNoCase User-Agent "Widow" banned
SetEnvIfNoCase User-Agent "WinHttp\.WinHttpRequest.*$" banned
SetEnvIfNoCase User-Agent "WWWOFFLE" banned
SetEnvIfNoCase User-Agent "Xaldon\ WebSpider" banned
SetEnvIfNoCase User-Agent "YANDEX.*$" banned
SetEnvIfNoCase User-Agent "zeus" banned

Anzeige von ABAKUS

von Anzeige von ABAKUS »


Hochwertiger Linkaufbau bei ABAKUS:
  • Google-konformer Linkaufbau
  • nachhaltiges Ranking
  • Linkbuilding Angebote zu fairen Preisen
  • internationale Backlinks
Wir bieten Beratung und Umsetzung.
Jetzt anfragen: 0511 / 300325-0

thetrasher
PostRank 5
PostRank 5
Beiträge: 238
Registriert: 31.12.2005, 10:50
Wohnort: Bad Tölz

Beitrag von thetrasher » 28.04.2006, 21:18

Déjà-vu?

Deine Idee ist gut - wenn die Botbetreiber die User-Agent-Kennung nicht ändern könnten.

Selbst "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)" muss kein Browser sein: https://www.abakus-internet-marketing.d ... 20525.html

Franchesco
PostRank 3
PostRank 3
Beiträge: 66
Registriert: 04.05.2006, 08:42

Beitrag von Franchesco » 04.05.2006, 13:30

Hi. Kann man denn Easys Liste bedenkenlos übernehmen?

Tschau
Frankchesco

Antworten
  • Vergleichbare Themen
    Antworten
    Zugriffe
    Letzter Beitrag