Format robots.txt

The following unexpected content was also found in the robots.txt file which does not comply with the current "Robots Exclusion Standard". If directed to a specific User-Agent (search engine robot) that accepts the following directives, then you can ignore this message. Please verify the robots.txt file before submitting to search engines:

1. " Gulliver <- a new "User-Agent" directive requires an empty line above it
2. User-agent: Snap <- a new "User-Agent" directive requires an empty line above it
3. User-agent: looksmart <- a new "User-Agent" directive requires an empty line above it
.....

The file consists of one or more records separated by one or more blank lines (terminated by CR,CR/NL, or NL)

antonia hat geschrieben:

1. " Gulliver <- a new "User-Agent" directive requires an empty line above it

Das bedeutet doch, das vor jedem "User-agent: .." eine Lerzeile stehen soll?!