Blocking certain Search Engine Robots

  • Betroffene Version
    WoltLab Suite 3.0

    Hi,

    I'm looking for a way to block certain Search Engine Robots on my website. How can I do this in WoltLab?

    Thanks,

    Walter

  • Unfortunately robots.txt only works with legit searchbots and is a convention, not a rule. I want to block the bad searchbots and spiders but am unable to do this. Even blocking their IP is apparently useless.

    For info : with the free forumsoftware I used in the past, this was easily manageble.

  • By .htaccess you can block it with:

    Apache Configuration
    <IfModule mod_rewrite.c>
        RewriteCond %{HTTP_USER_AGENT} baidu [NC]
        RewriteRule .* - [F,L]
    </IfModule>

    By robot.txt you'll choose:

    Code
    User-agent: Baiduspider
    Disallow: /

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!