logo

New Response

« Return to the blog entry

You are replying to:

    • avatar
    • Jake Howlett
    • Posted on Thu 9 Feb 2012 07:52 AM

    More specifically you would probably want to just prevent crawling of the DB which has moved. The content of the robots.txt would then be like:

    User-Agent: *

    Disallow: /database.nsf/

    # Allow ALL others

    User-agent: *

    Disallow:

Your Comments

Name:
E-mail:
(optional)
Website:
(optional)
Comment: