Results 1 to 2 of 2

Thread: Recommended Robots.txt

    1. Recommended Robots.txt

      Recommended Robots.txt

      By: (Administrator) Tempus is offline 27th Dec 2011 09:37
      Alot of forums forget to install a robots.txt file allowing bots to crawl all over the place , potentially opening them selves up to security issues and increase bandwidth usage , here is a recommended Robot.txt file for vbulletin forums :

      Only registered members can view code.
      Create a new file in notepad etc, paste the above code into it and save it as robots.txt. Then upload it to your forum root.
  • #2
    On Probation
    Click to Expand
    Join Date
    Sep 2012
    vB Version
    Liked 1 Time in 1 Post
    I'm using other robot.txt:
    Only registered members can view code.
    search.php is open for robots and adsense to index more pages.

  • Tags for this Thread

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts