Results 1 to 3 of 3

Thread: Recommended Robots.txt

    1. Recommended Robots.txt

      Recommended Robots.txt

      By: (Administrator) Tempus is offline 27th Dec 2011 09:37
      Rating: 
      Alot of forums forget to install a robots.txt file allowing bots to crawl all over the place , potentially opening them selves up to security issues and increase bandwidth usage , here is a recommended Robot.txt file for vbulletin forums :

      Code:
      Only registered members can view code.
      Create a new file in notepad etc, paste the above code into it and save it as robots.txt. Then upload it to your forum root.
  • #2
    Junior Member
    Click to Expand
    Join Date
    Sep 2012
    Posts
    4
    vB Version
    4.2.x
    Likes
    3
    Liked 1 Time in 1 Post
    I'm using other robot.txt:
    Code:
    Only registered members can view code.
    search.php is open for robots and adsense to index more pages.

  • #3
    Junior Member jfla94's Avatar
    Click to Expand
    Join Date
    Aug 2014
    Posts
    8
    vB Version
    3.8.x
    Likes
    1
    Liked 1 Time in 1 Post
    Gender
    Male
    exelent

  • Tags for this Thread

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •