+ Reply to Thread
Results 1 to 4 of 4

Thread: What is the limit of a robot.txt file?

  1. #1
    HWHT Addict pihu147741 is on a distinguished road
    Join Date
    Oct 2017
    Location
    Jaipur
    Posts
    33

    What is the limit of a robot.txt file?

    Hello friends,


    What is the limit of a robot.txt file?

  2. #2
    HWHT Starter onlive-server is on a distinguished road
    Join Date
    Feb 2018
    Location
    Norway
    Posts
    1
    Hello,

    It is recommend that the size of robot.txt file <= 500 kilobytes.

  3. #3
    SuperExpert RepriseH is on a distinguished road
    Join Date
    Jul 2017
    Location
    India
    Posts
    751
    Google spiders crawl only 500KB of the text file. Hence it is better to upload a maximum of 500KB for your robots.txt file.
    Cheap VPS | $1 VPS Hosting
    Cheap Dedicated Servers | Dedicated Servers starting from $29/MO

  4. #4
    HWHT Starter DavidMichael is on a distinguished road
    Join Date
    Jun 2018
    Location
    MD, USA
    Posts
    10
    The limit of robot.txt file is 500kb.

+ Reply to Thread

Similar Threads

  1. What is the limit of a robot.txt file?
    By artijain1900 in forum Search Engine Optimization
    Replies: 1
    Last Post: 04-03-2018, 05:41 AM
  2. what is limit set for the number or characters for Adwords.?
    By ruhikhan in forum Search Engine Optimization
    Replies: 0
    Last Post: 03-19-2018, 07:47 AM
  3. Is Empty .java file name a valid source file name?
    By sydneyearplug in forum Web / Graphic Design , Web Development Requests
    Replies: 0
    Last Post: 02-22-2018, 09:28 AM
  4. Mention what is the limit set for the number or characters for Adwords ad?
    By sydneyearplug in forum Search Engine Optimization
    Replies: 0
    Last Post: 01-08-2018, 08:12 AM
  5. How to Submit Robot.txt File In Webmaster..?
    By Sanusaini in forum Search Engine Optimization
    Replies: 3
    Last Post: 10-18-2017, 12:09 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts