More in this section

Forums / Bugs & Issues / Default directories NOT to include in robots.txt

Default directories NOT to include in robots.txt

1 posts, 0 answered
  1. Liz
    Liz avatar
    0 posts
    Registered:
    12 May 2016
    28 Feb
    Link to this post

    Does anyone have a standard protocol for which directories to disallow in a robots.txt file for Sitefinity deployment?   For example, platforms like wordpress recommend certain directories to disallow (/wp-admin/, /wp-content/, /wp-includes/, etc.).   

    Obviously Sitefinity is far more advanced than wordpress, but the principle is the same.  

    So, I'm curious if such advice exists from fellow users or from Sitefinity themselves.  

     

    Thanks,

    Liz

     

1 posts, 0 answered