More in this section
Forums / Bugs & Issues / Default directories NOT to include in robots.txt

Default directories NOT to include in robots.txt

The forums are in read-only mode. In case that you want to directly contact the Progress Sitefinity team use the support center. In our Google Plus group you can find more than one thousand Sitefinity developers discussing different topics. For the Stack Overflow threads don’t forget to use the “Sitefinity” tag.
1 posts, 0 answered
  1. Liz
    Liz avatar
    0 posts
    Registered:
    12 May 2016
    28 Feb 2017
    Link to this post

    Does anyone have a standard protocol for which directories to disallow in a robots.txt file for Sitefinity deployment?   For example, platforms like wordpress recommend certain directories to disallow (/wp-admin/, /wp-content/, /wp-includes/, etc.).   

    Obviously Sitefinity is far more advanced than wordpress, but the principle is the same.  

    So, I'm curious if such advice exists from fellow users or from Sitefinity themselves.  

     

    Thanks,

    Liz

     

1 posts, 0 answered