+1-888-365-2779
Try Now
More in this section

Forums / General Discussions / Allow search engines to index this page

Allow search engines to index this page

20 posts, 1 answered
  1. Noah
    Noah avatar
    6 posts
    Registered:
    22 Dec 2008
    03 Mar 2011
    Link to this post
    Hello,

    Editing a Page Title and Properties, under the Advanced Options, is a checkbox, "Allow search engines to index this page".

    I couldn't find anything in the documentation on this for 4.0.  In 3.7, it was a radio button that defaulted to yes.

    Should this default to checked?  Is there a global setting somewhere that overrides it?

    Thanks
    -Noah
  2. Ivan Dimitrov
    Ivan Dimitrov avatar
    16072 posts
    Registered:
    25 Nov 2016
    04 Mar 2011
    Link to this post
    Hello Noah,

    You can control this from the "Advanced" options of each page.

    Regards,
    Ivan Dimitrov
    the Telerik team
  3. Markus
    Markus avatar
    2763 posts
    Registered:
    25 Nov 2005
    04 Mar 2011
    Link to this post
    Dear Ivan

    When talking about search engines are we talking about google and friends?

    If yes what does it to to the page. Would not see a <meta tag?

    If this is ment to be that the page can be searched by SF internal then it should defenitely be renamed.

    Markus
  4. Noah
    Noah avatar
    6 posts
    Registered:
    22 Dec 2008
    04 Mar 2011
    Link to this post
    Hi Ivan,

    I know where it is located, but it is defaulting to unchecked.  Do you have to go through each page and enable it?

    Thanks
    -Noah
  5. Ivan Dimitrov
    Ivan Dimitrov avatar
    16072 posts
    Registered:
    25 Nov 2016
    07 Mar 2011
    Link to this post
    Hello Noah,

    In SP1 the default value for is checked . You can set the value programmatically for each pages using the fluent API.

        App.WorkWith().Pages().ForEach(p =>
                    {
                        p.Page.Crawlable = true;
                  
                    }).SaveChanges();

    Regards,
    Ivan Dimitrov
    the Telerik team
    Answered
  6. Markus
    Markus avatar
    2763 posts
    Registered:
    25 Nov 2005
    07 Mar 2011
    Link to this post
    Dear Ivan

    Can you answer my questions as well?

    Markus
  7. Ivan Dimitrov
    Ivan Dimitrov avatar
    16072 posts
    Registered:
    25 Nov 2016
    08 Mar 2011
    Link to this post
    Hello Markus,

    I believe that we are talking about the Sitefinity's search capabilities. All meta tags for the public engines can be added through page properties sections, but if the page is published and it is navigable it will be shown on the public side - this page will be accessible by the public users.

    Regards,
    Ivan Dimitrov
    the Telerik team
  8. Markus
    Markus avatar
    2763 posts
    Registered:
    25 Nov 2005
    08 Mar 2011
    Link to this post
    Thanks Ivan

    So please let me make two feature requests

    1) Rename existing to "Allow Sitefinity search engines to index this page".

    2) Make a second one "Allow external search engines to index this page".  which will set an meta robot noindex

    I think 1) is important because when I hear someone talk about Search Engines I would assume he is talking about Google and freinds (SEO)

    Markus
  9. Noah
    Noah avatar
    6 posts
    Registered:
    22 Dec 2008
    10 Mar 2011
    Link to this post
    Hi Ivan,

    I agree with Markus.  As the check box says search engines, plural, I would think it controlled external search engines such as Google.  I was under the impression that this was related to external search engines being able to index the page.  It would be helpful if the interface (and documentation which is missing on this topic), was updated to reflect which search engine(s) were affected.

    Thanks
    -Noah
  10. Markus
    Markus avatar
    2763 posts
    Registered:
    25 Nov 2005
    10 Mar 2011
    Link to this post
    @Noah

    Thanks for backing me up

    @Ivan

    When you write 'I believe ....' does that mean you are not sure?

    Markus
  11. Antoaneta
    Antoaneta avatar
    258 posts
    Registered:
    02 Nov 2015
    10 Mar 2011
    Link to this post
    Hi Markus Berchtold,

    This option is only for external search engines like Google which means that if it is enabled the page will be indexed by the external engines. 


    Greetings,
    Antoaneta
    the Telerik team
  12. Markus
    Markus avatar
    2763 posts
    Registered:
    25 Nov 2005
    10 Mar 2011
    Link to this post
    Dear Antoaneta

    Thanks for clearing that up. So it acutally makes sense.

    This leaves the question how is indexing by search engines surpressed when using this option?

    I dont see a mate robots noindex there.

    How should it work?

    Markus

    PS: How about make an extrea feature make available for internal search engine then :-)
  13. Antoaneta
    Antoaneta avatar
    258 posts
    Registered:
    02 Nov 2015
    10 Mar 2011
    Link to this post
    Hi Markus Berchtold,

    If you uncheck this option the page will not be indexed by the search engines, but will still be indexed internally.

    Kind regards,
    Antoaneta
    the Telerik team
  14. Markus
    Markus avatar
    2763 posts
    Registered:
    25 Nov 2005
    10 Mar 2011
    Link to this post
    Dear Antoaneta

    <meta name="robots" content="noindex" /> is really present when unchecked. Sorry missed that.

    Would it still make sense to have a secend option for SF internal search?

    markus
  15. Antoaneta
    Antoaneta avatar
    258 posts
    Registered:
    02 Nov 2015
    10 Mar 2011
    Link to this post
    Hello Markus ,

    I believe that such an option is not needed at this moment but I will discuss it internally with the team to get more opinions.

    Best wishes,
    Antoaneta
    the Telerik team
  16. Brett Winklesky
    Brett Winklesky avatar
    6 posts
    Registered:
    10 Dec 2009
    26 Apr 2011
    Link to this post
    @Antoaneta

    Is this functionality still working in 4.1?  I unchecked the "index" option and I'm not seeing a "noindex" meta tag.

    Brett
  17. Pavel Iliev
    Pavel Iliev avatar
    140 posts
    Registered:
    18 Jul 2016
    29 Apr 2011
    Link to this post
    Hi Brett ,

    Yes, it is working. Could you double check please? If it is still not working, please tell us if the template of the page is based on a master page.

    Best wishes,
    Pavel
    the Telerik team

  18. Brett Winklesky
    Brett Winklesky avatar
    6 posts
    Registered:
    10 Dec 2009
    02 May 2011
    Link to this post
    Hi-

    This functionality isn't working on the projects we are using templates based off of Master Page files.  I assume this is a bug? 

    BW
  19. Pavel Iliev
    Pavel Iliev avatar
    140 posts
    Registered:
    18 Jul 2016
    09 May 2011
    Link to this post
    Hello Brett,

    Yes it is a bug, we'll fix it for the service pack. I am sorry for the inconvenience caused.

    Best wishes,
    Pavel
    the Telerik team
    Do you want to have your say in the Sitefinity development roadmap? Do you want to know when a feature you requested is added or when a bug fixed? Explore the Telerik Public Issue Tracking system and vote to affect the priority of the items
  20. Charl
    Charl avatar
    22 posts
    Registered:
    05 Jun 2013
    18 Feb 2014
    Link to this post
    We have started a discussion on this feature and would like to invite you to share your feedback here: 

    http://www.sitefinity.com/developer-network/forums/sitefinity-preview/upcoming-features/exclude-pages-from-sitefinity-search

    We will be happy to hear your specific cases and scenarios in regards to excluding pages from SiteFinity search. 

    Thank you in advance.
    Charl









20 posts, 1 answered