More in this section
Forums / Developing with Sitefinity / Indexing restricted content with Google Mini

Indexing restricted content with Google Mini

The forums are in read-only mode. In case that you want to directly contact the Progress Sitefinity team use the support center. In our Google Plus group you can find more than one thousand Sitefinity developers discussing different topics. For the Stack Overflow threads don’t forget to use the “Sitefinity” tag.
2 posts, 0 answered
  1. Jason M
    Jason M avatar
    108 posts
    15 Jan 2007
    22 Jul 2008
    Link to this post
    We've been using Google Mini (GM) to index our sites for a few years (asp, asp.NET), but can't seem to index restricted content (Deny Anonymous) in Sitefinity.  All public content indexes without any issues.

    I've set up our login page to automatically authenticate our GM (using IP and other criteria) and this works fine with non-Sitefinity .NET content.  With Sitefinity content I notice 5 redirects in the "Crawl Diagnostics" section before GM drops these pages.  Anyone else had success with this?

    All of the Google forums recommend an upgrade to the Google Search Appliance, but I'd prefer using our existing GM and saving $$.

    I'm contemplating adding the auto login logic to the restricted .master pages of this content, but wanted to see if anyone else had success.

  2. Nikola
    Nikola avatar
    51 posts
    24 Sep 2012
    24 Jul 2008
    Link to this post
    Hi Jason M,

    Sitefinity is using either Windows or Forms authentication, so without appropriate authentication you won't be able to gain access to the restricted Sitefinity pages. And as far as I know Google Mini doesn't support Forms Authentication.

    A possible workaround would be to create a custom HttpModule which runs prior the Sitefinity's HttpModule and perform a check wherever the request is from Google Mini, and Authenticate it.

    Beware that such implementation could lead to security risk, so proceed with caution.

    the Telerik team

    Check out Telerik Trainer, the state of the art learning tool for Telerik products.
2 posts, 0 answered