1-888-365-2779
+1-888-365-2779
Try Now
More in this section

Forums / Developing with Sitefinity / Indexing restricted content with Google Mini

Indexing restricted content with Google Mini

2 posts, 0 answered
  1. Jason M
    Jason M avatar
    108 posts
    Registered:
    15 Jan 2007
    22 Jul 2008
    Link to this post
    We've been using Google Mini (GM) to index our sites for a few years (asp, asp.NET), but can't seem to index restricted content (Deny Anonymous) in Sitefinity.  All public content indexes without any issues.

    I've set up our login page to automatically authenticate our GM (using IP and other criteria) and this works fine with non-Sitefinity .NET content.  With Sitefinity content I notice 5 redirects in the "Crawl Diagnostics" section before GM drops these pages.  Anyone else had success with this?

    All of the Google forums recommend an upgrade to the Google Search Appliance, but I'd prefer using our existing GM and saving $$.

    I'm contemplating adding the auto login logic to the restricted .master pages of this content, but wanted to see if anyone else had success.

    J
  2. Nikola
    Nikola avatar
    51 posts
    Registered:
    24 Sep 2012
    24 Jul 2008
    Link to this post
    Hi Jason M,

    Sitefinity is using either Windows or Forms authentication, so without appropriate authentication you won't be able to gain access to the restricted Sitefinity pages. And as far as I know Google Mini doesn't support Forms Authentication.

    A possible workaround would be to create a custom HttpModule which runs prior the Sitefinity's HttpModule and perform a check wherever the request is from Google Mini, and Authenticate it.

    Beware that such implementation could lead to security risk, so proceed with caution.

    Greetings,
    Nikola
    the Telerik team

    Check out Telerik Trainer, the state of the art learning tool for Telerik products.
2 posts, 0 answered