We would like to exclude certain parts of our pages from being rendered when requested by the search indexer or other crawlers.
In v3.x, we were able to this:
// Do not render this control for the index crawler
// (we don't want the contents of this control to be indexed)
which would prevent a control's contents from rendering for the crawlers. How can we accomplish the same in 4.x?