Thank you for your question!
is specific to Sitefinity's crawler. If you want to determine if a bot is requesting your page you could create a list with all User Agents (http://user-agents.org/) and check on every Http Request for a User Agent which match with some in your list.
I hope you find this information helpful.
the Telerik team
Check out Telerik Trainer
, the state of the art learning tool for Telerik products.