Josh, you are right. Removing the Generic Content module will remove the Tags & Categories control as well. This module is adding the control dynamically when it loads. Unfortunately this is the only way (for now) to remove the Tags & Categories from the toolbox.
the Telerik team
Check out Telerik Trainer
, the state of the art learning tool for Telerik products.