Was that category assigned to any content items before you deleted it? I suppose the last taxon wasn't deleted correctly and there are leftovers of it in the database, which is causing the problem. If there are any items that had that category assigned to them, you can try deleting them and see if the issue is cleared. Also, you can search in the database for any references to the taxon with the ID from the error and delete them with a query.
the Telerik team
Do you want to have your say in the Sitefinity development roadmap? Do you want to know when a feature you requested is added or when a bug fixed? Explore the Telerik Public Issue Tracking
system and vote to affect the priority of the items