How do I delete a tag?

To delete a tag - that is, remove it completely from the project, including from all objects that have the tag - click the "Manage tags" link next to the "Add a tag" link, for example in the popup dialog for a backlog item. Then click on the tag that you want to delete, to open its popup, then click the "Delete" link in the lower left corner of the popup: