Path : Admin >> Expenses >> Tags >> Actions >> Deactivate
Deletion cannot be possible. However we can deactivate the tag.