Deletion cannot be possible. However we can deactivate it.
Path : Admin >>Expenses >> Expenses >> Actions >> Deactivate