You can delete a task template when it is no longer needed. Deleting a task template will not affect any tasks that have been created from it.
Requirements: You must have a project role that includes the Task Administrator right.