Click Actions > Delete from the people menu to permanently delete the person from Float. All of their assigned tasks will be deleted as well.
If the person was the Project Owner on a project, ownership is transferred to the Account Owner.
Once a person is deleted, they are gone forever. Try archiving them instead if forever seems like a long time.