I have checked the options and my Delete forum action is set to: Hard delete forum and forum data itself.
But the deleted groups still show to me as Admin.
The only way I can permanently delete a group is by manually going into the database and deleting the group from tl_group table and then deleting the members from the tl_group_member table.