Navigate to the Site via Content >> Sites >> Select the Site
Locate the three dots menu at the top right-hand corner and select Delete from the dropdown:
You can also remove a site from the public so that it becomes unavailable to non-admins until you are ready to open it up again via the Configure tab: