In 'Settings/Users/Access management', enable the right: 'Delete a customer'.
You can delete a customer if the customer is not linked to a sale or a store credit movement.
In this case, you will find a 'Delete' button in the customer form.
To respect the GDPR law, you can anonymise a customer form. More information.