In 'Settings/Users/Access management', enable the right: 'Delete or merge customers'.

You can delete a customer if the customer is not linked to a sale or a store credit movement.
In this case, you will find a 'Delete' button in the customer form.

To respect the GDPR law, you can anonymise a customer form. More information.