Can I delete a customer?

Yes, you can.

In the Customers module, click on a customer you wish to delete. In the customer details page, click on More in the top right corner and select Delete from the drop-down.

Note: You will not be able to delete a customer if any transactions have been created for it. The transactions for the particular customer have to be deleted first after which you can proceed to delete the customer.