You can delete multiple Clients at a time the Client Explorer by holding down Shift (to select a series) or Ctrl (to select outside of a series).
If a Client is associated with Project, Task, Service Order, or Service Plan then the Client cannot be deleted and you will see a message similar to the one below prompting you to mark the Client as "Inactive".