You can delete a custom collection by going to the edit Custom Collection form. First you must select the collection that you wish to rename in your collection list on the Collection tab. Once it is selected you will see an edit link:
From the edit collection form you can delete your custom collection by clicking the delete button in the upper right corner:
When you delete a Custom Collection it does remove the cards from your overall collection, it simply removes the Custom Collection.