Why can't I delete some contact lists?

If a contact list is referenced in a Campaign, or Workflow Action (Send to sales, Send to Marketing) the list, you will not be able to delete the list until the references are removed. References to lists by objects (Campaigns, Workflow Actions) that are in the trash retain their referenced list associations, thus you may want to empty your trash to remove references.