Here’s how:
Look just above the list of names in your Contact List for the message “type some contact information…”.
On the right end of that bar is a down-arrow. Click the down-arrow to open a menu of viewing options.
Quick, eh? Now just click on a selection to either show (or hide) offline contacts, show (or hide) your Address Book contacts, or show (or hide) empty groups in your Contact List.