Click the folder name to open the folder. Then, at the top of the list of messages, you'll see two links next to the folder name -- Rename and Delete. Click Delete. That's it!