Completed tasks are always saved but aren't necessarily displayed.

To change whether they are displayed or not, do the following:

1. Click the "Options" link in the upper-right corner of the calendar page.
2. Click the "Tasks" link.
3. From the Completed Tasks box, select "Hide completed tasks" or "Display in calendar on day completed."