Evolution alarms won't go away

Binary package hint: evolution

evolution 2.27.91-0ubuntu1

I'm using Karmic, and I have a lot of events set up in my calendar. When I added the calendars, it proceeded to generate alarms for a bunch of past events as well as the ones in the near future. It's about 37 right now.
When I bring up the list of alarms, and tell it to dismiss all, the window closes. But a little bit later, they all come back, along with the notification boxes. 37 of them.
And something is happening with it in the tray. I'm using the notification tray in Awn, and it leaves an empty space that gives the tooltip that there are 37 alarms. And each time it comes back it leaves another empty space. I had to do a killall evolution-alarm-notify to get them to go away.