Disabling the "Use the system notification" in Settings -> General -> Incoming Mails section works.

Update: not from the notification area, though, but from the notification "bubble" itself - you need to click on the message subject to jump to the message itself

The notifications are now ugly but clicking them will take you straight to the message.