Something that hasn't been brought up yet, it's not all about speed either. The Extreme cards are built to withstand more extreme temperatures, for example the CF Extreme can operate between -25°C to 85°C.
Can't find any numbers on the Ultra cards, but at least the Extreme series are marketed as better in this aspect. And if I recall correctly I did see some numbers a few years ago when I decided which series I should get, and the temperature difference was enough to decide for me.

