Definitely not an easy decision here by any stretch. I've actually had both as well and ended up selling the 24 TS-E II. I know you guys are going to think I'm crazy, but I needed the flexibility of AF and the low-light capabilities of f1.4.
If you have the money to have another more flexible lens in the same focal range, the TS-E II is an easy decision. In my case, I wanted the capability to take indoor shots of my son and other family members at events. The 24 TS-E doesn't excel in this area - it's just too slow for indoor use in dim lighting without a tripod and the need to manually focus means a lot of missed shots unless your subject is static.
One note on size, the 24 TS-E II seems gigantic compared to the 24 f1.4. For travel I'd definitely prefer the latter as it's more discreet and the weather sealing is a bonus. I took my TS-E to Hawaii last year and I was constantly worried about getting water or sand inside the lens. No question the 24 TS-E is a better 'pure landscape/architecture' lens, but it's lack of flexibility will mean a lot of missed shots if you intend to use it as a general purpose 24mm.
Good luck with your decision!