Welp, I listed some things to sell. Time to raise some funds.
My 1Ds II, EOS-M kit and some flash kit are all on the books to go bye bye. With funds raised, I'll likely move to a 1D3 (I recently went birding and it's actually weird, but I prefer a crop for birding, so will sell one of my full frames) and a Fuji X100S, with a bit out of pocket to go that way.
Looking back over everything, I have gone over the Sony options, Fuji and a few M43 options again. Deep down I'd love to get a full on full frame Sony with eye/face detect. But, I recently found one piece of media that finally swayed my choice on what I will try for a small large sensor compact. I looked at the size comparison of a Fuji X100 series to the EOS-M and it was like 10~15mm difference overall in HxL. It's still very small. The EOS-M is very small to me (for the sensor size). I'm already completely happy with a 35mm FOV, so it seems this is the right way to go for my check boxes. The size really got me though. I thought it would be big. But it's quite small. Especially in the context of my 5D or 1Ds series bodies which are much bigger and far far heavier.
So the shopping begins. I'm thinking an X100S will do the job.
Thanks to everyone for the opinions and ideas.
I'll report back when I have something in my hands.