That's fair, I haven't used my M with my EF lenses much at all, I have a full frame body.
That said, not only am I looking at upgrading to the 5D Mark IV, but the M5 still calls to me. I wish the EF-M lens selection were better though, which is the one hurdle I'm trying to address. That, or would I really just rather have a good compact like the Panasonic LX100. The new EF-M macro, if at 50mm with a moderately fast aperture, would probably join my collection. Unfortunately it's a slow 28mm. The 11-22 probably still will if I get an M5, but I'd love to see a faster midzoom. Something similar to the 17-55 2.8 IS they make for EF-S.