I used 4x5 and 35mm for years, and now use a Canon crop body for sports, NEX for manual focus rangefinder and adapted lenses, and M4/3 for just about everything else.
I think that with M4/3 or NEX crop factor is irrelevant, unless you are using legacy lenses, bacause quality lenses are available in wide and ultrawide focal lengths: 14mm/2.5; 9-18 zoom; 7-14 zoom.
For my uses, the M4/3 14mm/2.5 (28mm equiv) and 20mm/1.7 (40mm equiv) lenses see the most duty, followed by the 14-150 ultra-zoom (incredibly compact!).
The fastest AF M4/3 bodies seem to be the new E-P3, E-PL3, and GH2's; reports indicate that they are comparable to basic DSLRs in this respect. The NEX's seem to be a notch slower in AF, and more importantly, the lens selection is limited and lenses are as big as Canon lenses, losing one of the key advantages of a mirrorless body like M4/3 or NEX. OTOH, if you want to use legacy lenses, they offer a focus indicator feature called "peaking" which speeds up your work and accuracy.
Finally, the new Nikon mirrorless system seems to offer even faster AF in good light, but trades off image quality at low and moderate ISOs (!) and depth of field control.
If I had no equipment, I'd choose M4/3 again because of the lens selection and augment it with a Canon/Nikon DSLR for fast action.
Good luck on your search! They're all good choices.