I've handled lots of cameras with lots of different sensor formats over the years. Personally I don't find the sensor size itself to really change all that much with how I use a camera, and that aspect feels no different than changing to a different lens.
What is different is how things actually function. Dynamic range, controls, weight, etc. All of those issues have an actual impact, where as the sensor size really doesn't do much beyond feel a little different for the first few seconds you're looking through the eye piece.
I once had to take a photo for some friends with another's friend's 5D with 40mm while initially thinking it was my 7D with the same lens. Owner of the 5D had grabbed my camera off the table to run off and do something else, and I hadn't realized that I was holding the wrong camera till it was halfway to my eye. The change in angle of view was far less of an impact on taking the photo than the camera having completely different controls than what I was expecting.
But I have used image sensors that ranged from the size of the eye of a large sewing needle, up to a 10'x10' one. (Yes, feet, not inches.) It really isn't something worth dwelling on. Focus on what you want to do with your photography, and find gear that meets those needs.
Canon EOS 7D | EF 28 f/1.8 | EF 85 f/1.8 | EF 70-200 f/4L | EF-S 17-55 | Sigma 150-500
Flickr: Real-Luckless