How about getting a used 5D Mark II, if you can't swing the 6D right now?
I usually try to talk people out of full frame, since I think most don't really need it... But you are definitely a prime candidate for it. Full frame cameras' real fortés are: 1. Low light shooting and 2. Image enlargeability.
7D is a fine camera. I've had two of them for over four years. They are my main users and have taken a couple hundred thousand images. The 7D's features make it an especially good sports/action camera, a better "AI Servo" camera than 50D (which I have, too). But that's not what you are looking for.
7D does not especially improve upon 50D for your needs. IQ is only very modestly improved, it's images are no more enlargeable. It's able to do about one stop higher ISO. 7D is better built and sealed, but it is no better focusing in One Shot and low light.
In comparison, 5DII (which I also use) has a significant "full frame enlargeablity"advantage, is about two stops higher ISO capable than 50D (about one stop higher than 7D). It even manages to continue focus, tho slowly, in slightly lower light than 7D. It's not as good at low light focusing as 6D (center point only) or 5DIII, but my 5DII is still able to focus (center point only, too). 5DII is definitely not a sports/action "AI Servo" camera. But it's fine for stationary subject, "One Shot" work.
So, I'd say no.... don't go to 7D. Go to 5DII or 6D instead. Either of them will serve your particular purposes better.