Actually you wouldn't be crazy at all...
If you like the larger size cameras, but don't need all the features of 7D, get the 60D.
If you are okay with the smaller Rebels, get the T3i if you want the articulated LCD screen (which the 60D has too), or if you don't need that, save a few more $ and get the T2i.
They are all 18MP cameras - same as 7D - and capable of essentially the same image quality and high ISO performance.
The only reason to keep the 7D would be if you need the extra features for your particular shooting... The most obvious features are the fancier AF modes, but the biggect performance difference is with AI Servo and tracking moving subjects. If you don't do that type of shooting very much, it's sort of a waste to pay for it.
Some more subtle features that are unique to 7D are the additional AF points (19 vs 9), the 100% viewfinder, Micro Focus adjust, more configurable controls, additional sealing and higher durability rated shutter (150,000, compared to 100K in 60D and 75K in the Rebels).
The 60D and 7D also have 1/250 flash sync and 1/8000 top shutter speed (compared to 1/200 and 1/4000 on the Rebels). All the AF points in the 60D and 7D are the more sensitive "cross" type. Only the center point on the Rebels is the cross-type.
7D is a mostly metal (magnesium) shell over a metal frame. 60D is a more polycarbonate shell over a metal frame (making it lighter in weight). The Rebel series are more polycarbonate throughout.