OK Karl, time for some basic terminology so that you can describe it better...it is kinda like being a doctor with a patient who simply says "It hurts"!
Ballheads often have 1) an upper main body section with the socket for the ball and controls, 2) the ball, the 3) camera base or quick release (partially visible at top), and a 4) lower panning base section that allows the main section to spin 360 degrees so that you can pan the camera -- rather than releasing the ball to do so. The center column has the 5) column, and the 'tripod base plate'.
Here you can see a ballhead mounted on the baseplate of a Bogen 3221 (Manfrotto). The baseplate is grayish, the panning base is the black section with the white index mark just below the numbers (angle of rotation), and the main body of the ballhead is the big black part with the numbers (angle of rotation).
Here you can see the 6) center column, and the 7) tripod base plate, and also see the three holes (8 ) where the set screws (not shown) are found on the Manfrotto.
So using the generic list of sections, tell us what you have tried, whether or not you found and loosened the set screws. And just maybe the center thread has come loose within the tripod baseplate...Gitzo's thread screws in, so that you can choose either 1/4" or 3/8" threads for the head to screw onto.