Now you see why people looking to change or drop out the background use a background with a strong, non-skin toned color (like green or blue) - the ability to isolate the background and create a mask in this manner is called chromakeying, or using a "green screen". If your background is not a saturated color, but instead is somewhat neutral, then there is no "chroma" upon which to key. Typically, you want to pick a background that will be in stark contrast to the subject - most caucasian skin tones are red so the red channel of the image will be very light in the areas where skin and light hair live. If the background is green or blue, then the background will be dark in the red channel - this creates good contrast between the subject and the background and permits the red channel (the grayscale rendering of the red channel) to be used as the starting point to create the mask you need to separate the subject from the background.
You could try using the neutral background and lighting it with a gelled, flagged strobe to color the background and create this contrast, if you intend to key the background in post.
kirk