If you're trying to light the whole backdrop with a Speedlite, that's about as good as it's gonna get.
However, you could zoom the flash to 105mm and snoot it with something like a soup can, to create a more concentrated area of color that will vignette nicely for an individual portrait. This will concentrate the light such that you can crank up the power of the main and fill without overpowering the color.
You should be able to go up to 1/2 power without issue, as long as there is a little breathing room between the flash lens and the gel. At full power, you'll run into frustrations with recycle time.
Also, don't give up on using a studio strobe and a fabric backdrop. I think with more experimentation you'll be able to produce something that will be pleasing and useful.