Wow, so many different ideas. If family pictures are at the top of you list, you already have a great portrait lens, the 50mm f1.8. To supplement that for outdoor portraits I would add the
Canon 85, f1.8. I hadn't thought of a flash, but that is an excellent idea. Perhaps a 400, 500, or 600 series Canon flash- would look for a used one to save money. You would still have money left over for a 55-250 for those other type of pictures. The only disadvantage I see with this set-up is that one day you will probably want to replace the 55-250 with something better, though you wouldn't have spent that much on it so you won't lose that much on it either if you sell it. If you want to start at the top, then keep what you have and add a Canon 70-200L f4 IS or a Canon 70-300L IS. Neither of those would be a first choice for portraits on a crop body, especially indoors, but they are both great lenses which I'm sure you will enjoy and will hold their value if you ever wish to sell them.
If you get the flash be sure to visit the site that stsva linked to, and buy his first book too. Lastly, forget about the 24-105L unless you go full frame.