On a crop sensor camera, my main portrait lenses are:
50/1.4 and 85/1.8 primes, 24-70/2.8 zoom.
I am currently experimenting with a Tamron SP 60mm f2 macro lens, too. (I'll use it when I am not sure I'll be shooting any portraits or macro and simply want to keep my camera bag to a minimum.... since the Tamron can take the place of three lenses: the 50, 85 and a 100mm macro lens.)
There are two key things I look for in a portrait lens.... One is how it renders perspective, the other is a large aperture to be able to blur down backgrounds when necessary.
Short telephotos render pleasing perspective for portraits. On a crop camera, the focal lengths from about 45mm to 85mm are about right.
Most zooms are f2.8 at best... Same with most macro lenses. And for portraits that's really only marginally large enough an aperture at times, other times isn't as large as I'd like for more complete control over the background. Hence the f1.4, f1.8 and f2.0 prime lenses.
Sometimes a zoom is necessary... kids and pet portraits for example. With them you often have to be quick and the flexibility of a zoom can outweigh it's limited aperture, size and other factors.
Often really fast AF isn't necessary for portraiture (the 60mm Tamron I mentioned above isn't terribly fast focusing... neither is Canon's 85/1.2L II, one of the most premium portrait lenses available). But sometimes it can help... such as shooting candids or portraits during an sports activity.
P.S. IMO, there are many types of "portraits". They range from "candids" to formally posed... single tight head shots to small groups or even large groups... studio to environmental... amatuer subject to professional subject... and many more. The type of portrait being shot can call for a certain type of lens. For example, for a candid shot I want to be unobtrusive and to work fast. That's where a quick fosusing and relatively small prime lens comes in handy. For a fashion shot in a studio with a professional model, a big intimidating lens is less of a concern, focusing precision is more important than speed (usually) and a carefully controlled background doesn't demand a large aperture.

