Call the couple and talk to them. You have the photographer's side of the story, now get theirs to see what they have to say.
Yes. All the complaints that the photographer has told you about, real or made up, are about your behavior during the wedding. The couple didn't complain about your images. How could they? They haven't seen your images! But you weren't hired as an entertainer, you were hired to produce images. Seems like the photographer could have dealt with their complaints by telling them so and asking them to hold off on making a decision until they see the product. There should also be something in his contract with them that prevents situations like the one he now tells you exists.
One possibility is the Uncle Bob story: the couple have photos, and they don't want to pay. Another is that the photographer wants to use your photos without paying.