I don't know if this will work (being a relative newbie who hasn't dealt with this in the past) but this is what I would try: I would prune the males back until they were basically stumps with enough fan leaves to keep them alive and continue pruning new growth. Again, I can't verify how successful this would be...