Females only become hermy if they are shocked into it. I don't know who told you that but if I were you I wouldnt believe another word they said.
As per your question about when they can fertilize. As soon as the pods burst open and pollen comes out of the males. So it is best to just kill...