I have the same problem one plant showed male flower 4 or 5 weeks in and seeded a few buds on the others, but not itself?

Is there anything bad about smoking the hermy bud? I know that if you pick the male "bannanas" off they have pollen in them. Can pollen cause "harsh" smoke or maybe headache?

__________________