Caterpillars and possibly bud rot? harvest?

its my first grow outdoor and I'm about ready to harvest. i was going to give it another week until i noticed what i thought was bud rot. i then noticed the green worm caterpillars and did some research on them. apparently they go hand in hand. i can't tell if i have but rot or not. Can someone please advise.

also I'm probably going to just harvest but i don't want to smoke any mold to other bad stuff (poop and dead bugs) from the caterpillars? how should i go about harvesting and what should i save/throw out?

I'm no pro but looks in the 3rd pic like you have bud rot starting

I mentioned on another thread that when I hung my buds last yr. the caterpillars rappelled from them on silk the first couple days. I think you should watch some youtube videos on washing your buds for all contaminants. I'm thinking of using the peroxide method. not sure. following this thread

That brown you see is your bud dying because a catapillar has severed that part of the bud from the main stem....if you pull on those brown areas they will come off with ease and you'll find a catapillar underneath munching and shitting his way through your hard work ....if your going to harvest now then just stay away from those brown areas ....once you start handling the buds you'll see how easily those parts fall apart ....it's pretty easy to tell where those little fuckers have been .....next round I suggest you do some prevention spraying to keep this from reoccurring ....GL