Because of my small personal grow, I was able to take time trimming at harvest, looking closely for pests.
If I found a dead/brown area on a bud and small silk, this was an obvious caterpillar, and I'd toss that bud away.
From posts above....I never kill typical spiders either. I move them...