the key to budworms is diligent precaution. in late veg/early flower, i would use a insect killer that has pyrethrin. This kills eggs and hatched catepillars. I continue with BT...this continues to provide poison for those bastards. All the while I'm using this, i also cover my potted plant with a mosquito net, caped around the entire plant using bamboo stakes. This helps keep moths/butterflies from laying eggs. Any openings from the mosquito net provides an entrance but definitely reduces exposure to flying insects.
I use BT up to Week 3/4 of flowering and just keeping a careful eye on everything as it ripens. You really can't eliminate budworms but you can reduce the amount of lost bud.
in your stage, you can two things, either take an early harvest and watch the worms start crawling out as it dries or let it ripen more and suffer an even smaller harvest. I would take a early harvest. look into investing in a mosquito net to cover your plant and better precaution