Yea, caterpillars are bad news outdoors. They eat their way into buds and shit everywhere, and cause bud rot. The best stuff to spray is BT - it’s a bacterial concentrate that wipes em out, and is safe for food crops. You gotta spray early and often to keep them away.