I also grow in a nearby forest. I have only had problems with bugs when they are seedlings and when they are budding. U could probably start them in pots until they get big enough to withstand the pests and then transplant them into the ground. or maybe try this.... First Rays' Home Remedies...