Yes, I would avoid sticking anything into the soil which may disrupt the roots. I use soft pots, so I just punch a hole in the plastic and feed some string through it. If you're using hard plastic pots, just drill a small hole at the top of your container instead. Simply tie the string around the stem of your plant to sturdy the plant.