I had the same thing in my soil, was really worried they would damage the plant but as far as i could see the roots were fine, but i didn't like them being there!
I managed to kill them all without using chemicals and with no damage to the plant. Basically i got one of those USB coffee mug...