I just came back from my local grow shop. They gave me 'BT' to fight against those little fuckers. BT, aka Bacillus thuringiensis, is an organic bacteria that's effective agains caterpillars, worms and larvae. Supposed to be natural and good to the enviroment. Effective agains those worms but useless against other little bugs. Its all on wikipedia!
The guy also advised to stop showering with Neem Oil once the flowering starts but I personally think that you can continue with it, as long as you don't use it the last weeks before harvest.
Ok, so now I've got the famous BT... lets get those damn worm squaters off my garden...
Good Luck Everyone!