Nah, rockwool is safe. It's much like fiberglass, it can be an irritant if it gets into your throat, but generally, as long as you aren't shreding the stuff in a small room, you'll be fine. It's not like asbestos or anything, it won't cause permanent harm even if a little bit did find it's way...