Well the fan itself is not controlled by vacuum but the vents are - I imagine the noise changes when you switch from floor, to face, to defrost (or, you are maybe stuck with just defrost and cannot actuate the vents..) That indicates a bad vacuum line somewhere in the car - why the noise is...