24/7 your plants still "breaths" in the dark
also, so do mold, don't want to let that get a foothold in there, if the fan is to noisy build a insulated box for it and buy a few meters of insulated ducting, a speed control to turn it down to half strengths doigng lights out could also be a option