You can tape a border of plastic around the door so it's light tight when the door closes and the plastic then covers the gap, that never hurts.
If you get in the closet and close the door and it's not dark, fix it, but don't seal it off from fresh air getting in too.