Why not build a box to go inside your closet?
Sure it won't be as big as the closet itself but you'll be able to put holes in the box for ventilation etc.
Just leave one of the doors open slightly and stick a fan blowing cool air into the closet, then the fans on the box will pull cool air in, and blow hot air out.
Just a suggestion.
Rep if it's helped