Very typical problem when using window bangers.
This is what I make for that out of cardboard and foil tape:
View attachment 3674504 View attachment 3674505
You don't have to foil the whole thing, just the folded in sides

And def don't foil tape the inside lining of the cardboard, that will reflect the light in. But this works.