Sounds like the water is trapped in the pots. There should be holes in the pots to allow the water to drain out. If it's indoors, there should be a pan to catch the water. stirring the soil will not help, and would likely damage the plant's root structure.
