If you're in the UK, there is a place called watercoolerhq, I'm not sure if i can paste in links so give that a google...
Stay away from britta filter type shite... it's no good for what we need (I assume you have hard water).
Check out their RO machines, there is like a mini 'portable' type...