Under the sink water filtration

So I moved to a new area and the water is pretty chlorinated tasting :(

It’s ruining my nicer teas and I need to remedy the situation. I’ve used britas in the past but I’d really prefer a more radical solution. Especially since I’ve gotten my 4l Zojirushi (thank you Garret!).

So what are people’s thoughts? I’d prefer something that didn’t cost an arm and a leg. I just want to be able to drink some of my nicer straight teas and not have to stick to strongly flavored stuff!