i've done it and it does taste better.
i used 100% activated charcoal instead of a brita filter, as the brita has other crap in it that isn't necessary and it also costs too much.
you can get clean charcoal for a good price from pet stores for use in aquariums.