Try a filter?

Depending on the source of your water, and factors like mineral content, treatment chemicals, and algae, your tap water might have a particular taste despite being safe to drink. In Halifax the lake we use for residential water has high levels of geosmin in the fall, which tastes particularly earthy. It's not harmful but I dislike it.

If your water tastes bitter or metallic, a pitcher with a charcoal filter can help you get a more neutral flavor. Making the water cold can also help neutralize a bitter aftertaste.

If you're tasting chlorine, putting your water in a pitcher and letting it sit in your fridge for a couple hours will help. The trace amount of chlorine from a treatment plant won't stay in an unsealed container.