I know goat milk tastes like the goat's smell, but if the milk is really fresh, you really don't taste it much if at all. The other solution is, if it's not so fresh (and milk quickly starts to sour if not kept immediately in the fridge) to let it ferment furthermore until it thickens and add some (pasteurized) organic yoghurt (from cow's milk) to make it taste better.
If you're drinking it raw against 'lactose intolerance' it's ok to mix it with some pasteurized dairy.