I have been married 3 years and was in the same position as you. His past bothered me A LOT. But now I rarely think about it. After we got married I started to realise, well, when we're in our 60s, will he even remember those other women much? They are bound to all fade into complete insignificance, none of them meant as much to him as I do. I'm sure as time goes by you will not think about his past as much. It's never going to be good to think about it, anyway!