It has nothing to do with religion or lack of. It is all about CONTROL and you are a control freak. Look how freaked out you are about just the idea that you can't control others (women) I am so sure that you are divorced or never married.
Men like you are a loaded time bomb and women sense this when meeting you. That's why you are unsuccessful at romance. No woman wants an overseer - unless she is damaged beyond repair.