Hi btm66, you said: "I have been giving him soymilk and someone suggested I not do that either".
That was good advice! Soy contains natural chemical ingredients that mimic estrogen that can have deleterious effects on normal male development. (In other words- feminizing effects). This has been well document by numerous research studies during the past 2 decades or so, even though it doesn't seem to be widely publicized.
I would encourage you to try goats milk though, infants and children who can't tolerate cows milk often do very well with goat milk. I wonder if it's related to the fact that goats are not generally fed all the Antibiotics and hormones that cows are?