Actually, i've read studies a few years ago that found it had no measurable feminizing effect on males. The phytoestrogens in soy have something like one-thousandth of the biological activity that estrogen has, so you would have to drink gallons and gallons of it to actually have any effect on your reproductive health, let alone to actually "feminize" you.
I know it's bad form to say something like this without citing any sources, but I haven't been able to find the studies on Google yet. As soon as I have sources. . .or even if I find out anything different, i'll post it here in this thread.
-----
That's because when milk proteins are digested, they break down into something called "casomorphin", which is an opiate that acts on the opiate receptors in your brain. The natural function of this is to get baby cows to crave their mother's milk, so they'll keep drinking it and growing.
http://en.wikipedia.org/wiki/Casomorphin
ALL mother's milk - cow, human, cat, pig, dog, etc - naturally contains opiates that make their baby want to keep drinking the milk. That's why babies have to be "weaned" off of it once they can eat solid food. . . .and why you developed a taste for it after drinking it for awhile.