I believe the developing Sertoli cells are responsible for influencing the development of male reproductive structures through the production of anti-mullerian hormone. During embryonic development there is a sexually indifferent stage in which the embryo has the potential to develop either male or female structures. The sertoli cells produce Mullerian inhibiting substance, a peptide hormone that causes the mullerian ducts to regress.
