According to the requirements of the loading and unloading robot for the visual system, the mathematical model of the binocular vision measurement system and the accuracy of the binocular measurement system are analyzed. Further, according to the model, the angle and the baseline distance of the two cameras were verified by experiment, so as to control the measurement of the upper and lower deviation. It ensures the accuracy of image acquisition, which provides accurate coordinate data for loading and unloading robots.