From the point of view of control, the fuzzy sliding mode controller was designed in order to solve servo problem of robot visual based on epipolar geometry. By establishing appropriate fuzzy rule base, buffeting phenomena were effectively weakened or reduced. Simultaneously the robustness and quickness of the system were improved. The effectiveness and feasibility of this approach is tested with the 6DOF robot of visual positioning simulation.