Fatigue damage, cracks occurred in work process of a rolling mill AGC servo hydraulic cylinder. Through working condition, mechanical modeling and simulation analysis, the cause of fatigue damage was concluded. Through increasing the thickness of the cylinder barrel and cylinder bottom and increasing the radius of the grinding wheel groove at the cylinder bottom, the maximum stress had fallen sharply, and the fatigue life of the AGC hydraulic cylinder was improved.