Aimed at the low efficiency of manual inspection of glass surface quality in traditional glass processing, automatic optical inspection (AOI) equipment was proposed to detect glass surface quality. The overall design scheme, structure composition, control system function and control flow of AOI system for glass finishing were discussed,and the design method and steps of AOI system based on machine vision were analyzed. The detection of defects on glass surface is realized by independent research and development of color image algorithm system, which has high accuracy and is better than the manual detection method. It makes the product quality more stable and reliable, and prevents defective products from flowing into the second process or the client. The system can work continuously, greatly improve work efficiency, and reduce the labor costs of enterprises.