A software architecture suitable for the machine vision software is proposed based on Qt for Linux. The design idea of the software architecture was divided into the machine vision algorithm tools and the software structure. The vision tools were provided the software structure with the reference interface function. When processing the vision software, the software structure would finish the job from acquiring the image from the camera, invoking vision algorithm function, to sending the data to the external equipment by selected communication mode. Halcon is combined and used as the machine vision algorithm tools, to test and verify the software architecture.