The applications of deep learning in fault diagnosis, image analysis, speech recognition and text understanding were described. Four typical deep learning models of convolutional neural network, deep confidence network, stack automatic coding network and recursive neural network were introduced. The research progress of deep learning in model selection, learning algorithm and practical application in fault diagnosis were reviewed. The theoretical analysis, feature extraction, optimization training and research development of deep learning in fault diagnosis were discussed.