Abstract: To overcome the problem that the deficiency of the appearance model and the motion model often leads to low precision in original Multiple Instance Learning (MIL), a target tracking algorithm is proposed based on multiple instance deep learning. In original MIL algorithm, the image is not represented effectively by Haar-like feature. To improve the tracking precision, a stacked denoising autoencoder is used to learn image features and express the image representations obtained effectively. Selected feature vector could not be replaced in the original MIL algorithm, which has difficulty reflecting the changes of the target and the background．Thus, some weakest discriminative feature vector is replaced with new randomly generated feature vector when weak classifiers are selected. It introduces new information to the target model and adapts to the dynamic changes of the target. Aiming at the deficiency of using motion model where the location of the target is likely to appear within a radius in original MIL algorithm, the particle filter estimates objects location to increase the tracking precision. Compared with the original MIL algorithm and other state-of-the-art trackers in the complex environment, the experiments on variant image sequences show that the proposed algorithm raise the tracking accuracy and the robustness.