A novel image fusion algorithm is proposed based on EM algorithm. This method infers the iterative process of real scene to fusion images according to EM algorithm based on multi-image model. Varieties of methods, such as Laplace Pyramids, wavelet and gradient pyramids, are discussed and compared with EM algorithm. The digital imitation results show that the robustness of the method is quite good even when fusing the seriously polluted image.