Based on analysis of LMS algorithm, the ELMS algorithm is researched, which is regarded as an improved algorithm of LMS. The performances of the two algorithms are analyzed and compared, and the advantages of ELMS are pointed out. Then, a variable step size ELMS algorithm is proposed, the theoretical analysis and computer simulation indicate that the new algorithm has quite fast convergence rate, better steady performance and can be applied to adaptive systems effectively.