The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


A New Leaky-LMS Algorithm with Analysis

Though the Leaky Least-Mean-Square (LLMS) algorithm mitigates the drifting problem of the LMS algorithm, its performance is similar to that of the LMS algorithm in terms of convergence rate. In this paper, we propose a new LLMS algorithm that has a better performance than the LLMS algorithm in terms of the convergence rate and at the same time solves the drifting problem in the LMS algorithm. This better performance is achieved by expressing the cost function in terms of a sum of exponentials at a negligible increase in the computational complexity. The convergence analysis of the proposed algorithm is presented. Also, a normalized version of the proposed algorithm is presented. The performance of the proposed algorithm is compared to those of the conventional LLMS algorithm and a Modified version of the Leaky Least-Mean-Square (MLLMS) algorithm in channel estimation and channel equalization settings in additive white Gaussian and white and correlated impulsive noise environments.


[1] Ahmad M., Kukrer O., and Hocanin A., An Efficient Recursive Inverse Adaptive Filtering Algorithm for Channel Equalization, in Proceeding of European Wireless, Lucca, pp. 88-92, 2010.

[2] Arya S. and Singh B., Performance of DSTATCOM using Leaky-LMS Control Algorithm, IEEE Journal of Emerging and Selected Topics in Power Electronics, vol. 1, no. 2, pp. 104-113, 2013.

[3] Boukis C., Mandic D., and Constantinides A., A Generalised Mixed Norm Stochastic Gradient Algorithm, in Proceeding of 15th International Conference on Digital Signal Processing, Wales, pp. 27-30. 2007.

[4] Cartes D., Ray L., and Collier R., Lyapunov Tuning of the Leaky LMS Algorithm for Single- Source, Single-Point Noise Cancellation, in Proceeding of the American Control Conference, Alington, pp. 3600-3605, 2001.

[5] Delic H. and Hocanin A., Robust Detection in DS/CDMA, Journal of IEEE Transactions on Vehicular Technology, vol. 51, no. 1, pp. 155- 170, 2002.

[6] Feuer A. and Weinstein E., Convergence Analysis of LMS Filters with Uncorrelated Gaussian Data, Journal of IEEE Transactions on Acoustic, Speech and Signal Processing, vol. 33, no. 1, pp. 222-230, 1985.

[7] Foley J. and Boland F., A Note on Convergence Analysis of LMS Adaptive Filters with Gaussian Data, Journal of IEEE Transactions on Acoustic, Speech and Signal Processing, vol. 36, no. 7, pp. 1087-1089, 1988.

[8] Goodwin G., Hill D., and Xianya X., Stochastic Adaptive Control for Exponentially Convergent Time-Varying Systems, SIAM Journal on Control and Optimization, vol. 24, no. 4, pp. 589-603, 1986.

[9] Haykin S., Adaptive Filter Theory, Prentice Hall, 2002. 050010001500200025003000350040004500500010-3 10-2 10-1 100 iterations mse MLLMS LLMS Proposed 2401 10v 050010001500200025003000350040004500500010-3 10-2 10-1 100 iterations mse MLLMS LLMS Proposed A New Leaky-LMS Algorithm with Analysis 331

[10] Hovd M. and Bitmead R., Directional Leakage and Parameter Drift, International Journal of Adaptive Control and Signal Processing, vol. 20, no. 1, pp. 27-39, 2006.

[11] Jagerman D., Nonstationary Blocking in Telephone Traffic, Journal of Bell System Technology, vol. 54, no. 3, pp. 625-661, 1975.

[12] Jo S., Choi J., and Lee Y., Modified Leaky LMS Algorithm for Channel Equalization in DS- CDMA Systems, Journal of IEEE Communication Letters, vol. 6, no. 5, pp. 202- 204, 2002.

[13] Mayyas K. and Aboulnasr T., Leaky-LMS: A Detailed Analysis, in Proceeding of IEEE International Symposium on Circuits and Systems, Seatlle, pp. 1255-1258, 1995.

[14] Nascimento V. and Sayed A., Unbiased and Stable Leaky-based Adaptive Filters, Journal of IEEE Transactions on Signal Processing, vol. 47, no. 12, pp. 3261-3276, 2002.

[15] Rigling B. and Schniter P., Subspace Leaky LMS, Journal of IEEE Signal Processing Letters, vol. 11, no. 2, pp. 136-139, 2004.

[16] Rojas H. and Cortes C., Adaptive Filtering for Lightning Electric Field Signals in Fractional Fourier Domain, in Proceeding of IEEE Statistical Signal Processing Workshop, Ann Arbor, pp. 213-216, 2012.

[17] Sethares W., Lawrence D., Johnson C., and Bitmead R., Parameter Drift in LMS Adaptive Filters, Journal of IEEE Transactions on Acoustic, Speech and Signal Processing, vol. 34, no. 4, pp. 868-879, 2003.

[18] Varade S. and Kulat K., Improvement in Interference Rejection Capability using Space- Time Turbo Code and Adaptive Beamforming for MIMO-OFDM System, in Proceeding of IEEE Conference on Signal Processing, Computing and Control, Waknaghat, pp. 1-8, 2012.

[19] Zhu Z., Zhang X., Wan X., and Wang Q., A Random-Valued Impulse Noise Removal Algorithm with Local Deviation Index and Edge- Preserving Regularization, Journal of Signal, Image and Video Processing, vol. 9, no. 1, pp. 221-228, 2015. Tajuddeen Gwadabe was born in 1987 in Nigeria. He received his B.E. in electrical engineering from Bayero University Kano (BUK), Nigeria, in 2011 and master s degree in electrical and electronics at Mevlana University, Turkey. His research interests include signal processing, adaptive filtering techniques and image processing. Mohammad Salman received the B.Sc., M.Sc., and Ph.D. Degrees in Electrical and Electronics Engineering from Eastern Mediterranean University (EMU), in 2006, 2007, and 2011, respectively. From 2006 to 2010, he was a teaching assistant of Electrical and Electronics Engineering department at EMU. In 2010, he joined the Department of Electrical and Electronic Engineering at European University of Lefke (EUL) as a senior lecturer for the Department. Since 2011, he worked as an Assist. Prof. Dr. in the Department of Electrical and Electronics Engineering, Mevlana (Rumi) University, Turkey. He served as a general chair, program chair, and a TPC member for many international conferences. He has supervised 6 M.Sc. Theses and currently supervising 4 Ph.D. Theses. His research interests include signal processing, adaptive filters, image processing, and communications systems.