The International Arab Journal of Information Technology (IAJIT)


Forecasting of Chaotic Time Series Using RBF

Time series forecasting is an important tool, which is used to support the areas of planning for both individual and organizational decisions. This problem consists of forecasting future data based on past and/or present data. This paper deals with the problem of time series forecasting from a given set of input/output data. We present a hybrid approach for time series forecasting using Radial Basis Functions Neural Network (RBFNs) and Genetic Algorithms (GAs). GAs technique proposed to optimize centers c and width r of RBFN, the weights w of RBFNs optimized used traditional algorithm. This method uses an adaptive process of optimizing the RBFN parameters depending on GAs, which improve the homogenize during the process. This proposed hybrid approach improves the forecasting performance of the time series. The performance of the proposed method evaluated on examples of short-term mackey-glass time series. The results show that forecasting by RBFNs parameters is optimized using GAs to achieve better root mean square error than algorithms that optimize RBFNs parameters found by traditional algorithms.

[1] Abdollahzade M., Miranian A., Hassani H., and Iranmanesh H., A New Hybrid Enhanced Local Linear Neuro-Fuzzy Model Based on the Optimized Singular Spectrum Analysis and its Application for Nonlinear And Chaotic Time Series Forecasting, Information Sciences, vol. 295, no. C, pp. 107-125, 2015.

[2] Awad M., Chaotic Time Series Prediction Using Wavelet Neural Network, Journal of Artificial Intelligence: Theory and Application, vol. 1, no. 3, pp. 73-80, 2010.

[3] Awad M., Pomares H., Ruiz I., Salameh O., and Hamdon M., Prediction of Time Series Using RBF Neural Networks: A New Approach of Clustering, The International Arab Journal of Information Technology, vol. 6, no. 6, pp.138- 143, 2009.

[4] Awad M., Optimization of Radial Basis Function Neural Networks Parameters using Genetic Algorithms: Applied on Function Approximation, International Journal of Computer Science and Security, vol. 4, no. 3, pp. 295-307, 2010.

[5] Behmanesh M., Mohammadi M., and Naeini V., Chaotic Time Series Prediction using Improved ANFIS with Imperialist Competitive Learning Algorithm, International Journal of Soft Computing and Engineering, vol. 4, no. 4, pp. 25-33, 2014. 0100200300400500600 -0.5 -0.4 -0.3 -0.2 -0.1 0 0.1 0.2 0.3 0.4 0.5 t RMSE Forcaseting Error Forecasting of Chaotic Time Series Using RBF Neural Networks Optimized ... 833

[6] Box G., Jenkins G., and Reinsel G., Time Series Analysis: Forecasting and Control, John Wiley and Sons, 2008.

[7] Brockwell P. and Davis R., Introduction to Time Series and Forecasting, Springer-Verlag, 2002.

[8] Buchtala O., Klimek M., and Sick B., Evolutionary Optimization of Radial Basis Function Classifiers for Data Mining Applications, IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 35, no. 5, pp. 928-947, 2005.

[9] Castro J., Castillo O., Melin P., Mendoza O., and Rodr guez-D az A., An Interval Type-2 Fuzzy Neural Network for Chaotic Time Series Prediction with Cross-Validation and Akaike Test, Soft Computing for Intelligent Control and Mobile Robotics, vol. 318, pp. 269-285, 2011.

[10] Chandra R. and Zhang M., Cooperative Coevolution of Elman Recurrent Neural Networks for Chaotic Time Series Prediction, Neurocomputing, vol. 86, pp. 116-123, 2012.

[11] Chen D., Wang J., Zou F., Yuan W., and Hou W., Time Series Prediction with Improved Neuro- Endocrine Model, Neural Computing and Applications, vol. 24, no. 6, pp. 1465-1475, 2014.

[12] Chen S., Cowan C., and Grant P., Orthogonal Least Squares Learning Algorithm for Radial Basis Function Networks, Neural Networks, IEEE Transaction, vol. 2, no. 2, pp. 302-309, 1991.

[13] Cortez P., Sensitivity Analysis for Time Lag Selection to Forecast Seasonal Time Series Using Neural Networks and Support Vector Machines, in Proceeding of the IEEE International Joint Conference on Neural Networks, Barcelona, pp. 3694-3701, 2010.

[14] Crone S. and Kourentzes N., Feature Selection for Time Series Prediction a Combined Filter and Wrapper Approach for Neural Networks, Neurocomputing, vol. 73, no. 10-11, pp. 1923- 1936, 2010.

[15] Golub G. and Loan C., Matrix Computations, Johns Hopkins, Baltimore, 1996.

[16] Gonz lez J., Rojas I., Ortega J., Pomares H., Fern ndez F., and D az A., Multiobjective Evolutionary Optimization of the Size, Shape, and Position Parameters of Radial Basis Function Networks for Function Approximation, IEEE Transaction on Neural Networks, vol. 14, no. 6, pp. 1478-1495, 2003.

[17] Harpham C., Dawson C., and Brown M., A Review of Genetic Algorithms Applied to Training Radial Basis Function Networks, Neural Computing and Applications, vol. 13, no. 3, pp. 193-201. 2004.

[18] Hartigan J. and Wong M., Algorithm AS 136: a K-means Clustering Algorithm, Applied Statistics, vol. 28, no. 1, pp. 100-108. 1979.

[19] Hassan A. and Abdullah S., Hybrid Radial Basis Function with Particle Swarm Optimisation Algorithm for Time Series Prediction Problems, Series Advances in Intelligent Systems and Computing, vol. 287, pp. 227-238, 2014.

[20] Makridakis S., Wheelwright S., and Hyndman R., Forecasting Methods and Applications, John Wiley and Sons, 2008.

[21] Mohammadi R., Ghomi S., and Zeinali F., A New Hybrid Evolutionary Based RBF Networks Method For Forecasting Time Series: a Case Study of Forecasting Emergency Supply Demand Time Series, Engineering Applications of Artificial Intelligence, vol. 36, pp. 204-214, 2014.

[22] Niu D., Lu Y., Xu X., and Li B., Short-Term Power Load Point Prediction Based on the Sharp Degree and Chaotic RBF Neural Network, Mathematical Problems in Engineering, vol. 2015, pp. 1-8, 2015.

[23] Nunn I. and White T., The Application of Antigenic Search Techniques to Time Series Forecasting, in Proceeding of the 7th annual Conference on Genetic and evolutionary Computation, Washington, pp. 353-360, 2005.

[24] Peralta J., Gutierrez G., and Sanchis A., Adann: Automatic Design of Artificial Neural Networks, in Proceeding of the 10th Annual Conference Companion on Genetic and Evolutionary Computation, New York, pp. 1863- 1870, 2008.

[25] Pomares H., Rojas I., Awad M., and Valenzuela O., An Enhanced Clustering Function Approximation Technique for a Radial Basis Function Neural Network, Mathematical and Computer Modeling, vol. 55, no. 3, pp. 286-302, 2012.

[26] Rivas A., Dise o y Optimizaci n De Redes De Funciones De base Radial Mediante T cnicas Bio-Inspiradas, Phd Thesis University of Granada, 2003.

[27] Rivas V., Merelo J., Castillo P., Arenas M., and Castellano J., Evolving RBF Neural Networks for Time-Series Forecasting with EvRBF, Information Sciences, vol. 165, no. 3-4, pp. 207- 220, 2004.

[28] Rojas I., Pomares H., Gonzalez J., Ros E., Salmer n M., Ortega J., and Prieto A., A New Radial Basis Function Networks Structure: Application to time series prediction, in Proceeding of the IEEE-INNS-ENNS International Joint Conference on Neural Networks, Italy, pp. 449-445, 2000.

[29] t pni ka M., Dvo k A., Pavliska V., and Vav kov L., A Linguistic Approach to Time Series Modelling with Help of the F-Transform, 834 The International Arab Journal of Information Technology, Vol. 14, No. 6, November 2017 Fuzzy Sets and Systems, vol. 180, no. 1, pp. 164- 184, 2011.

[30] Widrow B. and Lehr M., 30 Years of Adaptive Neural Networks: Perceptron Madaline and Back- Propagation, Proceeding of the IEEE, vol. 78, no. 9, pp. 1415-1442. 1990.

[31] Wu J., Long J., and Liu M., Evolving RBF Neural Networks for Rainfall Prediction Using Hybrid Particle Swarm Optimization and Genetic Algorithm, Neurocomputing, vol. 148, pp. 136- 142, 2015.

[32] Zhang G., Patuwo B., and Hu M., Forecasting with Artificial Neural Networks: the State of the Art, International Journal of Forecasting, vol. 14, no. 1, pp. 35-62, 1998.

[33] Zhang G., Time Series Forecasting Using A Hybrid ARIMA and Neural Network Model, Neurocomputing, vol. 50, pp. 159-175, 2003.

[34] Zhangang Y., Yanbo C., and Cheng K., Genetic Algorithm-Based RBF Neural Network Load Forecasting Model, in Proceeding of IEEE Power Engineering Society General Meeting, Tampa, pp.1-6, 2007. Mohammed Awad received the B.S. Degree in Industrial Automation Engineering from Palestine Polytechnic University in 2000, and advanced diploma and Ph.D. degrees in Computer Engineering from the Granada University Spain. From 2005 to 2006, he was a contract Researcher at Granada University. Since Feb. 2006, he has been an Assistant Professor in Computer Engineering Department, College of Engineering and Information Technology at Arab American University. At 2010 he has been an associate Professor in Computer Engineering. He worked for more than 9 years at the Arab American University in academic Position, in parallel with various Academic administrative positions. (Departments Chairman and Dean Assistant, and Dean of Scientific Research/Editor-In-Chief, Journal of AAUJ). Through the research and educational experience, he has developed strong research record. His research interests include: Artificial Intelligence, Neural Networks, Function Approximation of Complex Systems, Clustering Algorithms, Input Variable Selection, Fuzzy Expert Systems and Genetic Algorithms.