The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Application of Video Game Algorithm Based on Deep Q-Network Learning in Music Rhythm Teaching

The difficulty of music rhythm teaching makes its teaching effect limited. Some game algorithms show problems of stuttery and unclear picture when they are introduced into teaching, which greatly restricts the development of teaching content. Therefore, it is proposed to activate the Deep Q-Network (DQN) and improve the filter to improve the processing performance of game image data and the integrity of information retention. The model fuses the extracted features and processes them through the neural network. According to the performance characteristics and forms of music rhythm, constant Q-transformation, dynamic programming algorithm and hidden Markov model are proposed to analyze and design music signal, beat point analysis and signal traveling speed, so as to realize the identification and matching of music rhythm. The performance test and application analysis of the proposed fusion improvement algorithm are carried out: the video game algorithm can effectively extract data feature information, and its accuracy rate is basically 90% or above. The improved DQN and Artificial Fish Swarms Algorithm (AFSA) algorithms can maintain an accuracy of over 75%, followed by the ABC algorithm, which maintains an accuracy of over 70%, but exhibits significant fluctuations in the curve changes and nodes. The recognition accuracy of music signal feature extraction is over 70%, and it is less affected by signal-to-noise ratio. The improved activation function showed that the highest game score exceeded 10 points, while the scores of Rectified Linear Unit (ReLU) function and Hyperbolic tangent function (Tanh) function were basically hovering below 5 points, and the overall score curve fluctuated significantly. The recognition accuracy of music signal features extraction is above 70% and is less affected by signal to noise ratio. The algorithm has a good effect of music rhythm teaching, the students’ interest in classroom learning is more than 45%, and the learning weakness is less. The average score of students in music style judgment, rhythm division and index are 85 points and 90 points respectively, which is much higher than the 40 points and 63 points of traditional teaching. The proposed algorithm can better combine video games with music teaching and help students improve their learning effect under the gamification teaching method, and has good application value.

[1] Albaghajati A. and Ahmed M., “Video Game Automated Testing Approaches: An Assessment Framework,” IEEE Transactions on Games, vol. 15, no. 1, pp. 81-94, 2020. https://doi.org/10.1109/TG.2020.3032796

[2] Bharati S., Khan T., Podder P., and Huang N., Cognitive Internet of Medical Things for Smart Healthcare: Services and Applications, Springer, 2021. https://link.springer.com/chapter/10.1007/978-3- 030-55833-8_3

[3] Chen G., Cai Q., Fu X., and Lai Y., “Research on Algorithms of Computing Offloading and Resource Allocation Based on DQN,” in Proceedings of the 5th International Seminar on Computer Technology, Mechanical and Electrical Engineering, Shenyang, pp. 032047-032048, 2020. DOI:10.1088/1742-6596/1748/3/032047

[4] Dai Z., “Research on Network Intrusion Detection Security Based on Improved Extreme Learning Algorithms and Neural Network Algorithms,” International Journal of Biometrics, vol. 12, no. 1, pp. 56-57, 2020. https://doi.org/10.1504/IJBM.2020.10027201

[5] Dakshayani V., Locharla G., Plawiak P., Datti V., and Karri C., “Design of a Gabor Filter-Based Image Denoising Hardware Model,” Electronics, vol. 11, no. 7, pp. 1063, 2022. https://doi.org/10.3390/electronics11071063

[6] Fuchs J., Isenberg P., Bezerianos A., Miller M., and Keim D., “Teaching Clustering Algorithms with EduClust: Experience Report and Future Directions,” IEEE Computer Graphics and Applications, vol. 40, no. 2, pp. 98-102, 2020. https://doi.org/10.1109/MCG.2020.2970560

[7] Gaina R., Devlin S., Lucas S., and Perez-Liebana D., “Rolling Horizon Evolutionary Algorithms for General Video Game Playing,” IEEE Transactions on Games, vol. 14, no. 2, pp. 232-242, 2021. https://doi.org/10.48550/arXiv.2003.12331

[8] Ganghua B., “Simulation of Performance Skills Teaching System Based on Machine Vision and Sensor Audio Signal Processing,” Measurement: Sensors, vol. 33, pp. 101224, 2024. https://doi.org/10.1016/j.measen.2024.101224

[9] Grekow J., “Music Emotion Recognition Using Recurrent Neural Networks and Pretrained Models,” Journal of Intelligent Information Systems, vol. 57, no. 3, pp. 531-546, 2021. https://doi.org/10.1007/s10844-021-00658-5

[10] Huang Y., Lin W., and Chen Q., “Music Video Therapy Can be an Effective Nonpharmaceutical Intervention in Relieving Children’s Postoperative Pain After Cardiothoracic Surgery,” Journal of Cardiac Surgery, vol. 37, no. 1, pp. 261-261, 2022. https://doi.org/10.1111/jocs.16114

[11] James L. and Reifinger J., “Teaching Pitch Notation-Reading Skills,” General Music Today, vol. 33, no. 3, pp. 21-28, 2019. https://doi.org/10.1177/1048371319891419

[12] Jiang H., Zhang H., Xie X., and Han J., “Neural- Network-Based Learning Algorithms for Cooperative Games of Discrete-Time Multi- Player Systems with Control Constraints Via Adaptive Dynamic Programming,” Neurocomputing, vol. 344, no. 7, pp. 13-19, 2019. https://doi.org/10.1016/j.neucom.2018.02.107

[13] Karamizadeh S., Abdullah S., Manaf A., Zamani M., and Hooman A., “An Overview of Principal Component Analysis,” Journal of Signal and Information Processing, vol. 4, no. 3, pp. 2159- 4481, 2020. https://doi.org/10.4236/jsip.2013.43B031

[14] Khan A., Feng J., Liu S., and Omara I., “Playing a FPS Doom Video Game with Deep Visual Reinforcement Learning,” Automatic Control and Computer Sciences, vol. 53, no. 3, pp. 214-222, 2019. https://doi.org/10.3103/S0146411619030052

[15] Lipsky M. and Kantor J., “Identification of Challenges and Strengths of Children with Special Educational Needs in Their Musical Improvisations,” Journal of Clinical Psychology and Special Education, vol. 8, no. 1, pp. 118-136, 2019. https://doi.org/10.17759/cpse.2019080108

[16] Mateo C. and Talavera J., “Bridging the Gap between the Short-Time Fourier Transform (STFT), Wavelets, the Constant-Q Transform and Multi-Resolution STFT,” Signal Image and Video Processing, vol. 14, no. 8, pp. 1535-1543, 2020. https://doi.org/10.1007/s11760-020-01701-8

[17] Meng Z. and Chen W., “Automatic Music Transcription Based on Convolutional Neural Network, Constant Q Transform and MFCC,” in Proceedings of the 2nd International Conference on Artificial Intelligence Technologies and Application, Dalian, pp. 1-9, 2020. https://doi.org/10.1088/1742- 6596/1651/1/012192

[18] Mor B., Garhwal S., and Kumar A., “A Systematic Application of Video Game Algorithm Based on Deep Q-Network Learning in Music Rhythm … 137 Review of Hidden Markov Models and Their Applications,” Archives of Computational Methods in Engineering, vol. 28, pp. 1429-1448, 2021. https://doi.org/10.1007/s11831-020-09422-4

[19] Muller M., McFee B., and Kinnaird K., “Interactive Learning of Signal Processing Through Music: Making Fourier Analysis Concrete for Students,” IEEE Signal Process Magazine, vol. 38, no. 3, pp. 73-84. 2021. https://doi.org/10.1109/MSP.2021.3052181

[20] Petersen P. and Voigtlaender F., “Optimal Approximation of Piecewise Smooth Functions Using Deep ReLU Neural Networks,” Neural Networks, vol. 108, pp. 296-330, 2018. https://doi.org/10.1016/j.neunet.2018.08.019

[21] Raj P., Reddy P., and Chandrachoodan N., “Reduced Memory Viterbi Decoding for Hardware-Accelerated Speech Recognition,” ACM Transactions on Embedded Computing Systems, vol. 21, no. 3, pp. 1-18, 2022. https://doi.org/10.1145/3510028

[22] Borges A. and Richit A., “Development of Teaching Knowledge to Teach Music in Elementary School,” Cadernos De Pesquisa, vol. 50, no. 176, pp. 555-574, 2020. https://doi.org/10.1590/198053146782

[23] Saeidi S., “A New Model for Calculating the Maximum Trust in Online Social Networks and Solving by Artificial Bee Colony Algorithm,” Computational Social Networks, vol. 7, no. 1, pp. 3, 2020. https://doi.org/10.1186/s40649-020- 00077-6

[24] Smerdov A., Somov A., Burnaev E., Zhou B., and Lukowicz P., “Detecting Video Game Player Burnout with the Use of Sensor Data and Machine Learning,” IEEE Internet of Things Journal, vol. 8, no. 22, pp. 16680-16691, 2021. https://doi.org/10.48550/arXiv.2012.02299.

[25] Tian Y., Li Y., Pan L., and Harry M., “Research on Group Animation Design Technology Based on Artificial Fish Swarm Algorithm,” Journal of Intelligent and Fuzzy Systems, vol. 38, no. 2, pp. 1137-1145, 2020. https://doi.org/.10.3233/JIFS- 179475

[26] Wang Y., Mao M., Chang L., and Hatziargyriou N., “Intelligent Voltage Control Method in Active Distribution Networks Based on Averaged Weighted Double Deep Q-Network Algorithm,” Journal of Modern Power Systems and Clean Energy, vol. 11, no. 1, pp. 132-143, 2023. https://doi.org/10.35833/MPCE.2022.000146

[27] Yang Y. and Song X., “Research on Face Intelligent Perception Technology Integrating Deep Learning Under Different Illumination Intensities,” Journal of Computational and Cognitive Engineering, vol. 1, no. 1, pp. 32-36, 2022. https://doi.org/10.47852/bonviewJCCE19919

[28] Yi G., “Teaching about the Korean Ganggangsullae Folk Tradition in General Music Class,” Music Educators Journal, vol. 105, no. 3, pp. 45-53, 2019. https://doi.org/10.1177/0027432118815961

[29] Yu X., Ye C., Li B., Zhou H., and Huang M., “A Deep Q-Learning Network for Dynamic Constraint-Satisfied Service Composition,” International Journal of Web Services Research, vol. 17, no. 4, pp. 55-75, 2020. https://doi.org/ 10.4018/IJWSR.2020100104

[30] Zalkow F., Balke S., Arifi-Müller V., and Müller M., “MTD: A Multimodal Dataset of Musical Themes for MIR Research,” International Society for Music Information Retrieval, vol. 3, no. 1, pp. 180-192, 2020. https://doi.org/.10.5334/tismir.68

[31] Zeng D., Yan T., Zeng Z., Liu H., and Guan P., “A Hyperparameter Adaptive Genetic Algorithm Based on DQN,” Journal of Circuits, Systems and Computers, vol. 32, no. 4, pp. 2350062, 2023. https://doi.org/10.1142/S0218126623500627

[32] Zeng M., “Gesture Recognition Technology of VR Piano Playing Teaching Game based on Hidden Markov Model,” International Arab Journal on Information Technology, vol. 21, no. 4, pp. 760- 772, 2024. https://doi.org/10.34028/iajit/21/4/15

[33] Zhang Z., Zhang Q., Miao J., Yu F R., Fu F., Du J., and Wu T., “Energy-efficient secure video streaming in UAV-enabled wireless networks: A safe-DQN approach,” IEEE Transactions on Green Communications and Networking, vol. 5, no. 4, pp. 1892-1905, 2021. https://doi.org/10.1109/TGCN.2021.3095315