The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Joint Extraction of Organizations and Relations for Emergency Response Plans with Rich Semantic Information Based on Multi-head Attention Mechanism

At present, deep learning-based joint entity-relation extraction models are gradually gaining the capability to accomplish complex tasks. However, research progress in specific fields is relatively slow. Compared with other areas, emergency plan text possesses unique characteristics such as high entity density, extensive text, and numerous professional terms. These features challenge some general models, which struggle to handle the semantic information of emergency plan text effectively. In response to this, the paper addresses the complex semantics of emergency plan text. It proposes a joint extraction model for emergency plan organization and relationship, based on the multi-head attention mechanism (MA-JE). This model enriches semantic information by obtaining contextual information from various perspectives and different levels. The aim is to deeply mine and utilize sentence semantic information through extensive feature extraction of emergency plan text. The proposed model and the baseline model were separately tested on the Chinese emergency response plan dataset. The results indicate that the proposed approach surpasses existing baseline models in the joint extraction of entities and their relations. Furthermore, ablation experiments were conducted to verify the effectiveness of each module within the model.

[1] Bekoulis G., Deleu J., Demeester T., and Develder C., “Joint Entity Recognition and Relation Extraction as a Multi-Head Selection Problem,” Expert Systems with Applications, vol. 114, pp. 34-45, 2018. https://doi.org/10.48550/arXiv.1804.07847

[2] Cowie J. and Lehnert W., “Information Extraction,” Communications of the ACM, vol. 39, no. 1, pp. 80-91, 1996. https://doi.org/10.1145/234173.234209

[3] E Hai-Hong., Zhang W., and Xiao S., “Research Review of Entity Relation Extraction Based on Deep Learning,” Journal of Software, vol.30, no.6, pp. 26, 2019. =

[4z Eberts M. and Ulges A., “Span-Based Joint Entity and Relation Extraction with Transformer Pre- Training,” in Proceedings of the 24th European Conference on Artificial Intelligence, Santiago de Compostela, pp. 2006-2013, 2020. https://doi.org/10.48550/arXiv.1909.07755

[5] Geng Z., Zhang Y., and Han Y., “Joint Entity and Relation= Extraction= Model Based on= Rich= Semantics,” Neurocomputing, vol. 429, pp. 132- 140,= 2021. https://doi.org/10.1016/j.neucom.2020.12.037=

[6z Hinton G. and Ruslan R., “Reducing the Dimensionality= of= Data= with= Neural= NetworksI” 888 The International Arab Journal of Information Technology, Vol. 20, No. 6, November 202 Science, vol. 313, no. 5786, pp. 504-507, 2006. DOI: 10.1126/science.1127647

[7] Hong Y., Liu Y., Yang S., Zhang K., and Hu J., “Joint Extraction of Entities and Relations Using Graph Convolution over Pruned= Dependency= Trees,” Neurocomputing, vol. 411, pp. 302-312, 2020. https://doi.org/10.1016/j.neucom.2020.06.061=

[8z Huang W., Cheng X., Wang T. and Chu W., “BERT-Based Multi-Head Selection for Joint Entity-Relation Extraction,” in Proceedings of the Natural Language Processing and Chinese Computing, Dunhuang, pp. 713-723, 2019. https://doi.org/10.48550/arXiv.1908.05908

[9] Ji B., Yu J., Li S., Ma J., and Wu Q., “Span-Based Joint Entity= and Relation= Extraction= with= AttentionJBased SpanJSpecific= and=Contextual= Semantic Representations,” in Proceedings of the 28th International Conference on Computational Linguistics, Barcelona, pp. 88-99, 2020. 10.18653/v1/2020.colingJmain.8=

[10] Katiyar A. and Cardie C., “Investigating Lstms for Joint Extraction= of=Opinion Entities= and Relations,” in Proceedings of the 54th Annual Meeting of= the Association for Computational Linguistics, Berlin, pp. 919-929, 2016. DOI: 10.18653/v1/P1SJ1087=

[11] Katiyar A. and Cardie C., “Going Out on A Limb: Joint Extraction of Entity Mentions and=Relations without Dependency Trees,” in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, pp. 917- 928, 2017.=DOI: 10.18653/v1/P17J1085=

[12] Liu T., “Studies on Scenes' Construction of Emergency PlanningJPart=Ⅰ of Emergency Planning Technology Based on Scene-Task- Ability,” China Safety Production Science and Technology, vol. 8, no. 4, pp. 5-12, 2012.

[13] Liu Y., “Joint Extraction of Entities and Relations Based on Multi-Label Classification,” in Proceedings of= the IEEE= Qth International Conference on Data Science in Cyberspace IEEb, Hangzhou, ppK=10SJ111,= 2019K=DOI: 10.1109/DSC.2019.00024.

[14] Lin Y., Shen S., Liu Z., and Luan H., “Neural Relation Extraction with Selective Attention over Instances,” in Proceedings of the 54th Annual Meeting of= the Association for Computational Linguistics, Berlin, pp. 2124-2133, 2016. DOI:10.18653/v1/P16-1200

[15] Miao L., Zhang Y., Xie B., and Li Y., “Joint Entity Relation Extraction Based on Graph Neural Network,” Computer Application Research, vol. 39, no. 02, pp. 424-431, 2022.

[16] Miwa M. and Bansal M., “End-to-End Relation Extraction=Using LSTMS on=Sequences and Tree= Structures,” in Proceedings of the 54th Annual Meeting of= the Association for Computational Linguistics, Berlin, pp. 1105-1116, 2016. https://doi.org/10.48550/arXiv.1601.0077M=

[17] Nguyen D. and Verspoor K., “End-to-End Neural Relation Extraction Using Deep Biaffine Attention,” in Proceedings of the 41st European Conference on Information Retrieval, Cologne, pp. 729-738, 2019. https://doi.org/10.48550/arXiv.1812.11275

[18] Ni W., Shen Q., Liu T., Zeng Q., and Xu L., “Generating Textual Emergency Plans for Unconventional Emergencies-a Natural Language Processing Approach,” Safety Science, vol. 160, pp. 106047-106065, 2023. https://doi.org/10.1016/j.ssci.2022.106047

[19] Sun C., Wu Y., Al-Ajarmah M. and Sun S., “Extracting Entities and Relations with Joint Minimum Risk Training,” in Proceedings of the Conference on Empirical Methods in Natural Language Processing, Brussels, pp. 2256-2265, 2018. DOI: 10.18653/v1/D18-1249

[20] Tan Z., Zhao X., Wang W. and Xiao W., “Jointly Extracting Multiple Triplets with Multilayer Translation Constraints,” Proceedings of AAAI Conference on Artificial Intelligence, vol. 33, no. 1, pp. 7080-7087, 2019. https://doi.org/10.1609/aaai.v33i01.33017080

[21] Wang Y., Yu B., Zhang Y., Liu T., and Zhu H., “Tplinker: Single-Stage Joint Extraction of Entities and Relations Throughtoken Pair Linking,” in Proceedings of the 28th International Conference on Computational Linguistics, Barcelona, pp. 1572-1582, 2020. https://doi.org/10.48550/arXiv.2010.13415

[22] Wei Z., Su J., Wang Y., Tian Y., and Cheng Y., “A Novel Cascade Binary Tagging Framework for Relational Triple Extraction,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1476-1488, 2020. 10.18653/v1/2020.acl-main.136

[23] Zeng D., Zhang R., and Liu Q., “Copy Mtl: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning,” Proceedings of AAAI Conference on Artificial Intelligence, vol. 34, no. 5, pp. 9507-9514, 2020. https://doi.org/10.48550/arXiv.1911.10438

[24] Zeng X., Zeng D., He S., Kang L., and Zhao J., “Extracting Relational Facts by an End to End Neural= Model with= Copy= Mechanism,” in Proceedings of= the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne,= pp. 50SJ514,= 2018K=DOI:= 10.18653/v1/P1UJ1047=

[25] Zhao K., Xu H., Cheng Y., Li X., and Gao K., “Representation Iterative Fusion Based on Heterogeneous Graph Neural= Network for Joint Entity= and Relation= Extraction,” Knowledge- Based Systems, vol. 219, pp. 106888-106897, Joint Extraction of Organizations and Relations for Emergency Response Plans ... 889 2021. https://doi.org/10.1016/j.knosys.2021.106888

[26] Zheng S., Hao Y., Lu D., Bao H., and Xu J., “Joint Entity and Relation Extraction Based on a Hybrid Neural Network,” Neurocomputing, vol. 257, pp. 59-66, 2017. https://doi.org/10.1016/j.neucom.2016.12.075

[27] Zheng S., Wang F., Bao H., Hao Y., and Zhou P., “Joint Extraction of Entities and Relations Based on= a Novel Tagging Scheme,” in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, pp. 1227- 1236, 2017K 10.18653/v1/P17-1113

[28] Zhou Y., Huang L., Guo T., Hu S., and Han J., “An Attention-Based Model for Joint Extraction of Entities and Relations with Implicit Entity Features,” in Proceedings of the World Wide Web Conference, San Francisco, pp. 729-737, 2019. https://doi.org/10.1145/3308560.3317704

[29] Zohaib A., Muhammad Q., Aasma M., and Parveen M., “Echo State Network Optimization Using Hybrid-Structure Based Gravitational Search Algorithm with Square Quadratic Programming for Time Series Prediction,” The International Arab Journal of Information Technology, vol. 19, no. 3A, pp. 530-535, 2022. 10.34028/iajit/19/3A/13