A joint-embedding framework fusing multi-feature information for cultural relic entity alignment in knowledge graphs

Authors

  • Min Zhang School of Information Engineering, Shaanxi Xueqian Normal University, China
  • Luya Yang School of Information Engineering, Shaanxi Xueqian Normal University, China
  • Yaxian Gao School of Information Engineering, Shaanxi Xueqian Normal University, China
  • Yong Ren Xi’an Shiyou University, China

DOI:

https://doi.org/10.15837/ijccc.2026.4.7233

Keywords:

Multi-feature fusion, entity alignment, Joint-embedding, Encyclopedic knowledge base

Abstract

Entity alignment across multi-source knowledge bases is frequently hindered by the problem of ’heterogeneous names but equivalent semantics,’ a challenge that becomes particularly acute in domains with specialized nomenclature and rare characters, such as cultural relics. To address this universal issue, this paper proposes a joint-embedding framework, MulF-ELMo-BERT, suitable for entity alignment in cultural relic knowledge graphs. This framework integrates multi-dimensional features such as entity names, attributes, summaries, and full-text texts, achieving comprehensive extraction of entity features from four levels: characters, words, sentences, and paragraphs. It effectively filters out weakly relevant entities and breaks through the limitations of semantic representation relying solely on a single feature. Given the dense presence of rare characters and specialized terms in cultural relic entity names, the ELMo context-aware word embedding model is introduced. It can dynamically adjust the vector representation of rare words based on their context, significantly enhancing semantic adaptability. Meanwhile, a Chinese BERT model with an integrated whole-word masking strategy is adopted to avoid local co-occurrence interference

References

Zhang, R.; Trisedya, B.D.; Li, M.; Jiang, Y.; Qi, J. (2022). A benchmark and comprehensive survey on knowledge graph entity alignment via representation learning, The VLDB Journal, 31(5), 1143-1168, 2022. https://doi.org/10.1007/s00778-022-00747-z

Hyvönen, E.; Rantala, H. (2019). Knowledge-based Relation Discovery in Cultural Heritage Knowledge Graphs, DHN 2019: Proceedings of the Digital Humanities in the Nordic Countries 4th Conference, Copenhagen, Denmark, March 5-8, 2019, 230-239, 2019. https://doi.org/10.5617/dhnbpub.11098

Gerlach, M.; Miller, M.; Ho, R.; Harlan, K.; Difallah, D. (2021, October). Multilingual entity linking system for wikipedia with a machine-in-the-loop approach, Proceedings of the 30th ACM International Conference on Information and Knowledge Management, 3818-3827, 2021. https://doi.org/10.1145/3459637.3481939

Gabrilovich, E.; Markovitch, S. (2007). Computing semantic relatedness using Wikipedia-based explicit semantic analysis, IJCAI'07: Proceedings of International Joint Conference on Artificial Intelligence, Macao, August 10-16, 2007, 1606-1611, 2007.

Lin, L.; Hao, T. (2024). An end-to-end entity recognition and disambiguation framework for identifying Author Affiliation from literature publications, Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024), 120-129, 2024. https://doi.org/10.18653/v1/2024.sdp-1.11

Zhang, F.; Li, J.; Cheng, J. (2023). Improving entity alignment via attribute and external knowledge filtering, Applied Intelligence, 53(6), 6671-6681, 2023. https://doi.org/10.1007/s10489-022-03744-5

Yang, K.; Liu, S.; Zhao, J.; et al. (2020). COTSAE: co-training of structure and attribute embeddings for entity alignment, Proceedings of the AAAI Conference on Artificial Intelligence, 34(03), 3025-3032, 2020. https://doi.org/10.1609/aaai.v34i03.5696

Wang, L.; Lu, L.; Jiang, N. (2011). A study of leaf modeling technology based on morphological features, Mathematical and Computer Modelling, 54(3-4), 1107-1114, 2011.

Tam, N.T.; Trung, H.T.; Yin, H.; et al. (2020). Entity alignment for knowledge graphs with multi-order convolutional networks, IEEE Transactions on Knowledge and Data Engineering, 34(9), 4201-4214, 2020. https://doi.org/10.1109/TKDE.2020.3038654

Wang, L.; He, Y.; Zhou, S.; Lu, L. (2013). Modeling and visualization based on morphological features of leaf vein, Sensor Letters, 11(6-7), 1288-1292, 2013. https://doi.org/10.1166/sl.2013.2859

Li, Y.; Xu, T.; Sun, Z.; et al. (2024). Entity Alignment Through Joint Utilization of Multiple Pretrained Models for Attribution Relationship, 2024 IEEE 11th International Conference on Cyber Security and Cloud Computing (CSCloud), IEEE, 1-6, 2024. https://doi.org/10.1109/CSCloud62866.2024.00008

Sun, Y.; Lee, Y. (2024). Embedding-based Two-Stage Entity Alignment for Cross-Lingual Knowledge Graphs, Journal of Information Science and Engineering, 40(2), 2024.

Zhong, Z.; Zhang, M.; Fan, J.; et al. (2022). Semantics driven embedding learning for effective entity alignment, 2022 IEEE 38th International Conference on Data Engineering (ICDE), IEEE, 2127-2140, 2022.

Ge, C.; Liu, X.; Chen, L.; et al. (2021). Make it easy: An effective end-to-end entity alignment framework, Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, 777-786, 2021. https://doi.org/10.1145/3404835.3462870

Liu, Z.; Cao, Y.; Pan, L.; et al. (2020). Exploring and evaluating attributes, values, and structures for entity alignment, arxiv preprint arxiv:2010.03249, 2020. https://doi.org/10.18653/v1/2020.emnlp-main.515

Paganelli, M.; Tiano, D.; Guerra, F. (2024). A multi-facet analysis of bert-based entity matching models, The VLDB Journal, 33(4), 1039-1064, 2024. https://doi.org/10.1007/s00778-023-00824-x

Huang, J.; Li, T.; Jia, Z.; et al. (2016). Entity alignment of Chinese heterogeneous encyclopedia knowledge base, Journal of computational and applied, 7(36), 1881-1886, 2016.

Zhang, C.; Chen, L.; Li, Q. (2016). Chinese text similarity algorithm based on PST_LDA, Application Research of Computers, 33(2), 375-377,383, 2016.

Deng, Y.; Chen, L.; Wu, Y.; et al. (2023). Event entity alignment for multi-source encyclopedia knowledge bases with the similarity of event element sets, Third International Seminar on Artificial Intelligence, Networking, and Information Technology (AINIT 2022), SPIE, 12587, 144-151, 2023. https://doi.org/10.1117/12.2667213

Bordes, A.; Usunier, N.; Garcia-Duran, A.; Weston, J.; Yakhnenko, O. (2013). Translating embeddings for modeling multi-relational data, Advances in neural information processing systems 26, 2013.

Yoon, S.; Ko, S.; Kim, T.; et al. (2025). Unsupervised Robust Cross-Lingual Entity Alignment via Neighbor Triple Matching with Entity and Relation Texts, Proceedings of the Eighteenth ACM International Conference on Web Search and Data Mining, 184-193, 2025. https://doi.org/10.1145/3701551.3703500

Kolyvakis, P.; Kalousis, A.; Kiritsis, D. (2018). Deepalignment: Unsupervised ontology matching with refined word vectors, Proceedings of the 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 1-6 June 2018, 2018. https://doi.org/10.18653/v1/N18-1072

Shahbazi, H.; Fern, X.Z.; Ghaeini, R.; et al. (2019). Entity-aware elmo: Learning contextual entity representation for entity disambiguation, arxiv preprint arxiv:1908.05762, 2019.

Wu, Y.; Liu, X.; Feng, Y.; et al. (2019). Relation-aware entity alignment for heterogeneous knowledge graphs, arxiv preprint arxiv:1908.08210, 2019. https://doi.org/10.24963/ijcai.2019/733

Zhu, Y.; Liu, H.; Wu, Z.; et al. (2021). Relation-aware neighborhood matching model for entity alignment, Proceedings of the AAAI Conference on Artificial Intelligence, 35(5), 4749-4756, 2021. https://doi.org/10.1609/aaai.v35i5.16606

Bai, L.; Song, C.; Zhu, L. (2024). Joint multi-feature information entity alignment for crosslingual temporal knowledge graph with bert, IEEE Transactions on Big Data, 11(2), 345-358, 2024. https://doi.org/10.1109/TBDATA.2024.3378113

Liu, Y.; Ott, M.; Goyal, N.; Du, J.; Joshi, M.; Chen, D.; Levy, O.; Lewis, M.; Zettlemoyer, L.; Stoyanov, V. (2019). RoBERTa: A robustly optimized BERT pretraining approach, arXiv preprint arXiv:1907.11692, 2019.

Zhang, Z.; Han, X.; Liu, Z.; Jiang, X.; Sun, M.; Liu, Q. (2019). ERNIE: Enhanced Language Representation with Informative Entities, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, July 28-August 2, 2019, pp. 1441-1451, 2019. https://doi.org/10.18653/v1/P19-1139

Yang, Z.; Dai, Z.; Yang, Y.; Carbonell, J.; Salakhutdinov, R.; Le, Q. V. (2019). XLNet: Generalized Autoregressive Pretraining for Language Understanding, Advances in Neural Information Processing Systems, Vol. 32, pp. 5753-5763, 2019.

Additional Files

Published

2026-07-07

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.