融合结构与文本特征的知识图谱关系预测方法研究

doi:10.13266/j.issn.0252-3116.2020.21.013

图书情报工作 ›› 2020, Vol. 64 ›› Issue (21): 99-110.DOI: 10.13266/j.issn.0252-3116.2020.21.013

融合结构与文本特征的知识图谱关系预测方法研究

林泽斐^1,2, 欧石燕¹

1. 南京大学信息管理学院南京 210093;
2. 福建师范大学社会发展学院福州 350007

收稿日期:2020-06-09 修回日期:2020-08-19 出版日期:2020-11-05 发布日期:2020-11-05
通讯作者: 欧石燕(ORCID:0000-0001-8617-6987),教授,博士生导师,通讯作者,E-mail:oushiyan@nju.edu.cn
作者简介:林泽斐(ORCID:0000-0001-8637-7359),讲师,博士研究生。
基金资助:
本文系国家社会科学基金重点项目"基于关联数据的学术文献内容语义发布及其应用研究"（项目编号：17ATQ001）研究成果之一。

Research on Relation Prediction in Knowledge Graphs by Fusing Structure and Text Features

Lin Zefei^1,2, Ou Shiyan¹

1 School of Information Management, Nanjing University, Nanjing 210093;
2 College of Social Development, Fujian Normal University, Fuzhou 350007

Received:2020-06-09 Revised:2020-08-19 Online:2020-11-05 Published:2020-11-05
Supported by:

摘要/Abstract

摘要： [目的/意义] 提出一种融合内部结构特征和外部文本特征的知识图谱关系预测新方法，旨在预测知识图谱中两实体间缺失关系的类型。[方法/过程] 将关系路径和反映实体间关系的文本矩阵化，通过卷积神经网络学习与特定关系类型相关的结构和文本模式特征，在此基础上训练模型实现关系预测。[结果/结论] 实验结果显示，该方法在评测数据集上的性能表现超过对照方法的水平，可有效提升知识图谱关系预测的性能。通过实际应用发现，该方法在知识服务中具有良好的应用价值。

关键词: 知识图谱, 关系预测, 特征融合, 深度学习

Abstract: [Purpose/significance] Relation prediction is an important task in knowledge graph completion, and plays an important role in improving the completeness of knowledge in knowledge graphs. The paper proposes a new relation prediction method that combines internal structure features and external text features, which aims to predict the missing relations between two entities in knowledge graphs. [Method/process] The method transforms the relation paths in a knowledge graph and the texts that involve entity relationships into matrixes, learns the structure features and text pattern features related to a specific relation type through convolutional neural networks, and then trains a model based on the learned features for relation prediction. [Result/conclusion] The results shows that the performance of our proposed method on evaluation data sets is superior to the state-of-the-art approaches, and the method can effectively improves the performance of knowledge graph relationship prediction. Through practical application, it wvas found that this method has high application value in knowledge services.

Key words: knowledge graph, relation prediction, feature fusion, deep learning

中图分类号:

林泽斐, 欧石燕. 融合结构与文本特征的知识图谱关系预测方法研究[J]. 图书情报工作, 2020, 64(21): 99-110.

Lin Zefei, Ou Shiyan. Research on Relation Prediction in Knowledge Graphs by Fusing Structure and Text Features[J]. LIS, 2020, 64(21): 99-110.

参考文献

[1] KEJRIWAL M. Domain-specific knowledge graph construction[M]. Berlin:Springer, 2019.
[2] 孙雨生,常凯月,朱礼军. 大规模知识图谱及其应用研究[J]. 情报理论与实践, 2018, 41(11):138-143.
[3] KROMPAβ D, BAIER S, TRESP V. Type-constrained representation learning in knowledge graphs[C]//Proceedings of international Semantic Web conference. Berlin:Springer, 2015:640-655.
[4] FAN M, ZHOU Q, ZHENG T F, et al. Distributed representation learning for knowledge graphs with entity descriptions[J]. Pattern recognition letters, 2017, 93(7):31-37.
[5] 复旦大学知识工场实验室. 中文通用百科知识图谱(CN-DBpedia)[EB/OL].[2020-07-21]. http://openkg.cn/dataset/cndbpedia.
[6] NGUYEN D Q, SIRTS K, QU L, et al. Neighborhood mixture model for knowledge base completion[C]//Proceedings of the 20th SIGNLL conference on computational natural language learning. Stroudsburg:ACL Press, 2016:40-50.
[7] 徐增林,盛泳潘,贺丽荣,等. 知识图谱技术综述[J]. 电子科技大学学报, 2016, 45(4):589-606.
[8] 刘知远,孙茂松,林衍凯,等. 知识表示学习研究进展[J]. 计算机研究与发展, 2016, 53(2):247-261.
[9] BORDES A, USUNIER N, GARCIA-DURAN A, et al. Translating embeddings for modeling multi-relational data[C]//Proceedings of advances in neural information processing systems. San Diego:Neural Information Processing Systems Foundation, 2013:2787-2795.
[10] WANG Z, ZHANG J, FENG J, et al. Knowledge graph embedding by translating on hyperplanes[C]//Proceedings of the 28th AAAI conference on artificial intelligence. Palo Alto:AAAI Press, 2014:1112-1119.
[11] LIN Y, LIU Z, SUN M, et al. Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the 28th AAAI conference on artificial intelligence. Palo Alto:AAAI Press, 2015:2181-2187.
[12] JI G, HE S, XU L, et al. Knowledge graph embedding via dynamic mapping matrix[C]//Proceedings of the 53rd annual meeting of the ACL and the 7th international joint conference on NLP. Stroudsburg:ACL Press, 2015:687-696.
[13] 聂斌玲. 基于图结构信息的知识表示学习方法研究[D]. 杭州:浙江大学, 2019.
[14] NICKEL M, TRESP V, KRIEGEL H P. A three-way model for collective learning on multi-relational data[C]//Proceedings of the 28th international conference on machine learning. New York:ACM Press, 2011:809-816.
[15] YANG B, YIH S W, HE X, et al. Embedding entities and relations for learning and inference in knowledge bases[EB/OL].[2020-08-16]. https://arxiv.org/pdf/1412.6575.
[16] TROUILLON T, WELBL J, RIEDEL S, et al. Complex embeddings for simple link prediction[C]//Proceedings of the 33rd international conference on machine learning. New York:ACM Press, 2016:2071-2080.
[17] LAO N, MITCHELL T,COHEN W W. Random walk inference and learning in a large scale knowledge base[C]//Proceedings of the 2011 conference on empirical methods in natural language processing. Stroudsburg:ACL Press, 2011:529-539.
[18] 刘峤,韩明皓,江浏祎,等. 基于双层随机游走的关系推理算法[J]. 计算机学报, 2017, 40(6):1275-1290.
[19] XU J, CHEN K, QIU X, et al. Knowledge graph representation with jointly structural and textual encoding[C]//Proceedings of the 26th international joint conference on artificial intelligence. San Rafael:Morgan & Claypool Publishers, 2017:1318-1324.
[20] LONG T, LOWE R, CHEUNG J C, et al. Leveraging lexical resources for learning entity embeddings in multi-relational data[EB/OL].[2020-08-24]. https://arxiv.org/pdf/1605.05416.
[21] DETTMERS T, MINERVINI P, STENETORP P, et al. Convolutional 2d knowledge graph embeddings[C]//Proceedings of the 32th AAAI conference on artificial intelligence. Palo Alto:AAAI Press, 2018:1811-1818.
[22] HINTON G E, SRIVASTAVA N, KRIZHEVSKY A, et al. Improving neural networks by preventing co-adaptation of feature detectors[EB/OL].[2020-05-22]. https://arxiv.org/pdf/1207.0580.
[23] SURDEANU M, TIBSHIRANI J, NALLAPATI R, et al. Multi-instance multi-label learning for relation extraction[C]//Proceedings of the 2012 joint conference on EMNLP and computational natural language learning. Stroudsburg:ACL Press, 2012:455-465.
[24] KIM Y. Convolutional neural networks for sentence classification[C]//Proceedings of the 2014 conference on empirical methods in natural language processing. Stroudsburg:ACL Press, 2014:1746-1751.
[25] ADNAN WA, YAAKOB M, ANAS R, et al. Artificial neural network for software reliability assessment[C]//Proceedings of intelligent systems and technologies for the new millennium. Piscataway:IEEE, 2000:446-451.
[26] TOUTANOVA K, CHEN D. Observed versus latent features for knowledge base and text inference[C]//Proceedings of the 3rd workshop on continuous vector space models and their compositionality. Stroudsburg:ACL Press, 2015:57-66.
[27] Microsoft. FB15K-237 knowledge base completion dataset[EB/OL].[2020-08-10]. https://www.microsoft.com/en-us/download/details.aspx?id=52312.
[28] BISONG E. Building machine learning and deep learning models on google cloud platform[M]. Ottawa:Apress, 2019.
[29] HAN X, CAO S, LV X, et al. Openke:an open toolkit for knowledge embedding[C]//Proceedings of the 2018 conference on empirical methods in natural language processing. Stroudsburg:ACL Press, 2018:139-144.
[30] 林泽斐,欧石燕. 基于在线百科的大规模人物社会网络抽取与分析[J]. 中国图书馆学报, 2019, 45(6):100-118.

融合结构与文本特征的知识图谱关系预测方法研究

Research on Relation Prediction in Knowledge Graphs by Fusing Structure and Text Features

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	邓君, 王阮. 口述历史档案资源知识图谱与多维知识发现研究[J]. 图书情报工作, 2022, 66(7): 4-16.
[2]	卓可秋, 沈思, 王东波. 自有知识增强下的学术全文本关系抽取研究[J]. 图书情报工作, 2022, 66(7): 120-131.
[3]	周毅, 刘峥, 粟小青, 金体成. 融合多层次数据的问答知识图谱本体模型构建[J]. 图书情报工作, 2022, 66(5): 125-132.
[4]	宋雪雁, 张伟民, 张祥青. 基于档案文献的清代祭祀礼器知识图谱构建研究[J]. 图书情报工作, 2022, 66(3): 140-151.
[5]	董美, 常志军. 一种面向中医领域科技文献的实体关系抽取方法[J]. 图书情报工作, 2022, 66(18): 105-113.
[6]	高杰, 张立立, 黄新平. 融合知识图谱与DTM模型的我国社区治理政策变迁研究[J]. 图书情报工作, 2022, 66(17): 47-59.
[7]	袁毅, 陶鑫琪, 李瑾萱, 刘娅娴, 汪晓芸, 景香玉. 基于招聘文本实体挖掘的人才供需分析——以人工智能领域为例[J]. 图书情报工作, 2022, 66(14): 101-118.
[8]	韩普, 顾亮. 基于混合深度学习的中文医学实体抽取研究[J]. 图书情报工作, 2022, 66(14): 119-127.
[9]	曾子明, 张瑜, 李婷婷. 多特征融合的突发公共卫生事件潜在谣言传播者识别[J]. 图书情报工作, 2022, 66(13): 80-90.
[10]	赵蓉英, 朱伟杰, 常茹茹, 刘卓著. 话语权研究可视化分析：溯源、审视与演进[J]. 图书情报工作, 2022, 66(11): 4-13.
[11]	周潇, 许银彪, 史益. 基于深度学习与语义挖掘的技术创新组合识别与追踪[J]. 图书情报工作, 2022, 66(10): 33-44.
[12]	张国标, 李鹏程, 陆伟, 程齐凯. 多特征融合的关键词语义功能识别研究[J]. 图书情报工作, 2021, 65(9): 89-96.
[13]	李娜, 姜恩波, 朱一真, 刘婷. 政策工具自动识别方法与实证研究[J]. 图书情报工作, 2021, 65(7): 115-122.
[14]	欧阳剑, 梁珠芳, 任树怀. 大规模中国历代存世典籍知识图谱构建研究[J]. 图书情报工作, 2021, 65(5): 126-135.
[15]	杜悦, 王东波, 江川, 徐润华, 李斌, 许超, 徐晨飞. 数字人文下的典籍深度学习实体自动识别模型构建及应用研究[J]. 图书情报工作, 2021, 65(3): 100-108.