基于CNN-BiLSTM模型的在线医疗实体抽取研究

doi:10.13266/j.issn.0252-3116.2019.12.014

图书情报工作 ›› 2019, Vol. 63 ›› Issue (12): 105-113.DOI: 10.13266/j.issn.0252-3116.2019.12.014

基于CNN-BiLSTM模型的在线医疗实体抽取研究

陈德鑫^1,2, 占袁圆^1,2, 杨兵^1,2, 谢亚霓³

1. 湖北大学教育学院武汉 430062;
2. 湖北大学智慧学习研究中心武汉 430062;
3. 荆门市图书馆荆门 448000

收稿日期:2018-10-09 修回日期:2019-01-07 出版日期:2019-06-20 发布日期:2019-06-20
作者简介:陈德鑫(ORCID:0000-0003-2627-6585),讲师,博士,E-mail:202chendexin@163.com;占袁圆(ORCID:0000-0001-8981-6564),本科生;杨兵(ORCID:0000-0002-2774-0282),副院长,教授,博士;谢亚霓(ORCID:0000-0001-8537-7402),馆员。
基金资助:
本文系湖北省自然科学基金项目"基于深度学习的网络用户心理健康状态研究"（项目编号：2018CFB315）研究成果之一。

Research on Extraction of Online Medical Entities Based on Mixed Deep Learning Model

Chen Dexin^1,2, Zhan Yuanyuan^1,2, Yang Bing^1,2, Xie Yani³

1. School of Education, Hubei University, Wuhan 430062;
2. Smart Learning Center, Hubei University, Wuhan 430062;
3. Jingmen Library, Jingmen 448000

Received:2018-10-09 Revised:2019-01-07 Online:2019-06-20 Published:2019-06-20

摘要/Abstract

摘要： [目的/意义]在线医疗信息抽取是实现医疗信息检索、医疗信息推荐、个人医疗健康提醒及警示、疾病诊断、公众健康监控、药物不良反应挖掘等服务的基础环节，而医疗实体抽取则是在线医疗信息抽取的首要工作。本文拟解决传统医疗实体抽取严重依赖于人工特征提取且效率低的问题。[方法/过程]以网络文本为研究对象，首先对医疗实体类型和医疗实体抽取的目标进行描述。将在线医疗文本中的医疗实体抽取任务看作序列标注问题来解决，通过对CNN模型和BiLSTM模型基础理论的探讨，构建基于混合深度学习模型CNN-BiLSTM的医疗实体抽取框架。[结果/结论]通过三组对比实验，验证了本文所使用的CNN-BiLSTM模型在医疗实体抽取任务中的有效性。

关键词: 深度学习, 卷积神经网络, 双向长短记忆模型, 医疗实体

Abstract: [Purpose/significance] Online medical information extraction is the basic link to achieve medical information retrieval, medical information recommendation, personal medical health reminder and warning, disease diagnosis, public health monitoring, drug adverse reaction mining and other services, while medical entity extraction is the primary work of online medical information extraction. This paper aims to solve the problem that traditional medical entity extraction relies heavily on artificial feature extraction and the problem of low efficiency.[Method/process] Taking network text as the research object, this paper firstly describes the type of medical entity and the target of extraction of medical entity. Online entity extraction task in medical text was considered a sequence labeling problem to solve, the paper discussed the basic theories of BiLSTM model and the CNN model, and built a model based on hybrid deep learning CNN-BiLSTM medical entity extraction framework.[Result/conclusion] At last, the effectiveness of the CNN-BiLSTM model in the medical entity extraction task was verified through three comparison experiments.

Key words: deep learning, convolutional neural network, bi-directional long short term memory networks, medical entities

中图分类号:

陈德鑫, 占袁圆, 杨兵, 谢亚霓. 基于CNN-BiLSTM模型的在线医疗实体抽取研究[J]. 图书情报工作, 2019, 63(12): 105-113.

Chen Dexin, Zhan Yuanyuan, Yang Bing, Xie Yani. Research on Extraction of Online Medical Entities Based on Mixed Deep Learning Model[J]. LIS, 2019, 63(12): 105-113.

参考文献

[1] 程健一. 中文电子病历实体关系抽取研究[D]. 哈尔滨:哈尔滨工业大学, 2016.
[2] WEI Q, CHEN T, XU R, et al. Disease named entity recognition by combining conditional random fields and bidirectional recurrent neural networks[J]. Database:the journal of biological databases & curation, 2016(1):1-8.
[3] 杨锦锋,于秋滨,关毅,等. 电子病历命名实体识别和实体关系抽取研究综述[J]. 自动化学报, 2014, 40(8):1537-1562.
[4] 龙光宇, 徐云. CRF与词典相结合的疾病命名实体识别[J]. 微型机与应用, 2017(21):51-53.
[5] LIU H, QIN X, FU B. The symptoms and pathogenesis entity recognition of TCM medical records based on CRF[C]//Proceedings of the 2017 international workshop on big data and information security. New York:IEEE, 2016:1479-1484.
[6] 苏娅, 刘杰, 黄亚楼. 在线医疗文本中的实体识别研究[J]. 北京大学学报(自然科学版), 2016, 52(1):1-9.
[7] CHIU J P C, NICHOLS E. Named entity recognition with bidirectional LSTM-CNNs[J]. Transactions of the Association for Computational Linguistics, 2016, 4(1):357-370.
[8] 杨红梅, 李琳, 杨日东,等. 基于双向LSTM神经网络电子病历命名实体的识别模型[J]. 中国组织工程研究, 2018(20):3237-3242.
[9] 吴嘉伟, 关毅, 吕新波. 基于深度学习的电子病历中实体关系抽取[J]. 智能计算机与应用, 2014, 4(3):35-38.
[10] XU K, ZHOU Z, HAO T, et al. A bidirectional LSTM and conditional random fields approach to medical named entity recognition[C]//Proceedings of the international conference on advanced intelligent systems and informatics 2017. Berlin:Springer, 2018:355-365.
[11] DONG X, CHOWDHURY S, QIAN L, et al. Transfer bi-directional LSTM RNN for named entity recognition in Chinese electronic medical records[C]//Proceedings of the international conference on E-Health networking, applications and services. New York:IEEE, 2017:1-4.
[12] MIOTTO R, WANG F, WANG S, et al. Deep learning for healthcare:review, opportunities and challenges[J]. Briefings in bioinformatics, 2017,19(6):1236-1246.
[13] i2b2. 2010i2b2/VA challenge evaluation concept annotation guidelines[EB/OL].[2018-02-18].https://www.i2b2.org/NLP/Relations/assets/Concept%20Annotation%20Guideline.pdf.
[14] KOUTNIK J, GREFF K, GOMEZ F, et al. A clockwork RNN[J]. Computer science, 2014:1863-1871.
[15] VU N T, ADEL H, GUPTA P, et al. Combining recurrent and convolutional neural networks for relation classification[C]//Proceedings of NAACL-HLT. Stroudsburg:ACL, 2016:534-539.
[16] WEN Y, ZHANG W, LUO R, et al. Learning text representation using recurrent convolutional neural network with highway layers[C]//Proceedings of Neu-IR'6 SIGIR workshop on neural information retrieval. New York:ACM, 2016:1-5.
[17] ADEL H, SCHUTZE H. Exploring different dimensions of attention for uncertainty detection[C]//Proceedings of the 15th conference of the European chapter of the Association for Computational Linguistics. Stroudsburg:ACL, 2017(1):22-34.
[18] YIN W, SCHUTZE H, XIANG B, et al. ABCNN:attention-based convolutional neural network for modeling sentence pairs[J]. Transactions of the Association for Computational Linguistics, 2016(4):259-272.
[19] DAUPHIN Y N, FAN A, AULI M, et al. Language modeling with gated convolutional networks[C]//Proceedings of the 34th international conference on machine learning. Sydney:The Journal of Machine Learning Research, 2017:1-9.
[20] ARKHIPENKO K, KOZLOV I, TROFIMOVICH J, et al. Comparison of neural network architectures for sentiment analysis of Russian Tweets[C]//Proceedings of the international conference "Dialogue 2016". Moscow:Computational Linguistics and Intellectual Technologies, 2016:1-10.
[21] HE K, ZHANG X, REN S, et al. Delving deep into rectifiers:Surpassing human-level performance on imagenet classification[C]//Proceedings of the IEEE international conference on computer vision. New York:IEEE, 2015:1026-1034.
[22] SANTOS C N D, ZADROZNY B. Learning character-level representations for part-of-speech tagging[C]//Proceedings of international conference on machine learning. Beijing:JMLR, 2014:1818-1826.
[23] GRAVES A, SCHMIDHUBER J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures[J]. Neural Netw, 2005, 18(5):602-610.
[24] RAMSHAW L A, MARCUS M P. Text Chunking using transformation-based learning[J]. Text speech & language technology, 1995, 11(5):82-94.
[25] GRAVES A, MOHAMED A R, HINTON G. Speech recognition with deep recurrent neural networks[C]//Proceedings of IEEE international conference on acoustics, speech and signal processing. New York:IEEE, 2013:6645-6649.

基于CNN-BiLSTM模型的在线医疗实体抽取研究

Research on Extraction of Online Medical Entities Based on Mixed Deep Learning Model

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	袁毅, 陶鑫琪, 李瑾萱, 刘娅娴, 汪晓芸, 景香玉. 基于招聘文本实体挖掘的人才供需分析——以人工智能领域为例[J]. 图书情报工作, 2022, 66(14): 101-118.
[2]	韩普, 顾亮. 基于混合深度学习的中文医学实体抽取研究[J]. 图书情报工作, 2022, 66(14): 119-127.
[3]	周潇, 许银彪, 史益. 基于深度学习与语义挖掘的技术创新组合识别与追踪[J]. 图书情报工作, 2022, 66(10): 33-44.
[4]	李娜, 姜恩波, 朱一真, 刘婷. 政策工具自动识别方法与实证研究[J]. 图书情报工作, 2021, 65(7): 115-122.
[5]	杜悦, 王东波, 江川, 徐润华, 李斌, 许超, 徐晨飞. 数字人文下的典籍深度学习实体自动识别模型构建及应用研究[J]. 图书情报工作, 2021, 65(3): 100-108.
[6]	李旭晖, 程威, 唐小雅, 于滔, 陈壮, 钱铁云. 基于多层卷积神经网络的金融事件联合抽取方法[J]. 图书情报工作, 2021, 65(24): 89-99.
[7]	桂美增, 许学国. 基于深度学习的技术机会预测研究——以新能源汽车为例[J]. 图书情报工作, 2021, 65(19): 130-141.
[8]	孔德婧, 董放, 陈子婧, 刘宇涵, 周源. 离群专利视角下的新兴技术预测——基于BERT模型和深度神经网络[J]. 图书情报工作, 2021, 65(17): 131-141.
[9]	钱力, 刘细文, 张智雄, 刘会洲. AI+智慧知识服务生态体系研究设计与应用实践——以中国科学院文献情报中心智慧服务平台建设为例[J]. 图书情报工作, 2021, 65(15): 78-90.
[10]	雷兵, 刘小, 钟镇. 基于题录信息的领域学术文献细粒度分类方法研究[J]. 图书情报工作, 2021, 65(14): 128-137.
[11]	林泽斐, 欧石燕. 融合结构与文本特征的知识图谱关系预测方法研究[J]. 图书情报工作, 2020, 64(21): 99-110.
[12]	李慧, 胡吉霞. 一种基于图卷积自编码模型的多维度学科知识网络融合方法[J]. 图书情报工作, 2020, 64(18): 114-125.
[13]	易明, 张婷婷, 李梓. 多维特征下社会化问答社区答案排序研究[J]. 图书情报工作, 2020, 64(17): 103-113.
[14]	余传明, 王曼怡, 安璐. 跨语言情境下基于对抗的实体关系抽取模型研究[J]. 图书情报工作, 2020, 64(17): 131-144.
[15]	吕璐成, 韩涛, 周健, 赵亚娟. 基于深度学习的中文专利自动分类方法研究[J]. 图书情报工作, 2020, 64(10): 75-85.