You Position: Home > Paper

Diabetes named entity recognition based on feature fusion

( views:1, downloads:0 )
Author:
No author available
Journal Title:
Chinese Journal of Medical Physics
Issue:
7
DOI:
10.3969/j.issn.1005-202X.2024.07.016
Key Word:
糖尿病;命名实体识别;特征融合;注意力机制;diabetes;named entity recognition;feature fusion;attention mechanism

Abstract: To overcome the challenges of entity diversity and data scarcity in diabetes named entity recognition,feature fusion based named entity recognition is proposed.With BERT+BILSTM+CRF as the benchmark model,improvements are made in 3 aspects.(1)The pre-trained model RoBERTa-wwm-ext is introduced as the model embedding layer to provide character-level embedding,and the whole word mask is used in the training stage to obtain semantic representation containing prior knowledge.(2)bidirectional long short-term memory network and iterated dilated convolutional neural network are used to extract features in parallel to obtain features of different granularities.At the same time,the dynamic feature fusion is combined with the attention mechanism to better understand the key information of the data,thus obtaining richer contextual features.(3)The conditional random field is decoded to obtain the final prediction results.The proposed model achieves an F1 value of 79.58%which is 5.38%higher than High-Order MKGraph on DiaKG,a Chinese diabetes data set containing 18 entity categories,fully demonstrating that the feature fusion based method can effectively identify diabetic entities.

  • This article has no references!
WanfangData CO.,Ltd All Rights Reserved
About WanfangData | Contact US
Healthcare Department, Fuxing Road NO.15, Haidian District Beijing, 100038 P.R.China
Tel:+86-010-58882616 Fax:+86-010-58882615 Email:yiyao@wanfangdata.com.cn
Baidu
map