基于文本分块的多模板隐马尔可夫模型的文本信息抽取

基于文本分块的多模板隐马尔可夫模型的文本信息抽取

王雷^1,2，陈治平^1,2，李志成³

1. 福建工程学院计算机与信息科学系, 福建福州350014; 2. 清华大学计算机与信息科学系, 北京100084;

收稿日期:2006-04-01 修回日期:1900-01-01 出版日期:2006-10-24 发布日期:2006-10-24
通讯作者: 王雷

Using text blocks based on multiple templates hidden markov model for text information extraction

WANG Lei,CHEN Zhi-ping,LI Zhi-cheng

1. Department of Computer & Information Science, Fujian University of Technology, Fuzhou 350014, Fujian, China；

Received:2006-04-01 Revised:1900-01-01 Online:2006-10-24 Published:2006-10-24
Contact: WANG Lei

摘要/Abstract

摘要： 针对文本信息抽取中训练数据来源的多样化，不利于学习到最优的模型参数的问题，提出了一种基于多模板隐马尔可夫模型的文本信息抽取算法. 新算法利用文本排版格式、分隔符等信息，对文本进行分块，在此基础上，通过对训练数据分成多个形式模板训练隐马尔可夫初始概率及转移概率参数，最后，结合统一训练的释放概率参数，对文本信息进行抽取. 实验结果表明，新算法在精确度和召回率指标上比简单隐马尔可夫模型具有更好的性能.

关键词: 文本信息抽取, 隐马尔可夫模型, 文本分块 , 多模板

Abstract: Since varied training data sources are not profitable for the learning of optimal model parameters, then a novel text information extraction algorithm based on hidden Markov model with multiple templates is proposed, which makes use of the information of format and list separators to segment text, and then extracts text information through combining theparameters of releasing probability for universal training, using multiple form templates to train the parameters of initial probability and transition probability for hidden Markov mode. Experimental results show better performance in precision and recall over simple hidden Markov model.

Key words: text block , multiple templates, hidden markov model, text information extraction

王雷,陈治平,李志成 . 基于文本分块的多模板隐马尔可夫模型的文本信息抽取[J]. J4, 2006, 41(3): 19-24 .

WANG Lei,CHEN Zhi-ping,LI Zhi-cheng . Using text blocks based on multiple templates hidden markov model for text information extraction[J]. J4, 2006, 41(3): 19-24 .

参考文献

多维度评价

Viewed

Full text

Abstract

Cited

Shared

Discussed