基于编辑距离的中文组织机构名简称-全称匹配算法

J4 ›› 2012, Vol. 47 ›› Issue (5): 43-48.

基于编辑距离的中文组织机构名简称-全称匹配算法

黄林晟^1,邓志鸿^1,2,唐世渭^1,2,王文清^3,陈凌³

1. 北京大学信息科学技术学院, 北京 100871;
2. 北京大学信息科学技术学院机器感知与智能教育部重点实验室, 北京 100871;
3. 中国高等教育文献保障系统(CALIS)管理中心, 北京 100871

收稿日期:2011-11-10 出版日期:2012-05-20 发布日期:2012-06-01
作者简介:黄林晟(1988- ),男,硕士研究生,主要研究方向为数字图书馆和数字博物馆.Email:lshuang1101@gmail.com
基金资助:
国家“八六三”高技术研究发展计划基金资助项目(2009AA01Z136);国家自然科学基金资助项目(90812001);国家教育部“211工程”中国高等教育文献保障系统(CALIS)三期建设项目。

A Chinese organization′s full name and matching abbreviation algorithm based on edit-distance

HUANG Lin-sheng¹, DENG Zhi-hong^1,2, TANG Shi-wei^1,2, WANG Wen-qing³, CHEN Ling³

1. School of Electronics Engineering and Computer Science, Peking University, Beijing 100871, China;
2. Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 100871, China;
3. Administrative Center of China Academic Library and Information System, Beijing 100871, China

Received:2011-11-10 Online:2012-05-20 Published:2012-06-01

摘要/Abstract

摘要：

在面对中文语言环境下组织机构名简称-全称匹配这一具体问题时,经典的基于编辑距离进行字符串相似匹配方法的实用性有所下降。基于编辑距离的思想,提出了一种改进匹配算法:首先对简称和全称进行分词,以切合中文的语法结构特点;之后结合重定义的词汇语义相似度度量方法,修改编辑操作权重,并通过自适应学习的方式进一步修正;最后选择与简称编辑距离最小的全称作为匹配结果。实验结果表明,该算法匹配准确率比原始方法有较大提升。

关键词: 文本挖掘;机器学习;编辑距离;组织机构名;简称-全称匹配

Abstract:

When dealing with the specific problem of a Chinese organization′s full name and matching abbreviation, the traditional string matching algorithm based on editdistance performs poorly. A new algorithm, also based on editdistance, was provided. The improvements include the following steps: (1) making the Chinese word segmentation fit the Chinese grammatical structure features, (2) modifying the editoperation weights with the redefined semantic similarity, (3) adjusting these weights by adaptive learning, and (4) choosing the full name with minimum edit-distance as the matching result. Experimental results show that our algorithm can effectively achieve higher abbreviationfull name matching accuracy.

Key words: text mining; machine learning; edit distance; organization name; abbreviation-full name match

黄林晟1,邓志鸿1,2,唐世渭1,2,王文清3,陈凌3. 基于编辑距离的中文组织机构名简称-全称匹配算法[J]. J4, 2012, 47(5): 43-48.

HUANG Lin-sheng1, DENG Zhi-hong1,2, TANG Shi-wei1,2, WANG Wen-qing3, CHEN Ling3. A Chinese organization′s full name and matching abbreviation algorithm based on edit-distance[J]. J4, 2012, 47(5): 43-48.

参考文献

多维度评价

Viewed

Full text

Abstract

Cited

Shared

Discussed