JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE) ›› 2015, Vol. 50 ›› Issue (01): 26-30.doi: 10.6040/j.issn.1671-9352.3.2014.014

Previous Articles     Next Articles

Finding potential errors in Chinese treebank based on inconsistencies

TAN Hong-ye, ZHAO Jian, CHEN Qian   

  1. College of Computer and Information Technology in Shanxi University, Taiyuan 030006, Shanxi, China
  • Received:2014-09-19 Revised:2014-11-25 Online:2015-01-20 Published:2015-01-24

PDF (PC)

969

Abstract: Corpora are fundamental to natural language processing(NLP) and corpus annotation quality influences the performance of the systems based on supervised machine learning approaches. Aiming at Chinese treebank, an approach was proposed to find potential errors based on inconsistencies. Inconsistencies were detected with two strategies: one uses similar internal structure and suspicious degree, the other uses the annotation guideline to check those annotations, which don't meet the definitions of the guideline. Experimental results show that there are some annotation errors in the inconsistencies.

Key words: inconsistencies, potential error, natural language processing, Chinese treebank

CLC Number: 

  • TP391
[1] 苗玺, 郑家恒. 中文语料库分词不一致的分类处理研究[J]. 山西大学学报:自然科学版, 2006,29(1):23-25. MIAO Xi, ZHENG Jiaheng. Classified study on inconsistency of segment for Chinese corpus[J]. Journal of Shanxi University: Natural Science Edition, 2006, 29(1):23-25.
[2] 刘江, 郑家恒, 张虎.中文文本语料库分词一致性检验技术的初探[J]. 计算机应用研究, 2005, 22(8):52-54. LIU Jiang, ZHENG Jiaheng, ZHANG Hu. Studies on the consistency o f word-segmented Chinese corpus[J]. Application Research of Computers, 2005, 22(8):52-54.
[3] 张虎, 郑家恒, 刘江. 语料库词性标注一致性检查方法研究[J]. 中文信息学报, 2004, 18(5):11-16. ZHANG Hu, ZHENG Jiaheng, LIU Jiang. The inspecting method study on consistence of part of speech tagging of corpus[J]. Journal of Chinese Information Processing, 2004, 18(5):11-16.
[4] 魏莉, 谭红叶, 郑家恒, 等. 汉语句法树库一致性检验方法研究[J]. 广西师范大学学报: 自然科学版, 2010(001):139-142. WEI Li, TAN Hongye, ZHENG Jiaheng,et al. Study of keeping consistency of Chinese corpus of complete parsing[J]. Journal of Guangxi Normal University: Natural Science Edition, 2010(001):139-142.
[5] KULICK S, BIES A. Treebank analysis and search using an extracted tree grammar[C]// Proceedings of the 8th International Workshop on Treebanks and Linguistic Theories, Milan: [s.n.], 2009:1-12.
[6] KULICK S, BIES A, MOTT J. Using derivation trees for treebank error detection[C]// Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies.Stroudsburg, PA, USA: Association for Computational Linguistics, 2011: 693-698.
[7] GARDENT C, NARAYAN S. Error mining on dependency trees[C]// Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, 2012: 592-600.
[8] DICKINSON M. Similarity and dissimilarity in treebank grammars[C]// Proceedings of the 18th International Congress of Linguists. Seoul:[s.n.], 2008: 1597-1611.
[9] VOLOKH A, NEUMANN G. Automatic detection and correction of errors in dependency tree-banks[C]// Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, PA, USA: Association for Computational Linguistics, 2011: 346-350.
[1] CHEN Ke-rui, PAN Jun. Multi-source data fusion based on the expand vector space model [J]. J4, 2013, 48(11): 87-92.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright 2018 © Editorial office of JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE)
Supported by Beijing Magtech Co.Ltd