Advanced SearchSearch Tips
Named Entity Recognition Using Distant Supervision and Active Bagging
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
  • Journal title : Journal of KIISE
  • Volume 43, Issue 2,  2016, pp.269-274
  • Publisher : Korean Institute of Information Scientists and Engineers
  • DOI : 10.5626/JOK.2016.43.2.269
 Title & Authors
Named Entity Recognition Using Distant Supervision and Active Bagging
Lee, Seong-hee; Song, Yeong-kil; Kim, Hark-soo;
Named entity recognition is a process which extracts named entities in sentences and determines categories of the named entities. Previous studies on named entity recognition have primarily been used for supervised learning. For supervised learning, a large training corpus manually annotated with named entity categories is needed, and it is a time-consuming and labor-intensive job to manually construct a large training corpus. We propose a semi-supervised learning method to minimize the cost needed for training corpus construction and to rapidly enhance the performance of named entity recognition. The proposed method uses distance supervision for the construction of the initial training corpus. It can then effectively remove noise sentences in the initial training corpus through the use of an active bagging method, an ensemble method of bagging and active learning. In the experiments, the proposed method improved the F1-score of named entity recognition from 67.36% to 76.42% after active bagging for 15 times.
named entity recognition;distant supervision;ensemble;active bagging;
 Cited by
A. Mikheev, C. Grover, and M. Moens, "Discription of the LTG System Used for MUC-7," Proc. of the 7th Message Understanding Conference, 1998.

T. Noh, S. Lee, "Extraction and Classification of Proper Nouns by Rule - based Machine Learning," Proc. of the KIISE Korea Computer Congress 2000, Vol. 27, No. 2, pp. 170-172, 2000.

K. Lee, J. Lee, M. Choi, and G. Kim, "Study on Named Entity Recognition in Korean Text," Proc. of the HCLT, pp. 292-299, 2000.

Y. Hwang, H. Lee, E. Chung, B. Yun, and S. Park, "Korean Named Entity Recognition Based on Supervised Learning Using Named Entity Construction Principles," Proc. of the HCLT, pp. 111-117, 2002.

K. Uchimoto, Q. Ma, M. Murata, H. Ozakum, and H. Isahara, "Named Entity Extraction Based on A ME Model and Transformation Rules," Proc. of the ACL, 2000.

A. Blum, Semi-supervised Learning, Encyclopedia of Algorithms, pp. 1-7, Jan, New York, 2015.

M. Mintz, S. Bills, R. Snow, and D. Jurafsky, "Distant supervision for relation extraction without labeled data," Proc. of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, Vol. 2, pp. 1003-1011, 2009.

K. Ha, S. Cho, and D. MacLachlan, "Response models based on bagging neural networks," Journal of Interactive Marketing, Vol. 19, No. 1, pp. 17-30, 2005. crossref(new window)

D. A. Cohn, Z. Ghahramani, and M. I. Jordan, "Active learning with statistical models," Journal of artificial intelligence research, 1996.

A. Borthwick, J. Sterling, E. Agichtein, and R. Grishman, "NYU: Description of the MENE named entity system as used in MUC-7," Proc. of the Seventh Message Understanding Conference, 1998.

C. Lee, M. Jang, "Named Entity Recognition with Structural SVMs and Pegasos algorithm," Journal of Cognitive Science, Vol. 21, No. 4, pp. 655-667, 2010. crossref(new window)

C. Lee, Y. Hwang, H. Oh, S. Lim, J. Heo, C. Lee, H. Kim, J. Wang, and M. Jang, "Fine-Grained Named Entity Recognition using Conditional Random Fields for Question Answering," Proc. of the HCLT, pp. 268-272, 2006.

Y. Kim, "Automatic training corpus generation method of Named Entity Recognition using Big data," M.S. Thesis, Sogang University, 2015.

J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," Proc. of the ICML, pp. 282-289, 2001.

Y. Song, H. Kim, "Semi-automatic Construction of a Named Entity dictionary Based on Active Learning," Proc. of the Computer Science and its Applications Lecture Notes in Electrical Engineering, Vol. 330, pp. 65-70, 2015.

Y. Park, S. Kang, B. Kyu, and J. Seo, "Title Named Entity Recognition using Wikipedia and Making Acronym," Proc. of the KIISE Korea Computer Congress 2013, pp. 637-639, 2013.