Correcting errors in a new gold standard for tagging icelandic text

Sigrún Helgadóttir, Hrafn Loftsson, Eiríkur Rögnvaldsson

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Citations (Scopus)

Abstract

In this paper, we describe the correction of PoS tags in a new Icelandic corpus, MIM-GOLD, consisting of about 1 million tokens sampled from the Tagged Icelandic Corpus, MÍM, released in 2013. The goal is to use the corpus, among other things, as a new gold standard for training and testing PoS taggers. The construction of the corpus was first described in 2010 together with preliminary work on error detection and correction. In this paper, we describe further the correction of tags in the corpus. We describe manual correction and a method for semi-automatic error detection and correction. We show that, even after manual correction, the number of tagging errors in the corpus can be reduced significantly by applying our semi-automatic detection and correction method. After the semi-automatic error correction, preliminary evaluation of tagging accuracy shows very low error rates. We hope that the existence of the corpus will make it possible to improve PoS taggers for Icelandic text.

Original languageEnglish
Title of host publicationProceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014
EditorsNicoletta Calzolari, Khalid Choukri, Sara Goggi, Thierry Declerck, Joseph Mariani, Bente Maegaard, Asuncion Moreno, Jan Odijk, Helene Mazo, Stelios Piperidis, Hrafn Loftsson
PublisherEuropean Language Resources Association (ELRA)
Pages2944-2948
Number of pages5
ISBN (Electronic)9782951740884
Publication statusPublished - 2014
Event9th International Conference on Language Resources and Evaluation, LREC 2014 - Reykjavik, Iceland
Duration: 26 May 201431 May 2014

Publication series

NameProceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014

Conference

Conference9th International Conference on Language Resources and Evaluation, LREC 2014
Country/TerritoryIceland
CityReykjavik
Period26/05/1431/05/14

Bibliographical note

Funding Information:
The original work on creating the MIM-GOLD corpus was partly supported by both the Icelandic Student Innovation Fund and the Icelandic Research Fund, grant 090662012. The work on correcting the tags has been supported by the META-NORD project (supported by the EU ICT Policy Support Programme as part of the Competitiveness and Innovation Framework Programme, grant agreement no 270899 (META-NORD)) and by the Icelandic Ministry of Education, Science and Culture as a part of the Icelandic Government’s IT Policy Programme. Kristján Friðbjörn Sigurðsson checked the tags in the whole corpus manually, Steinunn Valbjörnsdóttir took care of the bulk of the Phase 2 error checking and Brynhildur Stefáns-dóttir did a part of the Phase 2 error checking.

Other keywords

  • Corpus creation
  • Gold standard
  • Semi-automatic error correction

Fingerprint

Dive into the research topics of 'Correcting errors in a new gold standard for tagging icelandic text'. Together they form a unique fingerprint.

Cite this