The CLASSLA-StanfordNLP model for lemmatisation of non-standard Slovenian 1.1

PID

The model for lemmatisation of non-standard Slovenian was built with the CLASSLA-StanfordNLP tool (https://github.com/clarinsi/classla-stanfordnlp) by training on the ssj500k training corpus (http://hdl.handle.net/11356/1210) and the Janes-Tag corpus (http://hdl.handle.net/11356/1238), using the Sloleks inflectional lexicon (http://hdl.handle.net/11356/1230). These corpora were additionally augmented for handling missing diacritics by repeating parts of the corpora with diacritics removed. The estimated F1 of the lemma annotations is ~98.86.

The difference to the previous version of the lemmatizer is that now it relies solely on XPOS annotations, and not on a combination of UPOS, FEATS (lexicon lookup) and XPOS (lemma prediction) annotations.

Identifier
PID http://hdl.handle.net/11356/1350
Related Identifier http://dx.doi.org/10.18653/v1/W19-3704
Related Identifier http://hdl.handle.net/11356/1338
Related Identifier http://hdl.handle.net/11356/1784
Related Identifier https://github.com/clarinsi/classla-stanfordnlp
Metadata Access http://www.clarin.si/repository/oai/request?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai:www.clarin.si:11356/1350
Provenance
Creator Ljubešić, Nikola
Publisher Jožef Stefan Institute
Publication Year 2020
Rights Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0); https://creativecommons.org/licenses/by-sa/4.0/; PUB
OpenAccess true
Contact info(at)clarin.si
Representation
Language Slovenian; Slovene
Resource Type toolService
Format application/zip; text/plain; charset=utf-8; downloadable_files_count: 1
Discipline Linguistics