| 4 |
Gesture and Sign Language in Human-Computer Interaction and Embodied Communication : 9th International Gesture Workshop, GW 2011, Athens, Greece, May 25-27, 2011, Revised Selected Papers
|
|
|
|
UB Frankfurt Linguistik
|
|
Show details
|
|
|
| 9 |
Élaboration d'un corpus étalon pour l'évaluation d'extracteurs de termes
|
|
|
|
Abstract:
Ce travail porte sur la construction d’un corpus étalon pour l’évaluation automatisée des extracteurs de termes. Ces programmes informatiques, conçus pour extraire automatiquement les termes contenus dans un corpus, sont utilisés dans différentes applications, telles que la terminographie, la traduction, la recherche d’information, l’indexation, etc. Ainsi, leur évaluation doit être faite en fonction d’une application précise. Une façon d’évaluer les extracteurs consiste à annoter toutes les occurrences des termes dans un corpus, ce qui nécessite un protocole de repérage et de découpage des unités terminologiques. À notre connaissance, il n’existe pas de corpus annoté bien documenté pour l’évaluation des extracteurs. Ce travail vise à construire un tel corpus et à décrire les problèmes qui doivent être abordés pour y parvenir. Le corpus étalon que nous proposons est un corpus entièrement annoté, construit en fonction d’une application précise, à savoir la compilation d’un dictionnaire spécialisé de la mécanique automobile. Ce corpus rend compte de la variété des réalisations des termes en contexte. Les termes sont sélectionnés en fonction de critères précis liés à l’application, ainsi qu’à certaines propriétés formelles, linguistiques et conceptuelles des termes et des variantes terminologiques. Pour évaluer un extracteur au moyen de ce corpus, il suffit d’extraire toutes les unités terminologiques du corpus et de comparer, au moyen de métriques, cette liste à la sortie de l’extracteur. On peut aussi créer une liste de référence sur mesure en extrayant des sous-ensembles de termes en fonction de différents critères. Ce travail permet une évaluation automatique des extracteurs qui tient compte du rôle de l’application. Cette évaluation étant reproductible, elle peut servir non seulement à mesurer la qualité d’un extracteur, mais à comparer différents extracteurs et à améliorer les techniques d’extraction. ; We describe a methodology for constructing a gold standard for the automatic evaluation of term extractors. These programs, designed to automatically extract specialized terms from a corpus, are used in various settings, including terminology work, translation, information retrieval, indexing, etc. Thus, the evaluation of term extractors must be carried out in accordance with a specific application. One way of evaluating term extractors is to construct a corpus in which all term occurrences have been annotated. This involves establishing a protocol for term selection and term boundary identification. To our knowledge, no well-documented annotated corpus is available for the evaluation of term extractors. This contribution aims to build such a corpus and describe what issues must be dealt with in the process. The gold standard we propose is a fully annotated corpus, constructed in accordance with a specific terminological setting, namely the compilation of a specialized dictionary of automotive mechanics. This annotated corpus accounts for the wide variety of realizations of terms in context. Terms are selected in accordance with specific criteria pertaining to the terminological setting as well as formal, linguistic and conceptual properties of terms and term variations. To evaluate a term extractor, a list of all the terminological units in the corpus is extracted and compared to the output of the term extractor, using a set of metrics to assess its performance. Subsets of terminological units may also be extracted, providing a level of customization. This allows an automatic and application-driven evaluation of term extractors. Due to its reusability, it can serve not only to assess the performance of a particular extractor, but also to compare different extractors and fine-tune extraction techniques.
|
|
Keyword:
Annotated corpora; Annotation de corpus; Computational terminology; Évaluation; Evaluation; Extraction de termes; Language - Linguistics / Langues - Linguistique (UMI : 0290); Term acquisition; Term variation; Terminologie; Terminologie computationnelle; Terminology; Variation terminologique
|
|
URL: http://hdl.handle.net/1866/8687
|
|
BASE
|
|
Hide details
|
|
|
| 10 |
A detailed analysis of phrase-based and syntax-based machine translation: the search for systematic differences
|
|
|
|
In: Kaljahi, Rasoul Samed Zadeh, Rubino, Raphael, Roturier, Johann and Foster, Jennifer orcid:0000-0002-7789-4853 (2012) A detailed analysis of phrase-based and syntax-based machine translation: the search for systematic differences. In: AMTA, 28 Oct - 1 Nov 2012, San Diego, CA. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Word alignment and smoothing methods in statistical machine translation: Noise, prior knowledge and overfitting
|
|
Okita, Tsuyoshi. - : Dublin City University. Centre for Next Generation Localisation (CNGL), 2012. : Dublin City University. School of Computing, 2012
|
|
In: Okita, Tsuyoshi (2012) Word alignment and smoothing methods in statistical machine translation: Noise, prior knowledge and overfitting. PhD thesis, Dublin City University. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
DCU-Paris13 systems for the SANCL 2012 shared task
|
|
|
|
In: Le Roux, Joseph, Foster, Jennifer orcid:0000-0002-7789-4853 , Wagner, Joachim orcid:0000-0002-8290-3849 , Samad Zadeh Kaljahi, Rasoul and Bryl, Anton (2012) DCU-Paris13 systems for the SANCL 2012 shared task. In: The NAACL 2012 First Workshop on Syntactic Analysis of Non-Canonical Language (SANCL), 7-8 Jun 2012, Montreal, Quebec, Canada. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
DCU-Symantec submission for the WMT 2012 quality estimation task
|
|
|
|
In: Rubino, Raphael, Foster, Jennifer orcid:0000-0002-7789-4853 , Wagner, Joachim orcid:0000-0002-8290-3849 , Roturier, Johann, Samad Zadeh Kaljahi, Rasoul and Hollowood, Fred (2012) DCU-Symantec submission for the WMT 2012 quality estimation task. In: The NAACL 2012 Seventh Workshop on Statistical Machine Translation (WMT'12), 7-8 Jun 2012, Montreal, Quebec, Canada. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
Detecting grammatical errors with treebank-induced, probabilistic parsers
|
|
|
|
In: Wagner, Joachim orcid:0000-0002-8290-3849 (2012) Detecting grammatical errors with treebank-induced, probabilistic parsers. PhD thesis, Dublin City University. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Identifying high-impact sub-structures for convolution kernels in document-level sentiment classification
|
|
|
|
In: Tu, Zhaopeng, He, Yifan, Foster, Jennifer orcid:0000-0002-7789-4853 , van Genabith, Josef orcid:0000-0003-1322-7944 , Liu, Qun and Shouxun, Lin (2012) Identifying high-impact sub-structures for convolution kernels in document-level sentiment classification. In: Annual Meeting of the Association for Computational Linguistics (ACL 2012), 9-11 Jul 2012, Jelu, Korea. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Making results fit into 40 characters: a study in document rewriting
|
|
|
|
In: Leveling, Johannes orcid:0000-0003-0603-4191 and Jones, Gareth J.F. orcid:0000-0003-2923-8365 (2012) Making results fit into 40 characters: a study in document rewriting. In: The 35th Annual ACM SIGIR 2012 Conference, 12-16 Aug 2012, Portland, Oregon. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Sentiment analysis and real-time microblog search
|
|
Bermingham, Adam. - : Dublin City University. School of Computing, 2012. : Dublin City University. CLARITY: The Centre for Sensor Web Technologies, 2012
|
|
In: Bermingham, Adam (2012) Sentiment analysis and real-time microblog search. PhD thesis, Dublin City University. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 18 |
An evaluation of the role of sentiment in second screen microblog search tasks
|
|
|
|
In: Bermingham, Adam and Smeaton, Alan F. orcid:0000-0003-1028-8389 (2012) An evaluation of the role of sentiment in second screen microblog search tasks. In: 6th International AAAI Conference on Weblogs and Social Media (ICWSM12), 4 Jun 2012, Dublin, Ireland. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Mitigating the problems of SMT using EBMT
|
|
Dandapat, Sandipan. - : Dublin City University. Centre for Next Generation Localisation (CNGL), 2012. : Dublin City University. National Centre for Language Technology (NCLT), 2012. : Dublin City University. School of Computing, 2012
|
|
In: Dandapat, Sandipan (2012) Mitigating the problems of SMT using EBMT. PhD thesis, Dublin City University. (2012)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Active learning and the Irish treebank
|
|
|
|
In: Lynn, Teresa, Foster, Jennifer orcid:0000-0002-7789-4853 , Uí Dhonnchadha, Elaine and Dras, Mark (2012) Active learning and the Irish treebank. In: The Annual Meeting of the Australasian Language Technology Association (ALTA 2012), 4-6 Dec 2012, Dunedin, NZ. (2012)
|
|
BASE
|
|
Show details
|
|
|
|
|
