1 |
Ethical Issues in Corpus Linguistics And Annotation: Pay Per Hit Does Not Affect Effective Hourly Rate For Linguistic Resource Development On Amazon Mechanical Turk
|
|
|
|
In: ETHics In Corpus collection, Annotation and Application workshop ; https://hal.inria.fr/hal-01324362 ; ETHics In Corpus collection, Annotation and Application workshop, May 2016, Portoroz, Slovenia (2016)
|
|
BASE
|
|
Show details
|
|
2 |
Crowdsourcing for Language Resource Development: Criticisms About Amazon Mechanical Turk Overpowering Use
|
|
|
|
In: Human Language Technology Challenges for Computer Science and Linguistics ; https://hal.inria.fr/hal-01053047 ; Vetulani, Zygmunt and Mariani, Joseph. Human Language Technology Challenges for Computer Science and Linguistics, 8387, Springer International Publishing, pp.303-314, 2014, Lecture Notes in Computer Science, 978-3-319-08957-7. ⟨10.1007/978-3-319-08958-4_25⟩ (2014)
|
|
Abstract:
International audience ; This article is a position paper about Amazon Mechanical Turk, the use of which has been steadily growing in language processing in the past few years. According to the mainstream opinion expressed in articles of the domain, this type of on-line working platforms allows to develop quickly all sorts of quality language resources, at a very low price, by people doing that as a hobby. We shall demonstrate here that the situation is far from being that ideal. Our goal here is manifold: 1- to inform researchers, so that they can make their own choices, 2- to develop alternatives with the help of funding agencies and scientific associations, 3- to propose practical and organizational solutions in order to improve language resources development, while limiting the risks of ethical and legal issues without letting go price or quality, 4- to introduce an Ethics and Big Data Charter for the documentation of language resource
|
|
Keyword:
[INFO.INFO-TT]Computer Science [cs]/Document and Text Processing; Amazon Mechanical Turk; Ethics; Language resources
|
|
URL: https://doi.org/10.1007/978-3-319-08958-4_25 https://hal.inria.fr/hal-01053047/file/LNAI_AMT_Finale.pdf https://hal.inria.fr/hal-01053047/document https://hal.inria.fr/hal-01053047
|
|
BASE
|
|
Hide details
|
|
3 |
Un turc mécanique pour les ressources linguistiques : critique de la myriadisation du travail parcellisé
|
|
|
|
In: TALN'2011 - Traitement Automatique des Langues Naturelles ; https://hal.inria.fr/inria-00617067 ; TALN'2011 - Traitement Automatique des Langues Naturelles, Jun 2011, Montpellier, France (2011)
|
|
BASE
|
|
Show details
|
|
4 |
Crowdsourcing for language resource development: critical analysis of amazon mechanical turk overpowering use
|
|
|
|
In: Language & Technology Conference : Human Language Technologies as a Challenge for Computer Science and Linguistics ; https://hal.archives-ouvertes.fr/hal-01840838 ; Language & Technology Conference : Human Language Technologies as a Challenge for Computer Science and Linguistics, Jan 2011, Poznan, Poland (2011)
|
|
BASE
|
|
Show details
|
|
5 |
Amazon Mechanical Turk: Gold Mine or Coal Mine?
|
|
|
|
In: ISSN: 0891-2017 ; EISSN: 1530-9312 ; Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-00569450 ; Computational Linguistics, Massachusetts Institute of Technology Press (MIT Press), 2011, pp.413-420. ⟨10.1162/COLI_a_00057⟩ (2011)
|
|
BASE
|
|
Show details
|
|
|
|