| 1 |
Overview of the CLEF eHealth Evaluation Lab 2019
|
|
Kelly, Liadh; Suominen, Hanna; Goeuriot, Lorraine; Neves, Mariana; Kanoulas, Evangelos; Li, Dan; Azzopardi, Leif; Spijker, Rene; Zuccon, Guido; Scells, Harrisen; Palotti, João. - : Springer Verlag, 2019
|
|
Abstract:
In this paper, we provide an overview of the seventh annual edition of the CLEF eHealth evaluation lab. CLEF eHealth 2019 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring electronic health information in a multilingual setting. This year’s lab advertised three tasks: Task 1 on indexing non-technical summaries of German animal experiments with International Classification of Diseases, Version 10 codes; Task 2 on technology assisted reviews in empirical medicine building on 2017 and 2018 tasks in English; and Task 3 on consumer health search in mono- and multilingual settings that builds on the 2013–18 Information Retrieval tasks. In total nine teams took part in these tasks (six in Task 1 and three in Task 2). Herein, we describe the resources created for these tasks and evaluation methodology adopted. We also provide a brief summary of participants of this year’s challenges and results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.
|
|
Keyword:
1700 Computer Science; 2614 Theoretical Computer Science; Entity linking; Evaluation; Health records; High recall; Information extraction; Information retrieval; Medical informatics; Self-diagnosis; Systematic reviews; Test-set generation; Text classification; Text segmentation
|
|
URL: https://espace.library.uq.edu.au/view/UQ:9a73ef5
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Comparative evaluation of cross-language information retrieval systems
|
|
|
|
In: http://www.mt-archive.info/LREC-2004-Peters.pdf (2005)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
The Future of Evaluation for Cross-Language Information Retrieval Systems
|
|
|
|
In: http://nlp.uned.es/pergamus/pubs/clef-lrec.pdf (2004)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Eurospider at CLEF 2002
|
|
|
|
In: http://www.clef-campaign.org/workshop2002/WN/15.pdf (2002)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Experiments with the eurospider retrieval system for CLEF 2000
|
|
|
|
In: http://www.ercim.org/publication/ws-proceedings/CLEF2/eurospider.pdf (2001)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Experiments with the Eurospider Retrieval System for CLEF 2000
|
|
|
|
In: http://www.iei.pi.cnr.it/DELOS/CLEF/braschler.pdf (2001)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
The Evaluation of Systems for Cross-Language Information Retrieval
|
|
|
|
In: http://www.educat.hu-berlin.de/~kluck/lrec2000-paper-70.pdf (2000)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
The Eurospider Retrieval System and the TREC-8 Cross-Language Track
|
|
|
|
In: http://www.cs.columbia.edu/~min/papers/eit_t8f.pdf (1999)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
SPIDER Retrieval System at TREC7
|
|
|
|
In: http://trec.nist.gov/pubs/trec7/papers/ETHTREC7.pdf.gz (1999)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
The Eurospider Retrieval System and the TREC-8 Cross-Language Track
|
|
|
|
In: http://trec.nist.gov/pubs/trec8/papers/eit_t8f.pdf (1999)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
SPIDER Retrieval System at TREC7
|
|
|
|
In: http://trec.nist.gov/pubs/trec7/papers/ETHTREC7.ps (1999)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
From CLEF to TrebleCLEF: promoting Technology Transfer for Multilingual Information Retrieval
|
|
|
|
In: http://dis.shef.ac.uk/mark/publications/my_papers/DELOS_CLEFtoTrebleCLEF_20071116-d.pdf
|
|
BASE
|
|
Show details
|
|
|
| 13 |
The CLEF Campaign
|
|
|
|
In: http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings2/Martin.pdf
|
|
BASE
|
|
Show details
|
|
|
| 14 |
From Research to Application in Multilingual Information Access: the Contribution of Evaluation
|
|
|
|
In: http://www.mt-archive.info/LREC-2008-Peters.pdf
|
|
BASE
|
|
Show details
|
|
|
| 15 |
The CLEF Campaign
|
|
|
|
In: http://www.mt-archive.info/NTCIR-2001-Braschler.pdf
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Conference on Multilingual and Multimodal Information Access Evaluation
|
|
|
|
In: http://www.sigir.org/forum/2010D/conferences/2010d_sigirforum_agosti.pdf
|
|
BASE
|
|
Show details
|
|
|
| 17 |
A PROMISE for Experimental Evaluation
|
|
|
|
In: http://allan.hanbury.eu/lib/exe/fetch.php?media=ferro_et_al_promise.pdf
|
|
BASE
|
|
Show details
|
|
|
| 18 |
From Research to Application in Multilingual Information Access: the Contribution of Evaluation
|
|
|
|
In: http://www.lrec-conf.org/proceedings/lrec2008/pdf/913_paper.pdf
|
|
BASE
|
|
Show details
|
|
|
| 19 |
2004), ‘The future of evaluation for cross-language information retrieval systems
|
|
|
|
In: http://www.lrec-conf.org/proceedings/lrec2004/pdf/285.pdf
|
|
BASE
|
|
Show details
|
|
|
|
|
