| 4 |
The IR Task at the CLEF eHealth evaluation lab 2016: User-centred health information retrieval
|
|
|
|
Abstract:
This paper details the collection, systems and evaluation methods used in the IR Task of the CLEF 2016 eHealth Evaluation Lab. This task investigates the e↵ectiveness of web search engines in providing access to medical information for common people that have no or little medical knowledge. The task aims to foster advances in the development of search technologies for consumer health search by providing resources and evaluation methods to test and validate search systems. The problem considered in this year’s task was to retrieve web pages to support the information needs of health consumers that are faced by a medical condition and that want to seek relevant health information online through a search engine. As part of the evaluation exercise, we gathered 300 queries users posed with respect to 50 search task scenarios. The scenarios were developed from real cases of people seeking health information through posting requests of help on a web forum. The presence of query variations for a single scenario helped us capturing the variable quality at which queries are posed. Queries were created in English and then translated into other languages. A total of 49 runs by 10 different teams were submitted for the English query topics; 2 teams submitted 29 runs for the multilingual topics.
|
|
Keyword:
Evaluation; Health search
|
|
URL: https://espace.library.uq.edu.au/view/UQ:415488/UQ415488.pdf
https://espace.library.uq.edu.au/view/UQ:415488
|
|
BASE
|
|
Hide details
|
|
|
| 5 |
Overview of the ShARe/CLEF eHealth evaluation lab 2014
|
|
|
|
In: Kelly, Liadh orcid:0000-0003-1131-5238 , Goeuriot, Lorraine orcid:0000-0001-7491-1980 , Suominen, Hanna, Schreck, Tobias, Leroy, Gondy, Mowery, Danielle L., Velupillai, Sumithra, Chapman, Wendy, Martinez, David, Zuccon, Guido and Palotti, Joao (2014) Overview of the ShARe/CLEF eHealth evaluation lab 2014. Lecture Notes in Computer Science, 8685 . pp. 172-191. ISSN 0302-9743 (2014)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Overview of the ShARe/CLEF eHealth evaluation lab 2014
|
|
|
|
In: Kelly, Liadh orcid:0000-0003-1131-5238 , Goeuriot, Lorraine orcid:0000-0001-7491-1980 , Suominen, Hanna, Schreck, Tobias, Leroy, Gondy, Mowery, Danielle L., Velupillai, Sumithra, Chapman, Wendy, Martinez, David, Zuccon, Guido and Palotti, Joao (2014) Overview of the ShARe/CLEF eHealth evaluation lab 2014. In: Conference and Labs for the Evaluation Forum (CLEF 2014), 15-18 Sept 2014, Sheffield, UK. ISBN 978-3-319-11382-1 (2014)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
ShARe/CLEF eHealth evaluation lab 2014, task 3: user-centred health information retrieval
|
|
|
|
In: Goeuriot, Lorraine orcid:0000-0001-7491-1980 , Kelly, Liadh orcid:0000-0003-1131-5238 , Li, Wei B. orcid:0000-0001-7347-3501 , Palotti, Joao, Pecina, Pavel, Zuccon, Guido, Hanbury, Allan, Jones, Gareth J.F. orcid:0000-0002-4033-9135 and Mueller, Henning (2014) ShARe/CLEF eHealth evaluation lab 2014, task 3: user-centred health information retrieval. In: Conference and Labs for the Evaluation Forum (CLEF 2014), 15-18 Sept 2014, Sheffield, UK. (2014)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
ShARe/CLEF eHealth evaluation lab 2014, task 3: user-centred health information retrieval
|
|
|
|
In: Goeuriot, Lorraine orcid:0000-0001-7491-1980 , Kelly, Liadh orcid:0000-0003-1131-5238 , Li, Wei B. orcid:0000-0001-7347-3501 , Palotti, Joao, Zuccon, Guido, Hanbury, Allan, Jones, Gareth J.F. orcid:0000-0002-4033-9135 and Mueller, Henning (2014) ShARe/CLEF eHealth evaluation lab 2014, task 3: user-centred health information retrieval. CLEF 2014 Online Working Notes, 1180 . pp. 43-61. ISSN 1613-0073 (2014)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
ShARe/CLEF eHealth Evaluation Lab 2014, Task 3: User-centred health information retrieval
|
|
|
|
In: Proceedings of CLEF 2014 ; https://hal.archives-ouvertes.fr/hal-01086554 ; Proceedings of CLEF 2014, Sep 2014, Sheffield, United Kingdom (2014)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Overview of the ShARe/CLEF eHealth Evaluation Lab 2014
|
|
|
|
In: Information Access Evaluation : Multilinguality, Multimodality, and Interaction ; 5th International Conference of the CLEF Initiative, CLEF 2014, Sheffield, UK, September 15-18, 2014. Proceedings / Evangelos Kanoulas . (Hrsg.). - Springer International Publishing, 2014. - (Lecture Notes in Computer Science ; 8685). - S. 172-191. - ISBN 978-3-319-11381-4 (2014)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Khresmoi professional: multilingualsSemantic search for medical professionals
|
|
|
|
In: Kelly, Liadh orcid:0000-0003-1131-5238 , Hanbury, Allan, Jones, Gareth J.F. orcid:0000-0003-2923-8365 , Goeuriot, Lorraine orcid:0000-0001-7491-1980 and Mueller, Henning (2013) Khresmoi professional: multilingualsSemantic search for medical professionals. In: SIGIR 2013 Health Search and Discovery HSD workshop, 1 Aug 2013, Dublin, Ireland. (2013)
|
|
BASE
|
|
Show details
|
|
|
|
|
