1 |
Construct Validity of an Instrument for Assessment of Reflective Writing-Based Portfolios of Medical Students
|
|
|
|
In: Adv Med Educ Pract (2020)
|
|
Abstract:
PURPOSE: Assessment of reflective writing for medical students is challenging, and there is lack of an available instrument with good psychometric properties. The authors developed a new instrument for assessment of reflective writing-based portfolios and examined the construct validity of this instrument. METHODS: After an extensive literature review and pilot testing of the instrument, two raters assessed the reflective writing-based portfolios from years 2 and 3 medical students (n=135) on three occasions. The instrument consists of three criteria: organization, description of an experience and reflection on the experience. We calculated the reliability of scores using generalizability theory with a fully crossed design and two facets (raters and occasions). In addition, we measured criterion validity by testing correlations with students’ scores using other assessment methods. RESULTS: The dependability (Φ) coefficient of the portfolio scores was 0.75 using two raters on three occasions. Students’ portfolio scores represented 46.6% of the total variance across all score comparisons. The variance due to occasions was negligible, while the student–occasion interaction was small. The variance due to student–rater interaction represented 17.7%, and the remaining 27.7% of the variance was due to unexplained sources of error. The decision (D) study suggested that an acceptable dependability (Φ = 0.70 and 0.72) can be achieved by using two raters for one and two occasions, respectively. Finally, we found moderate to large effect-size correlations between students’ scores in reflective writing-based portfolios and communication skills (r = 0.47) and PBL tutorials (r = 0.50). CONCLUSION: We demonstrated the presence of different sources of evidence that support construct validity of the study instrument. Further studies are warranted before utilizing this instrument for summative assessment of students’ reflective writing-based portfolios in other medical schools.
|
|
Keyword:
Original Research
|
|
URL: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7276316/ http://www.ncbi.nlm.nih.gov/pubmed/32581621 https://doi.org/10.2147/AMEP.S256338
|
|
BASE
|
|
Hide details
|
|
6 |
Counselling uncertainty: genetics professionals' accounts of (non)directiveness and trust/distrust
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Counselling uncertainty: genetics professionals' accounts of (non)directiveness and trust/distrust
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Modes of risk explanation in telephone consultations between nurses and parents for a genetic condition
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Preface
|
|
|
|
In: Genre(s) on the Move: Hybridization and Discourse Change in Specialized Communication ; https://hal.univ-lille.fr/hal-01731374 ; Giuditta Caliendo (ed.); Vanda Polese (ed.); Srikant Sarangi (ed.). Genre(s) on the Move: Hybridization and Discourse Change in Specialized Communication, 6, Edizioni Scientifiche Italiane, pp.IX-X, 2012 (2012)
|
|
BASE
|
|
Show details
|
|
16 |
Handbook of communication in organisations and professions. - Handbooks of applied linguistics : HAL ; communication competence - language and communication problems - practical solutions ; 3 : Handbook of communication in organisations and professions. -
|
|
|
|
BLLDB
|
|
UB Frankfurt Linguistik
|
|
Show details
|
|
19 |
Professional and organisational practice : a discourse/communication perspective
|
|
|
|
BASE
|
|
Show details
|
|
|
|