Development and preliminary testing of a virtual reality measurement for assessing intake assessment skills

doi:10.1002/ijop.12898

. 2023 Jan 31.

doi: 10.1002/ijop.12898. Online ahead of print.

Development and preliminary testing of a virtual reality measurement for assessing intake assessment skills

Yu-Ling Lan¹, Wan-Lan Chen², Ying-Fen Wang³, Yuhsuan Chang⁴

Affiliations

¹ Department of Counseling and Clinical Psychology, National Dong Hwa University, Hualien, Taiwan, ROC.
² Department of Human Development and Psychology, Tzu Chi University, Hualien, Taiwan, ROC.
³ Department of Educational Psychology and Counseling, National Taiwan Normal University, Taipei, Taiwan, ROC.
⁴ College of Management, Yuan Ze University, Taoyuan, Taiwan, ROC.

PMID: 36720650
DOI: 10.1002/ijop.12898

Development and preliminary testing of a virtual reality measurement for assessing intake assessment skills

Yu-Ling Lan et al. Int J Psychol. 2023.

. 2023 Jan 31.

doi: 10.1002/ijop.12898. Online ahead of print.

Authors

Yu-Ling Lan¹, Wan-Lan Chen², Ying-Fen Wang³, Yuhsuan Chang⁴

Affiliations

¹ Department of Counseling and Clinical Psychology, National Dong Hwa University, Hualien, Taiwan, ROC.
² Department of Human Development and Psychology, Tzu Chi University, Hualien, Taiwan, ROC.
³ Department of Educational Psychology and Counseling, National Taiwan Normal University, Taipei, Taiwan, ROC.
⁴ College of Management, Yuan Ze University, Taoyuan, Taiwan, ROC.

PMID: 36720650
DOI: 10.1002/ijop.12898

Abstract

Objective structured clinical examinations (OSCEs) have been widely used in health care education to simultaneously assess knowledge, skill and attitude. Due to the high cost of running an OSCE, its application in professional psychology is still limited. To solve this problem, virtual standardised patient (VSP) implementations in creating psychology OSCEs can be a cost-effective method for administering a psychology OSCE regularly. This study aimed to develop and examine the psychometric properties of the VSP version of the Intake OSCE (VSP-Intake OSCE) in measuring psychologists' psychological assessment competencies (PACs) from entry to early practice. The initial development of the VSP-Intake OSCE contains a VSP station and a follow-up written station to measure PACs when conducting an intake assessment. To administer the VSP station, we built a new VSP system that allows psychologists to interact with a VSP verbally. A sample of 36 participants, including 27 graduate students and nine psychologists, were recruited to examine the psychometric properties of the VSP-Intake OSCE. As a newly developed instrument, the VSP-Intake OSCE revealed good inter-rater reliability and construct validity. We believe using VSP implementations to develop psychology OSCEs will be essential in promoting OSCE applications in professional psychology.

Keywords: Competency-based assessment; Objective structured clinical examination; Psychological assessment; Virtual reality.

References

REFERENCES

1. American Psychological Association. (2019). Report of the BEA task force to develop a blueprint for APA accreditation of master's programs in health service psychology. American Psychological Association. https://www.apa.org/ed/governance/bea/final-report.pdf
1. American Psychological Association. (2020). Guidelines for education and training in psychological assessment in health service psychology. American Psychological Association. https://www.apa.org/about/policy/guidelines-assessment-health-service.pdf
1. Dupuy, L., Micoulaud-Franchi, J., Cassoudesalle, H., Ballot, O., Dehail, P., Aouizerate, B., Cuny, E., de Sevin, E., & Philip, P. (2020). Evaluation of a virtual agent to train medical students conducting psychiatric interviews for diagnosing major depressive disorders. Journal of Affective Disorders, 263, 1-8. https://doi.org/10.1016/j.jad.2019.11.117
1. Fodor, L. A., Cotet, C. D., Cuijpers, P., Szamoskozi, S., David, D., & Cristea, I. A. (2018). The effectiveness of virtual reality based interventions for symptoms of anxiety and depression: A meta-analysis. Scientific Reports, 8, 10323.
1. Foster, A., Chaudhary, N., Murphy, J., Lok, B., Waller, J., & Buckley, P. F. (2015). The use of simulation to teach suicide risk assessment to health profession trainees-rationale, methodology, and a proof of concept demonstration with a virtual patient. Academic Psychiatry, 39(6), 620-629. https://doi.org/10.1007/s40596-014-0185-9

Grant support

MOST 109-2410-H-259-019-MY2/Ministry of Science and Technology

[1] American Psychological Association. (2019). Report of the BEA task force to develop a blueprint for APA accreditation of master's programs in health service psychology. American Psychological Association. https://www.apa.org/ed/governance/bea/final-report.pdf

[2] American Psychological Association. (2019). Report of the BEA task force to develop a blueprint for APA accreditation of master's programs in health service psychology. American Psychological Association. https://www.apa.org/ed/governance/bea/final-report.pdf

[3] American Psychological Association. (2020). Guidelines for education and training in psychological assessment in health service psychology. American Psychological Association. https://www.apa.org/about/policy/guidelines-assessment-health-service.pdf

[4] American Psychological Association. (2020). Guidelines for education and training in psychological assessment in health service psychology. American Psychological Association. https://www.apa.org/about/policy/guidelines-assessment-health-service.pdf

[5] Dupuy, L., Micoulaud-Franchi, J., Cassoudesalle, H., Ballot, O., Dehail, P., Aouizerate, B., Cuny, E., de Sevin, E., & Philip, P. (2020). Evaluation of a virtual agent to train medical students conducting psychiatric interviews for diagnosing major depressive disorders. Journal of Affective Disorders, 263, 1-8. https://doi.org/10.1016/j.jad.2019.11.117

[6] Dupuy, L., Micoulaud-Franchi, J., Cassoudesalle, H., Ballot, O., Dehail, P., Aouizerate, B., Cuny, E., de Sevin, E., & Philip, P. (2020). Evaluation of a virtual agent to train medical students conducting psychiatric interviews for diagnosing major depressive disorders. Journal of Affective Disorders, 263, 1-8. https://doi.org/10.1016/j.jad.2019.11.117

[7] Fodor, L. A., Cotet, C. D., Cuijpers, P., Szamoskozi, S., David, D., & Cristea, I. A. (2018). The effectiveness of virtual reality based interventions for symptoms of anxiety and depression: A meta-analysis. Scientific Reports, 8, 10323.

[8] Fodor, L. A., Cotet, C. D., Cuijpers, P., Szamoskozi, S., David, D., & Cristea, I. A. (2018). The effectiveness of virtual reality based interventions for symptoms of anxiety and depression: A meta-analysis. Scientific Reports, 8, 10323.

[9] Foster, A., Chaudhary, N., Murphy, J., Lok, B., Waller, J., & Buckley, P. F. (2015). The use of simulation to teach suicide risk assessment to health profession trainees-rationale, methodology, and a proof of concept demonstration with a virtual patient. Academic Psychiatry, 39(6), 620-629. https://doi.org/10.1007/s40596-014-0185-9

[10] Foster, A., Chaudhary, N., Murphy, J., Lok, B., Waller, J., & Buckley, P. F. (2015). The use of simulation to teach suicide risk assessment to health profession trainees-rationale, methodology, and a proof of concept demonstration with a virtual patient. Academic Psychiatry, 39(6), 620-629. https://doi.org/10.1007/s40596-014-0185-9