Telepractice and the WMS-IV
The telepractice information in this document is intended to support psychologists in making informed, well-reasoned decisions around remote assessment. This information is not intended to be comprehensive regarding all considerations for assessment via telepractice. It should not be interpreted as a requirement or recommendation to conduct assessment via telepractice.
Psychologists should remain mindful to:
- Follow professional best practice recommendations and respective ethical codes
- Follow telepractice regulations and legal requirements from federal, state and local authorities, licensing boards, professional liability insurance providers, and payors
- Develop competence with assessment via telepractice through activities such as practicing, studying, consulting with other professionals, and engaging in professional development.
Psychologists should use their clinical judgment to determine if assessment via telepractice is appropriate for a particular examinee, referral question, and situation. There are circumstances where assessment via telepractice is not feasible and/or is contraindicated. Documentation of all considerations, procedures, and conclusions remains a professional responsibility.
Several professional organizations and experts have provided guidance on telepractice assessment (American Psychological Association Services [APA Services], 2020; Association of State and Provincial Psychology Boards, 2013; Grosch et al., 2011; Inter Organizational Practice Committee, 2020; Stolwyk et al., 2020) to assist psychologists in decision making and ethical and legal practice issues.
The Wechsler Memory Scale–Fourth Edition (WMS–IV; Wechsler, 2008) can be administered in a telepractice context by using digital tools from Q-global®, Pearson’s secure online-testing and scoring platform. Specifically, Q-global digital assets (e.g., stimulus books) can be shown to the examinee in another location via the screen-sharing features of teleconference platforms. Details regarding Q-global and how it is used are provided on the Q-global product page.
A spectrum of options is available for administering the WMS–IV via telepractice; however, it is important to consider the fact that the normative data were collected via face-to-face assessment. Telepractice is a deviation from the standardized administration. The methods and approaches to administering instruments via telepractice should be supported by research and practice guidelines when appropriate.
Providers engaging in telepractice assessment may train facilitators to work with them on a regular basis in order to provide greater coverage to underserved populations (e.g., only two providers within a 500-mile radius, shortage of school psychologists within a school district). If such a facilitator is well trained and in a professional role (i.e., a professional facilitator), they can present cards, grids, and response booklets as well as adjust audiovisual equipment. This approach yields the WMS–IV composite scores that are available in face-to-face assessments.
In times when social distancing is necessary (such as the COVID-19 pandemic), using a professional facilitator may not be safe or feasible. If testing must occur under these conditions, it is possible that the examinee may participate without the help of an onsite facilitator. If the examiner determines that no facilitator is required, the examinee can assist with technological and administrative tasks during testing and should be oriented to these responsibilities prior to, and again at the beginning of the session. An initial virtual meeting should occur in advance of the testing session to address numerous issues specific to testing via telepractice. This initial virtual meeting is described in the administrative and technological tasks portion of the Examiner Considerations section and referred to in various sections of this document. The examiner should consider best practice guidelines, the referral question, and the patient’s condition, as well as telepractice equivalence study conditions to determine if this is possible and appropriate. Independent examinee participation may not be possible or appropriate, for example, for examinees with low cognitive ability or with low levels of technological literacy and experience.
If the examiner determines that the examinee cannot participate independently, and testing must occur under social distancing constraints, the only facilitator available may be someone in the examinee’s home (e.g., a parent, guardian, or caretaker). If the onsite facilitator is a nonprofessional facilitator, they can assist with technological and administrative tasks during testing and should be oriented to these responsibilities in the initial virtual meeting and again at the beginning of the session.
Professional and nonprofessional facilitators typically do not remain in the room with the examinee throughout the testing session. The examiner should plan to minimize (as much as possible) the need for the facilitator to remain in the room. In rare cases when the facilitator must remain in the room, they should do so passively and unobtrusively, and merely to monitor and address the examinee’s practical needs, as well as any technological or administrative issues as necessary. The facilitator’s role should be defined clearly by the examiner. The facilitator should only perform those functions the examiner approves and deems necessary. In any case, if a facilitator is necessary it is preferred that the facilitator remain accessible.
If a professional facilitator is not available, it impacts the workflow of the session, subtest selection, and the approach to deriving composite scores. For example, if a professional facilitator is not used, Designs and Spatial Addition are not feasible for telepractice. Neither of these subtests are included in the Older Adult battery so all the relevant composite scores for that battery may be derived. The Older Adult battery (ages 65–90) only requires the response booklet; no cards or grids are required for that battery. However, for the Adult battery, the omission of Designs and Spatial Addition impacts the ability to derive all composite scores, leaving Verbal Memory Index as the only index that can be derived using the standard norms.
Several composite scores based on different sets of WMS–IV subtests are available in the WMS–IV Flexible Approach (Wechsler, 2009). The WMS–IV Flexible Approach norms, however, can be used to derive the same index scores as are available in the Older Adult battery (Immediate Memory, Delayed Memory, Auditory Memory, Visual Memory). The Visual Working Memory Index can only be obtained remotely with the use of a professional facilitator. The WMS–IV Flexible Approach Alternate Indexes Worksheet is available in the Q-global Resource Library and can be used to derive these alternate index scores.
In addition, care needs to be taken with the Visual Reproduction response booklet to ensure the examinee is not re-exposed to stimuli through the response booklet.
Conclusion
The WMS–IV was not standardized in a telepractice mode, and this should be taken into consideration when utilizing this test via telepractice and interpreting results. For example, the examiner should consider relying on convergence of multiple data sources and/or being tentative about conclusions. Provided that the examiner has thoroughly considered and addressed the factors and the specific considerations as listed above, the examiner should be prepared to observe and comment about the reliable and valid delivery of the test via telepractice. Materials may be used via telepractice without additional permission from Pearson in the following published contexts:
- WMS–IV manuals, digital stimulus books, and response booklets via Q-global
- WMS–IV via Q-interactive (requires advanced technology skills and mirroring software)
Any other use of the WMS–IV via telepractice is not currently recommended. This includes, but is not limited to, scanning the paper stimulus books, digitizing the paper record forms, holding the stimulus books physically up in the camera's viewing area, or uploading a manual onto a shared drive or site.
References
American Psychological Association Services (APA Services). (2020). Guidance on psychological tele-assessment during the COVID-19 crisis. (2020). https://www.apaservices.org/practice/reimbursement/health-codes/testing/tele-assessment-covid-19?fbclid=IwAR1d_YNXYS2Yc5mdIz_ZIYSkrrJ_6A9BQeKuIHxEEjjRh1XDR6fOYncM3b4
Association of State and Provincial Psychology Boards (ASPPB). (2013). ASPPB telepsychology task force principles and standards. https://cdn.ymaws.com/www.asppb.net/resource/resmgr/PSYPACT_Docs/ASPPB_TELEPSYCH_PRINCIPLES.pdf
Eichstadt, T. J., Castilleja, N., Jakubowitz, M., & Wallace, A. (2013, November). Standardized assessment via telepractice: Qualitative review and survey data [Paper presentation]. Annual meeting of the American-Speech-Language-Hearing Association, Chicago, IL, United States.
Grosch, M. C., Gottlieb, M. C., & Cullum, C. M. (2011). Initial practice recommendations for teleneuropsychology. The Clinical Neuropsychologist, 25, 1119–1133.
Interorganizational Practice Committee [IOPC]. (2020). Recommendations/guidance for teleneuropsychology (TeleNP) in response to the COVID-19 pandemic. https://static1.squarespace.com/static/50a3e393e4b07025e1a4f0d0/t/5e8260be9a64587cfd3a9832/1585602750557/Recommendations-Guidance+for+Teleneuropsychology-COVID-19-4.pdf
Stolwyk, R., Hammers, D. B., Harder, L., & Cullum, C. M. (2020). Teleneuropsychology (TeleNP) in response to COVID-19. https://event.webinarjam.com/replay/13/pyl2nayhvspsp09
Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence. Pearson.
Wechsler, D. (2009). Wechsler Memory Scale (4th ed.). Pearson.
Telepractice–Face-to-Face Mode
See Table 1
- Brearly, T., Shura, R., Martindale, S., Lazowski, R., Luxton, D., Shenal, B., & Rowland, J. (2017). Neuropsychological test administration by videoconference: A systematic review and meta-analysis. Neuropsychology Review, 27(2), 174–186.
- Cullum, C. M., Weiner, M., Gehrmann, H., & Hynan, L. (2006). Feasibility of telecognitive assessment in dementia. Assessment, 13(4), 385–390.
- Cullum, C. M., Hynan, L. S., Grosch, M., Parikh, M., & Weiner, M. F. (2014). Teleneuropsychology: Evidence for video teleconference-based neuropsychological assessment. Journal of the International Neuropsychological Society, 20, 1028–1033.
- Galusha-Glasscock, J., Horton, D., Weiner, M., & Cullum, C. M. (2016). Video teleconference administration of the Repeatable Battery for the Assessment of Neuropsychological Status. Archives of Clinical Neuropsychology, 31(1), 8–11.
- Grosch, M., Weiner, M., Hynan, L., Shore, J., & Cullum, C. M. (2015). Video teleconference-based neurocognitive screening in geropsychiatry. Psychiatry Research, 225(3), 734–735.
- Hildebrand, R., Chow, H., Williams, C., Nelson, M., & Wass, P. (2004). Feasibility of neuropsychological testing of older adults via videoconference: Implications for assessing the capacity for independent living. Journal of Telemedicine and Telecare, 10(3), 130–134. https://doi.org/10.1258/135763304323070751
- Hodge, M., Sutherland, R., Jeng, K., Bale, G., Batta, P., Cambridge, A., Detheridge, J., Drevensek, S., Edwards, L., Everett, M., Ganesalingam, K., Geier, P., Kass, C., Mathieson, S., McCabe, M., Micallef, K., Molomby, K., Ong, N., Pfeiffer, S., … Silove, N. (2019). Agreement between telehealth and face-to-face assessment of intellectual ability in children with specific learning disorder. Journal of Telemedicine and Telecare, 25(7), 431–437. https://doi.org/10.1177/1357633X18776095
- Ragbeer, S. N., Augustine, E. F., Mink, J. W., Thatcher, A. R., Vierhile, A. E., & Adams, H. R. (2016). Remote assessment of cognitive function in juvenile neuronal ceroid lipofuscinosis (Batten disease): A pilot study of feasibility and reliability. Journal of Child Neurology, 31, 481–487. https://doi.org/10.1177/0883073815600863
- Stain, H. J., Payne, K., Thienel, R., Michie, P., Vaughan, C., & Kelly, B. (2011). The feasibility of videoconferencing for neuropsychological assessments of rural youth experiencing early psychosis. Journal of Telemedicine and Telecare, 17, 328–331. https://doi.org/10.1258/jtt.2011.101015
- Sutherland, R., Trembath, D., Hodge, A., Drevensek, S., Lee, S., Silove, N., & Roberts, J. (2017). Telehealth language assessments using consumer grade equipment in rural and urban settings: Feasible, reliable and well tolerated. Journal of Telemedicine and Telecare, 23(1), 106–115. https://doi.org/10.1177/1357633X15623921
- Temple, V., Drummond, C., Valiquette, S., & Jozsvai, E. (2010). A comparison of intellectual assessments over video conferencing and in-person for individuals with ID: Preliminary data. Journal of Intellectual Disability Research, 54(6), 573–577. https://doi.org/10.1111/j.1365-2788.2010.01282.x
- Wadsworth, H., Galusha-Glasscock, J., Womack, K., Quiceno, M., Weiner, M., Hynan, L., Shore, J., & Cullum, C. (2016). Remote neuropsychological assessment in rural American Indians with and without cognitive impairment. Archives of Clinical Neuropsychology, 31(5), 420–425. https://doi.org/10.1093/arclin/acw030
- Wadsworth, HE, Dhima, K., Womack, K.B, Hart, J., Weiner, M. F., Hynan, L. S., & Cullum, C. M. (2018). Validity of teleneuropsychological assessment in older patients with cognitive disorders. Archives of Clinical Neuropsychology, 33(8), 1040–1045. https://doi.org/10.1093/arclin/acx140
- Wright, A.J. (2018a). Equivalence of remote, online administration and traditional, face-to-face administration of the Woodcock-Johnson IV cognitive and achievement tests. Archives of Assessment Psychology, 8(1), 23-35.
- Wright, A. J. (2018b). Equivalence of remote, online administration and traditional, face-to-face administration of the Reynolds Intellectual Assessment Scales-Second Edition. https://pages.presencelearning.com/rs/845-NEW-442/images/Content-PresenceLearning-Equivalence-of-Remote-Online-Administration-of-RIAS-2-White-Paper.pdf
Digital–Traditional Format
See Table 2
- Daniel, M. H. (2012). Equivalence of Q-interactive administered cognitive tasks: WAIS–IV (Q-interactive Technical Report 1). Pearson. https://www.pearsonassessments.com/content/dam/school/global/clinical/us/assets/q-interactive/007-s-QinteractiveTechnical%20Report%201_WAIS-IV.pdf
- Daniel, M. H. (2012). Equivalence of Q-interactive administered cognitive tasks: WISC–IV (Q-interactive Technical Report 2). Pearson. https://www.pearsonassessments.com/content/dam/school/global/clinical/us/assets/q-interactive/009-s-Technical%20Report%202_WISC-IV_Final.pdf
- Daniel, M. (2013). Equivalence of Q-interactive and paper administration of WMS-IV cognitive tasks (Q-interactive Technical Report 6). Pearson.
- Daniel, M. H., Wahlstrom, D., & Zhang, O. (2014). Equivalence of Q-interactive and paper administrations of cognitive tasks: WISC®–V (Q-interactive Technical Report 8). Pearson. https://www.pearsonassessments.com/content/dam/school/global/clinical/us/assets/q-interactive/003-s-Technical-Report_WISC-V_092514.pdf
- Raiford, S. E., Holdnack, J. A., Drozdick, L. W., & Zhang, O. (2014). Q-interactive special group studies: The WISC–V and children with intellectual giftedness and intellectual disability (Q-interactive Technical Report 9). Pearson. http://www.helloq.com/content/dam/ped/ani/us/helloq/media/Technical_Report_9_WISC-V_Children_with_Intellectual_Giftedness_and_Intellectual_Disability.pdf
- Raiford, S. E., Drozdick, L. W., & Zhang, O. (2015). Q-interactive special group studies: The WISC–V and children with autism spectrum disorder and accompanying language impairment or attention-deficit/hyperactivity disorder (Q-interactive Technical Report 11). Pearson. http://images.pearsonclinical.com/images/assets/WISC-V/Q-i-TR11_WISC-V_ADHDAUTL_FNL.pdf
- Raiford, S. E., Drozdick, L. W., & Zhang, O. (2016). Q-interactive special group studies: The WISC–V and children with specific learning disorders in reading or mathematics (Q-interactive Technical Report 13). Pearson. https://www.pearsonassessments.com/content/dam/school/global/clinical/us/assets/q-interactive/012-s-Technical_Report_9_WISC-V_Children_with_Intellectual_Giftedness_and_Intellectual_Disability.pdf
- Raiford, S. E., Zhang, O., Drozdick, L. W., Getz, K., Wahlstrom, D., Gabel, A., Holdnack, J. A., & Daniel, M. (2016). Coding and Symbol Search in digital format: Reliability, validity, special group studies, and interpretation (Q-interactive Technical Report 12). Pearson. https://www.pearsonassessments.com/content/dam/school/global/clinical/us/assets/q-interactive/002-Qi-Processing-Speed-Tech-Report_FNL2.pdf