Online case-based assessment (CBA) – Program Rollout
The College is eliminating the random selection process for registrants to participate in peer and practice reviews. Instead, all registrants will be required to complete an online, “open-book” case-based assessment (CBA) on a regular and recurring basis, approximately every five years. The CBA will be used by the College to identify risks in practice and direct resources where they are most needed to help registrants provide safe and effective care.
As the cornerstone of the College’s quality assurance (QA) program, the CBA is intended to provide evidence-based feedback that will encourage Registered Psychotherapists (RPs) to continue to think critically about their practice, their professional growth, and their obligations as regulated health professionals. It supports reflective practice and life-long learning, critical components of providing safe and effective care.
Pilot – November 22 to 26, 2022
To ensure the CBA is an effective regulatory tool, we recruited 178 RPs to take the CBA as part of a pilot.
The CBA consisted of 30 situational judgement questions (“cases”). Each case had five answer options. Participants were asked to rank the five answers from the option most aligned with the Standards to the option least aligned with the Standards.
The CBA portal was available 24-hours a day from November 22 to 26, 2022. Pilot participants received a unique code to access the portal. After logging in, participants had three hours to complete the assessment.
The pilot assessment helped us validate the cases, test the platform, clarify instructions, and determine practical considerations, for example, how much time will be required to complete the assessment.
All pilot participants who completed the pilot assessment were provided with their results and feedback. Some participants have volunteered to pilot the peer-assisted review with a peer coach process. All pilot participants will not need to complete another CBA until their next 5-year cycle is due.
Pilot results
178 registrants volunteered to take the pilot CBA. The results supported our assumptions that most registrants who complete the CBA will be successful.
In addition, after reviewing data and feedback from participants, we increased the assessment time from 3 to 4 hours.
Program Launch – Spring and Fall 2023
The QA online assessment will become a mandatory component of the QA program in 2023.
Each year, there will be two assessment periods which will take place in May and October.
With the introduction of the online assessment, CRPO’s enhanced QA program will consist of the following main components:
1. Self-assessment and professional development (PD)
Registrants will still be required to complete and submit a self-assessment and engage in a minimum of 40 hours of relevant learning activities during their 2-year PD cycle. An RP’s PD cycle is based on their year of registration. At the end of an RP’s PD cycle, they are required to report that they completed their PD activities. In addition, any registrant who fails to participate in required PD reporting or online assessment, may be required to engage in a peer and practice review (PPR) activity.
2. Peer and practice review
When selected, registrants will be required to participate in the first stage of a peer and practice review by completing the CBA approximately every five years.
Registrants whose online CBA results identify competence deficits will participate in a peer-assisted review with a peer coach.
3. Remediation
Registrants who require additional support to address identified learning needs may be required to engage in directed remediation by the Quality Assurance Committee. Directives from the QA Committee may include remediation or specified continuing education.
In certain circumstances, the Quality Assurance Committee may direct the Registrar to impose terms, conditions and limitations on a Registrant’s Certificate of Registration, for example:
- if a Registrant demonstrates egregious gaps in knowledge, skill or judgment, despite receiving peer-assisted guidance and reassessment opportunities; or
- if a Registrant does not successfully complete a program of specified continuing education or remediation.