Evaluation & Assessment
Performance Levels and Ranges
Overview
The following CPRB-endorsed levels and ranges of performance expectations related to the 2010 Accreditation Standards were developed in consultation with hospital pharmacy directors and managers, residency directors, representatives of pharmacy professional associations, residency coordinators, pharmacy residents, preceptors, and pharmacists practicing in Canada and the United States. These levels and ranges provide examples of performance related to each of the competencies outlined in the Accreditation Standards (found here) and is useful for evaluating a resident's progress throughout the year.
Please click here for a PDF copy of the CPRB Levels and Ranges document.
Standard 3.1 – Provide Direct Patient Care as a Member of Interprofessional Teams
The resident shall be proficient in providing evidence-based direct patient care as a member of interprofessional teams
Range
Residents are expected to collaboratively manage simple drug related problems in patients with uncomplicated medical problems or psychosocial needs with minimal supervision from preceptors. For more complex drug related problems, or for patients with more complex medical problems or psychosocial needs, residents are expected to self-assess and identify what supports are required to assist the resident in provision of patient care. Residents work collaboratively within interprofessional teams and recognize their roles, limitations, and responsibilities.
Beyond Expected Level
The resident:
intervenes beyond the health care organization or outside the immediate care team to resolve continuity of care issues or drug related problems (e.g., liaising with team members from a transferring healthcare organization)
consistently and in a time/resource efficient and effective manner, addresses all actual and potential drug related problems for all assigned patients and seeks additional patient care opportunities
brings unique perspectives to critical evaluation of literature
Expected Level
The resident is able to:
consistently demonstrate a professional, patient-centered, team-oriented presence in the day-to-day performance of his/her clinical duties
obtain critical information from all appropriate sources in a time-efficient manner (including patient or caregiver interview, or pharmacy or health records)
pro-actively intervene with the patient, caregivers, and/or immediate care team to resolve or prevent actual or potential continuity of care issues
accurately identify relevant drug related problems and drug related needs and is able to prioritize amongst a variety of competing/different interests
provide timely, effective, and efficient resolution of drug related problems
uses critical appraisal of literature to apply evidence-based medicine to a specific patient care situation
appropriately balance use of primary, secondary, and tertiary references based on specific circumstances
document care provided in a professional and timely way, making use of data collected from multiple sources
Below Expected Level
The resident is:
is unable to gather or obtain critical information during an interview with a patient/caregiver in a timely manner
is unable to identify/state important drug related problems
is unable to prioritize amongst different/competing drug related problems
demonstrates over-reliance on tertiary references
is unable to consider different alternatives to manage drug-related problems
is unable to select an appropriate management strategy for drug-related problems
does not resolve drug-related problems in a timely manner
is unable to work collaboratively as a member of an interprofessional team (unaware of his role and responsibilities within the team; unable to effectively interact and communicate with team members)
Standard 3.2 – Manage and Improve Medication Use Systems
The resident shall demonstrate a working knowledge of medication use system(s) as well as pharmacy and other care provider roles within the system, in order to manage and improve medication use for individual patients and groups of patients.
Range
Residents are expected to understand and be able to effectively explain all aspects of the drug distribution and medication use systems in order to be able to optimize patient safety and patient care. Accordingly, residents apply their knowledge of medication management tools (such as formularies, automatic substitution policies, medical directives, etc) and therapeutic strategies (such as therapeutic drug monitoring, drug utilization review, etc.) to ensure safe and effective use of medications within the health care organization. Residents utilize reporting systems (such as adverse drug reports or medication incident reporting) as vehicles to improve the quality of medication use within the health care organization or system.
Beyond Expected Level
The resident:
independently applies knowledge related to drug distribution systems and medication prescribing processes to improve efficiency and effectiveness of health care delivery within a team-based context
is able to critically analyze medication incident reports and provide recommendations to prevent future incidents from occurring
is able to identify system-level areas for improvement in drug distribution systems
is able to identify gaps in current policies related to documentation of prescriptions and prescription changes, and suggest alternatives
independently, accurately, correctly and efficiently prepares sterile products (including cytotoxic agents) after completion of a health care organization’s training program
Expected Level
The resident is able to:
clearly, concisely, and completely describe the functioning of the drug distribution system and medication prescribing processes within the health care organization to another health care professional
assess prescriptions for accuracy, appropriateness, and adherence to health care organizational policies and practices
consistently identify and complete medication incident reports
explain, and educate others about health care organizational practices and policies related to preparation of sterile products (such as cytotoxic agents, parenteral nutrition, injectable medications), and narcotic and controlled drugs
document prescriptions and prescription changes clearly and completely, consistent with health care organizational policies and practices
Below Expected Level
The resident:
provides inaccurate or incomplete explanations of drug distribution systems within the health care organization, thereby resulting in incorrectly written prescriptions, lack of timely availability of or access to medications, etc.
lacks awareness or provides inaccurate descriptions of the role of pharmacists and other health care providers within the drug distribution system
is unable to consistently assess/evaluate orders to ensure safe and effective use of medications consistent with health care organizational policies and practices
utilizes inaccurate, inconsistent, or incomplete medication incident reporting systems
is unable to effectively teach or explain principles and practices related to safe medication use within the health care organization
is inconsistent or unclear in documentation
Standard 3.3 – Exercise Leadership
The resident shall apply leadership and management skills to contribute to the goals of the program, department, organization, and profession.
Range
Residents are expected to demonstrate abilities to manage complexity and change within large organizations, interprofessional teams, and pharmacy workgroups. Residents are expected to apply their understanding of management principles (such as human resource management, continuous quality improvement, change management, and budget management) to ensure self-efficacy and effective team-based dynamics to optimize patient care. Residents are expected to demonstrate leadership skills within the residency program, the department, the organization, and/or the profession. Residents adhere to professional and ethical standards in working through complex situations.
Beyond Expected Level
The resident is able to:
articulate a new vision of the future of the pharmacy profession, and manage his/her practice in a way that advances the profession toward that goal
effectively deal with complex situations by effectively applying ethical reasoning and reflective practice skills
coordinate care for medically complex patients with complex medical problems or psycho-social needs
freely, independently and appropriately offer opinions and recommendations for healthcare system change to audiences within and outside pharmacy
initiate, galvanize support for, and bring to fruition initiatives with widespread effects on healthcare systems or the profession of pharmacy
Expected Level
The resident is able to:
effectively and articulately respond to those who may oppose pharmacy-specific practices and policies
articulate alternatives and constructive proposals for change management (but may require assistance in actually implementing those alternatives or proposals)
advocate for pharmacy care and actively seek out opportunities to provide pharmacists’ care and services in a variety of settings
constructively work toward enhanced patient safety within a collaborative environment
articulate a personal statement or philosophy of practice, appropriate to diverse audiences (e.g. patients, other pharmacists, other health care professionals, etc.)
establish professional relationships with other team members
participate actively as a member of professional associations
Below Expected Level
The resident:
is unable to articulate the difference between leadership and management
adopts an unprofessional or negative stance towards issues within the organizational structures responsible for delivery of pharmacist services, or the health care organization or pharmacy profession rather than providing future-oriented, constructive proposals for change management
is unable or unwilling to promote the practice of pharmacy, the role of pharmacists, or pharmacy practice residencies to the public, students, or other healthcare professionals
Standard 3.4 – Exhibit Ability to Manage One’s Own Practice of Pharmacy
The resident shall apply skill in the management of his/her own practice of pharmacy, to advance his/her own learning, to advance patient care, and to contribute to the goals of the program, department, organization, or profession.
Range
Residents are expected to accurately self-assess and respond to practice demands and practice-related learning needs, to ensure they are able to remain current throughout their professional careers. Residents are expected to demonstrate effective time- and resource-management skills to allow them to balance multiple competing demands while achieving agreed upon objectives. Residents are expected to apply normative standards to self-evaluate their contributions to patient care and the profession. Residents work collaboratively and respectfully as part of pharmacy and interprofessional teams and adapt to changing/evolving circumstances of practice.
Beyond Expected Level
The resident is able to:
articulate a professional development plan, with outcome indicators based upon a comprehensive self- and peer-assessment process
utilize multiple methods to evaluate success of professional development activities and plans
create tools to facilitate own and other pharmacists’ self-evaluation of personal contributions to advancing patient care in diverse practice settings
Expected Level
The resident is able to:
self-evaluate, using appropriate standards, his/her contributions to the mission, vision or goals of the program, the organizational structure responsible for planning and delivery of pharmacy services, the healthcare organization, and the profession
articulate clearly how s/he contributes to advancement of the profession and pharmacy practice
demonstrate, in a pro-active manner, the ability to provide effective patient-centered pharmacy care and services
develop personal learning goals and plans, along with clear outcome indicators for success
engage in reflective practice
effectively self-assess learning needs as a foundation for planning continuous professional development
demonstrate initiative and commitment to address learning needs and gaps in personal delivery of care
Below Expected Level
The resident:
is unable to articulate and document personal pharmacy practice goals and plans
is unable to subsume personal self-interest to the needs of patients, the organizational structure responsible for planning and delivery of pharmacy services, or the health care organization
consistently places his/her own self-interest and needs above others without adequate consultation or discussion to address identified issues
is unable to articulate and document personal learning goals and plans
lacks effective self-assessment and reflective practice skills or propensities
Standard 3.5 – Provide Medication and Practice-Related Education
The resident shall effectively respond to medication and practice-related questions, and educate others.
Range
Residents are expected to effectively and efficiently identify and respond to educational needs of patients, other health care professionals, and members of the public. To do so, residents are required to demonstrate effective information gathering skills, the ability to accurately and concisely frame and state questions and problems, a clear understanding of various sources of literature (primary, secondary, tertiary), and the ability to formulate and present responses in an appropriate manner at the level of the audience. Residents are also expected to provide education to individuals and groups using effective teaching and learning strategies to optimize knowledge transfer and translation.
Beyond Expected Level
The resident:
is able to present at specialty rounds or in specialty areas
is invited to act as a presenter at regional, national or international conferences
is able to access, retrieve, analyze and synthesize information to respond to patients’ or others’ educational needs in specialty areas of practice
demonstrates superior levels of knowledge and comprehension related to practice in general or specialty areas
publishes work in peer reviewed journals
Expected Level
The resident is able to:
deliver poster or platform presentations about residency-based work to peers
appropriately adapt method, mode, or style of presentation to audience needs
refine requests for drug information to ensure accuracy and appropriateness
identify and select appropriate primary, secondary, and tertiary references required for specific situations
access, retrieve, analyze and synthesize information to respond to patients’ or others’ educational needs in general areas of practice
anticipate and have an answer prepared for common follow-up questions about drug information
develop and deliver presentations in a concise, clear, accurate and relevant manner using a variety of instructional media (e.g., Powerpoint, etc.)
provide documentation of education provided in a manner that is clear, concise, and appropriate for the audience
provide direct instruction, coaching, facilitation, modeling, and preceptorship to pharmacy professionals (including student pharmacists) or for other members of the interprofessional team
Below Expected Level
The resident:
is unable to adapt method, mode, or style of presentation based on audience needs
over-relies upon single and/or simplistic methods, modes or styles of presentation
is unable to refine requests for drug information to ensure accuracy and appropriateness
consistently responds to requests for information without gathering appropriate information in a timely manner
provides information or responses that are inaccurate, incomplete, superficial, impractical, illogical, ambiguous, or tangential
is unable to respond to requests beyond his/her normal ‘comfort zone’
is not capable of independent or unsupervised provision of medication- and practice-related education
demonstrates poor communication (speaking or writing) skills in English or French
Standard 3.6 – Demonstrate Project Management Skills
The resident shall use effective project management skills to undertake, conduct, and successfully complete a project related to pharmacy practice.
Range
During the residency program, residents are expected to identify a practice-based problem or issue, generate a research proposal to address it, develop appropriate research methodologies, and demonstrate effective data gathering and analysis skills. The resident is expected to complete a written report in a format suitable for publication, and must be able to defend all elements of the project, from conception to execution to interpretation.
Beyond Expected Level
The resident:
is able to resolve project management issues independently, with minimal supervision
selects challenging projects outside traditional area of pharmacy
demonstrate initiative and creativity in developing a project proposal or methodology
engages other health professionals to collaborate effectively as part of the project
publishes a manuscript detailing original research or project findings in a peer-reviewed journal as the first author
Expected Level
The resident is able to:
negotiate and adhere to project deadlines, goals, objectives, and expectations
accurately identify circumstances under which independence is required and circumstances under which assistance from others must be sought
independently identify an area of interest within which to work
complete the project as per specifications
defend hypotheses, methods, results, and conclusions in an informed manner
modify work plans to meet real-world contingencies and needs
contribute to answering a unique research question within the practice of pharmacy
submit a written manuscript describing the project and its outcomes to a peer-reviewed journal as a second or lesser author
Below Expected Level
The resident:
demonstrates disinterest or disengagement with project
is unduly reliant upon preceptors and others for direction
lacks initiative and does not meet negotiated deadlines
is unable to differentiate between opinions and facts
is unable to develop a broad research question into focused research objectives that are feasible within the project time frame