Evaluation & Assessment

Performance Levels and Ranges
 

Overview

The following CPRB-endorsed levels and ranges of performance expectations related to the 2010 Accreditation Standards were developed in consultation with hospital pharmacy directors and managers, residency directors, representatives of pharmacy professional associations, residency coordinators, pharmacy residents, preceptors, and pharmacists practicing in Canada and the United States. These levels and ranges provide examples of performance related to each of the competencies outlined in the Accreditation Standards (found here) and is useful for evaluating a resident's progress throughout the year. 

Please click here for a PDF copy of the CPRB Levels and Ranges document. 

 

Standard 3.1 – Provide Direct Patient Care as a Member of Interprofessional Teams

The resident shall be proficient in providing evidence-based direct patient care as a member of interprofessional teams

Range

Residents are expected to collaboratively manage simple drug related problems in patients with uncomplicated medical problems or psychosocial needs with minimal supervision from preceptors. For more complex drug related problems, or for patients with more complex medical problems or psychosocial needs, residents are expected to self-assess and identify what supports are required to assist the resident in provision of patient care. Residents work collaboratively within interprofessional teams and recognize their roles, limitations, and responsibilities.

Beyond Expected Level

The resident:

  • intervenes beyond the health care organization or outside the immediate care team to resolve continuity of care issues or drug related problems (e.g., liaising with team members from a transferring healthcare organization)

  • consistently and in a time/resource efficient and effective manner, addresses all actual and potential drug related problems for all assigned patients and seeks additional patient care opportunities

  • brings unique perspectives to critical evaluation of literature

Expected Level

The resident is able to:

  • consistently demonstrate a professional, patient-centered, team-oriented presence in the day-to-day performance of his/her clinical duties

  • obtain critical information from all appropriate sources in a time-efficient manner (including patient or caregiver interview, or pharmacy or health records)

  • pro-actively intervene with the patient, caregivers, and/or immediate care team to resolve or prevent actual or potential continuity of care issues

  • accurately identify relevant drug related problems and drug related needs and is able to prioritize amongst a variety of competing/different interests

  • provide timely, effective, and efficient resolution of drug related problems

  • uses critical appraisal of literature to apply evidence-based medicine to a specific patient care situation

  • appropriately balance use of primary, secondary, and tertiary references based on specific circumstances

  • document care provided in a professional and timely way, making use of data collected from multiple sources

Below Expected Level

The resident is:

  • is unable to gather or obtain critical information during an interview with a patient/caregiver in a timely manner

  • is unable to identify/state important drug related problems

  • is unable to prioritize amongst different/competing drug related problems

  • demonstrates over-reliance on tertiary references

  • is unable to consider different alternatives to manage drug-related problems

  • is unable to select an appropriate management strategy for drug-related problems

  • does not resolve drug-related problems in a timely manner

  • is unable to work collaboratively as a member of an interprofessional team (unaware of his role and responsibilities within the team; unable to effectively interact and communicate with team members)


 

Standard 3.2 – Manage and Improve Medication Use Systems

The resident shall demonstrate a working knowledge of medication use system(s) as well as pharmacy and other care provider roles within the system, in order to manage and improve medication use for individual patients and groups of patients.

Range

Residents are expected to understand and be able to effectively explain all aspects of the drug distribution and medication use systems in order to be able to optimize patient safety and patient care. Accordingly, residents apply their knowledge of medication management tools (such as formularies, automatic substitution policies, medical directives, etc) and therapeutic strategies (such as therapeutic drug monitoring, drug utilization review, etc.) to ensure safe and effective use of medications within the health care organization. Residents utilize reporting systems (such as adverse drug reports or medication incident reporting) as vehicles to improve the quality of medication use within the health care organization or system.

Beyond Expected Level

The resident:

  • independently applies knowledge related to drug distribution systems and medication prescribing processes to improve efficiency and effectiveness of health care delivery within a team-based context

  • is able to critically analyze medication incident reports and provide recommendations to prevent future incidents from occurring

  • is able to identify system-level areas for improvement in drug distribution systems

  • is able to identify gaps in current policies related to documentation of prescriptions and prescription changes, and suggest alternatives

  • independently, accurately, correctly and efficiently prepares sterile products (including cytotoxic agents) after completion of a health care organization’s training program

Expected Level

The resident is able to:

  • clearly, concisely, and completely describe the functioning of the drug distribution system and medication prescribing processes within the health care organization to another health care professional

  • assess prescriptions for accuracy, appropriateness, and adherence to health care organizational policies and practices

  • consistently identify and complete medication incident reports

  • explain, and educate others about health care organizational practices and policies related to preparation of sterile products (such as cytotoxic agents, parenteral nutrition, injectable medications), and narcotic and controlled drugs

  • document prescriptions and prescription changes clearly and completely, consistent with health care organizational policies and practices

Below Expected Level

The resident:

  • provides inaccurate or incomplete explanations of drug distribution systems within the health care organization, thereby resulting in incorrectly written prescriptions, lack of timely availability of or access to medications, etc.

  • lacks awareness or provides inaccurate descriptions of the role of pharmacists and other health care providers within the drug distribution system

  • is unable to consistently assess/evaluate orders to ensure safe and effective use of medications consistent with health care organizational policies and practices

  • utilizes inaccurate, inconsistent, or incomplete medication incident reporting systems

  • is unable to effectively teach or explain principles and practices related to safe medication use within the health care organization

  • is inconsistent or unclear in documentation

 

 

Standard 3.3 – Exercise Leadership

The resident shall apply leadership and management skills to contribute to the goals of the program, department, organization, and profession.

Range

Residents are expected to demonstrate abilities to manage complexity and change within large organizations, interprofessional teams, and pharmacy workgroups. Residents are expected to apply their understanding of management principles (such as human resource management, continuous quality improvement, change management, and budget management) to ensure self-efficacy and effective team-based dynamics to optimize patient care. Residents are expected to demonstrate leadership skills within the residency program, the department, the organization, and/or the profession. Residents adhere to professional and ethical standards in working through complex situations.

Beyond Expected Level

The resident is able to:

  • articulate a new vision of the future of the pharmacy profession, and manage his/her practice in a way that advances the profession toward that goal

  • effectively deal with complex situations by effectively applying ethical reasoning and reflective practice skills

  • coordinate care for medically complex patients with complex medical problems or psycho-social needs

  • freely, independently and appropriately offer opinions and recommendations for healthcare system change to audiences within and outside pharmacy

  • initiate, galvanize support for, and bring to fruition initiatives with widespread effects on healthcare systems or the profession of pharmacy

Expected Level

The resident is able to:

  • effectively and articulately respond to those who may oppose pharmacy-specific practices and policies

  • articulate alternatives and constructive proposals for change management (but may require assistance in actually implementing those alternatives or proposals)

  • advocate for pharmacy care and actively seek out opportunities to provide pharmacists’ care and services in a variety of settings

  • constructively work toward enhanced patient safety within a collaborative environment

  • articulate a personal statement or philosophy of practice, appropriate to diverse audiences (e.g. patients, other pharmacists, other health care professionals, etc.)

  • establish professional relationships with other team members

  • participate actively as a member of professional associations

Below Expected Level

The resident:

  • is unable to articulate the difference between leadership and management

  • adopts an unprofessional or negative stance towards issues within the organizational structures responsible for delivery of pharmacist services, or the health care organization or pharmacy profession rather than providing future-oriented, constructive proposals for change management

  • is unable or unwilling to promote the practice of pharmacy, the role of pharmacists, or pharmacy practice residencies to the public, students, or other healthcare professionals


Standard 3.4 – Exhibit Ability to Manage One’s Own Practice of Pharmacy

The resident shall apply skill in the management of his/her own practice of pharmacy, to advance his/her own learning, to advance patient care, and to contribute to the goals of the program, department, organization, or profession.

Range

Residents are expected to accurately self-assess and respond to practice demands and practice-related learning needs, to ensure they are able to remain current throughout their professional careers. Residents are expected to demonstrate effective time- and resource-management skills to allow them to balance multiple competing demands while achieving agreed upon objectives. Residents are expected to apply normative standards to self-evaluate their contributions to patient care and the profession. Residents work collaboratively and respectfully as part of pharmacy and interprofessional teams and adapt to changing/evolving circumstances of practice.

Beyond Expected Level

The resident is able to:

  • articulate a professional development plan, with outcome indicators based upon a comprehensive self- and peer-assessment process

  • utilize multiple methods to evaluate success of professional development activities and plans

  • create tools to facilitate own and other pharmacists’ self-evaluation of personal contributions to advancing patient care in diverse practice settings

Expected Level

The resident is able to:

  • self-evaluate, using appropriate standards, his/her contributions to the mission, vision or goals of the program, the organizational structure responsible for planning and delivery of pharmacy services, the healthcare organization, and the profession

  • articulate clearly how s/he contributes to advancement of the profession and pharmacy practice

  • demonstrate, in a pro-active manner, the ability to provide effective patient-centered pharmacy care and services

  • develop personal learning goals and plans, along with clear outcome indicators for success

  • engage in reflective practice

  • effectively self-assess learning needs as a foundation for planning continuous professional development

  • demonstrate initiative and commitment to address learning needs and gaps in personal delivery of care

Below Expected Level

The resident:

  • is unable to articulate and document personal pharmacy practice goals and plans

  • is unable to subsume personal self-interest to the needs of patients, the organizational structure responsible for planning and delivery of pharmacy services, or the health care organization

  • consistently places his/her own self-interest and needs above others without adequate consultation or discussion to address identified issues

  • is unable to articulate and document personal learning goals and plans

  • lacks effective self-assessment and reflective practice skills or propensities


Standard 3.5 – Provide Medication and Practice-Related Education

The resident shall effectively respond to medication and practice-related questions, and educate others.

Range

Residents are expected to effectively and efficiently identify and respond to educational needs of patients, other health care professionals, and members of the public. To do so, residents are required to demonstrate effective information gathering skills, the ability to accurately and concisely frame and state questions and problems, a clear understanding of various sources of literature (primary, secondary, tertiary), and the ability to formulate and present responses in an appropriate manner at the level of the audience. Residents are also expected to provide education to individuals and groups using effective teaching and learning strategies to optimize knowledge transfer and translation.

Beyond Expected Level

The resident:

  • is able to present at specialty rounds or in specialty areas

  • is invited to act as a presenter at regional, national or international conferences

  • is able to access, retrieve, analyze and synthesize information to respond to patients’ or others’ educational needs in specialty areas of practice

  • demonstrates superior levels of knowledge and comprehension related to practice in general or specialty areas

  • publishes work in peer reviewed journals

Expected Level

The resident is able to:

  • deliver poster or platform presentations about residency-based work to peers

  • appropriately adapt method, mode, or style of presentation to audience needs

  • refine requests for drug information to ensure accuracy and appropriateness

  • identify and select appropriate primary, secondary, and tertiary references required for specific situations

  • access, retrieve, analyze and synthesize information to respond to patients’ or others’ educational needs in general areas of practice

  • anticipate and have an answer prepared for common follow-up questions about drug information

  • develop and deliver presentations in a concise, clear, accurate and relevant manner using a variety of instructional media (e.g., Powerpoint, etc.)

  • provide documentation of education provided in a manner that is clear, concise, and appropriate for the audience

  • provide direct instruction, coaching, facilitation, modeling, and preceptorship to pharmacy professionals (including student pharmacists) or for other members of the interprofessional team

Below Expected Level

The resident:

  • is unable to adapt method, mode, or style of presentation based on audience needs

  • over-relies upon single and/or simplistic methods, modes or styles of presentation

  • is unable to refine requests for drug information to ensure accuracy and appropriateness

  • consistently responds to requests for information without gathering appropriate information in a timely manner

  • provides information or responses that are inaccurate, incomplete, superficial, impractical, illogical, ambiguous, or tangential

  • is unable to respond to requests beyond his/her normal ‘comfort zone’

  • is not capable of independent or unsupervised provision of medication- and practice-related education

  • demonstrates poor communication (speaking or writing) skills in English or French


Standard 3.6 – Demonstrate Project Management Skills

The resident shall use effective project management skills to undertake, conduct, and successfully complete a project related to pharmacy practice.

Range

During the residency program, residents are expected to identify a practice-based problem or issue, generate a research proposal to address it, develop appropriate research methodologies, and demonstrate effective data gathering and analysis skills. The resident is expected to complete a written report in a format suitable for publication, and must be able to defend all elements of the project, from conception to execution to interpretation.

Beyond Expected Level

The resident:

  • is able to resolve project management issues independently, with minimal supervision

  • selects challenging projects outside traditional area of pharmacy

  • demonstrate initiative and creativity in developing a project proposal or methodology

  • engages other health professionals to collaborate effectively as part of the project

  • publishes a manuscript detailing original research or project findings in a peer-reviewed journal as the first author

Expected Level

The resident is able to:

  • negotiate and adhere to project deadlines, goals, objectives, and expectations

  • accurately identify circumstances under which independence is required and circumstances under which assistance from others must be sought

  • independently identify an area of interest within which to work

  • complete the project as per specifications

  • defend hypotheses, methods, results, and conclusions in an informed manner

  • modify work plans to meet real-world contingencies and needs

  • contribute to answering a unique research question within the practice of pharmacy

  • submit a written manuscript describing the project and its outcomes to a peer-reviewed journal as a second or lesser author

Below Expected Level

The resident:

  • demonstrates disinterest or disengagement with project

  • is unduly reliant upon preceptors and others for direction

  • lacks initiative and does not meet negotiated deadlines

  • is unable to differentiate between opinions and facts

  • is unable to develop a broad research question into focused research objectives that are feasible within the project time frame