exam Blue print preparation training.pptx

this is a guideline how to prepare exam blue print for health science and medical graduates

1. By Tadese T. 10/14/2024 1 Exam Blueprint

2. Outline 10/14/2024 2 Objectives Introduction Importance of blueprint Process of blueprint preparation Example of blueprints

3. Objectives 10/14/2024 3 At the end of this session, participants will be able to: Discuss the importance of assessment blueprint Explain the process of creating blueprint Prepare blueprint for selected modules/Courses

4. Introduction to Exam Blueprint 10/14/2024 4 An approach that has evolved and been emphasized is Bp approach to assessment ( Hossam H, 2006) Blueprint is a process that ensures a match b/n curriculum and assessment system ( Content validity) A guide for construction of the whole assessment process Help to improve all aspects of course design and evaluation – benefiting both teacher and learners

5. Introduction; cont’d … 10/14/2024 5 A map or specification of assessment items based on educational outcome Indicates that a process of assessment needs to be conducted according to a replicable plan Its primary function is to support the validity of asst.– content validity It helps to align assessment items with the intended learning outcomes and students learning experience Education in Medicine Journal 2020; 12(1): 71–80 , THE CLINICAL TEACHER 2006; 3: 175–179 177

6. Introduction; cont’d … 10/14/2024 6 Ensure congruence among the three pillars of education Ensure that there are no questions that are out of the syllabus Make assessment fair to the students Guide the instructional strategies Determine the level of emphasis for each contents/competencies

7. Introduction; cont’d … 10/14/2024 7 Communicate your values (what material is really important) to students Help ensure that your tests are linked to teaching objectives Improve all aspects of course design and evaluation To identify appropriate test method Guides the test/exam construction process

8. How Can We Prepare Blueprint? 10/14/2024 8 Many ways to specify assessment blueprint Often written as a grid/tables to ensure representativeness Two –dimensional (Content-by-process matrix) – R ecommended Three –dimensional – more complex

9. Two –Dimensional Matrix 10/14/2024 9 O ne axis representing the problems or conditions upon which the competencies will be demonstrated The other axis represents the competencies to be tested (e.g. history taking, communication skills, physical examination, management planning, etc.) ( Newble , 2004)

10. Three Questions to be Answered 10/14/2024 10 What we want to assess ( KSA ) How we assess (methods) Relative importance (weight) of each area

11. Possible Frameworks 10/14/2024 11 Discipline/Course/Module Organ system Clinical presentation Medical specialty HCW  role expected (domain/sub-domain) Task or skill

12. Hossam H, 2006 10/14/2024 12

13. University of Calgary Medical School; Canada ( Kevin M, 2009) 10/14/2024 13

14. Assessment Blueprint for BSc Degree in Anesthesia, Ethiopia 10/14/2024 14

15. Eg . For Medical Lab. Science 10/14/2024 15

16. Anesthesia Qualification Exam Blueprint, 2023 10/14/2024 16

17. Exit Exam Blueprint, MOE 10/14/2024 17

18. Summary 10/14/2024 18 Our BP should able to answer the following questions: Can we prove that our assessments were valid and defensible? Were our tools developed to measure specific KSAs Was the level of the test appropriate to the candidates? Did we ever test higher cognitive learning? What about the practice of assessing skills and behaviors? How representative and reliable our tests were?

19. Group Activity 10/14/2024 19 Be in your group (dept.) and prepare blueprint for modules in your program; G- I: Pediatric Nursing G- II: Pharmacy G- III: Adult Nursing G – IV: Anesthesia G- V: Psychatry G- VI: Med. Lab. Sci. G-VII: SPH G-VIII: Biomedical + other depts ---work on system based modules

20. Activity Guide 10/14/2024 20 Refer to the given Bp templates and customize to your program Select one module/course from your curriculum Design two dimensional grid/ table by incorporating: Module competencies/content/ Tasks/process Learning outcomes Assessment method(s) Weight/emphasis

21. Activity guide; Cont’d… 10/14/2024 21 After reaching consensus on the design/template, Identify competencies/contents Then write the tasks/process expected of the students after completing the module Assign weight/level of emphasis from 100% for each task/process Write the learning outcomes for each task/process Assign appropriate assessment method(s) (MCQ, SOE, CBD, DOPS, PCE/Mini-CEX, OSCE, MSF, portfolio …)

22. THANK YOU! 10/14/2024 22