SLO Based Examination Development of Question Papers By Muhammad Nouman Haral FBISE Islamabad 2
01 Introduction Question Paper: Its Parts & Contents and Procedure Contents 02 QP Booklet QP Setting Booklet: An overview 03 Definitions Some Basic Terminologies and their relevance 04 Conclusion Key features of AFW and Summative examination 3
Question Paper With the exception of PBA and a couple of another subjects, every Question Paper mainly comprises of 3 main sections: Section A --- MCQs --- 20% of total marks Section B --- SRQs --- 50% of total marks Section C --- ERQs --- 30% of total marks The 2006 curriculum provided the guidelines about the respective percentages, however the updated curriculum has no specific guidelines about it. In 2006 curriculum percentages for the content coming from a single unit/chapter was also defined. (Discussed later in this session) Parts & Contents 4
Question Paper Development Process Proof-Reading The Paper-Setter then visits FBISE office and Proofreads the typed paper 03 Write up by the Paper Setter A single paper setter prepares a set of two similar question papers which are supposedly of similar degree of difficulty and have theoratically 1-1 correspondence with each other 01 Typing Question Paper is typed by the typist of the classified section on an offline local computer system. 02 Printing of Paper After another administrative process, the question papers are then printed and packed. 04 5
SINGLE PERSON EVERYONE is a Critic All who are even remotely related Question Paper Booklet SLO Based Question Papers Contents It contains: Some formal forms Some guidelines/instructions A few Limited Liability certificates Some Bills formats Table of Specification / Assessment Grids Layouts for Questions for Sections A, B and C Layouts for Rubrics and Solutions 6
ToS ( Assessment Grid ) 7
ToS ( Assessment Grid ) 8
ToS ( Assessment Grid ) 9
ToS ( Assessment Grid ) 10
ToS ( Assessment Grid ) 11
Difficulty Level Discrimination Index Ranges between to SLO/Unit The exact Number or Code in the reference document Assessment framework The important stuff Key Definitions An assessment framework provides a structured conceptual map of the learning outcomes of a programme of study along with details of how achievement of the outcomes can be measured . Ref: https://pmc.ncbi.nlm.nih.gov/articles/PMC4456467/ Validity: a. The state of being acceptable according to the law b. The quality of being well-grounded, sound, or correct Reliability: a. The quality of being able to be trusted or believed because of working or behaving well b. How well a machine, piece of equipment, or system works Merriam Webster Cambridge Dictionary Ranges between 1 to 10 or 10 to 1 12
Assessment Framework 2022 Unit Biology Chemistry Computer Science English Mathematics Pakistan Studies Physics Urdu No of SLO % No of SLO % No of SLO % No of SLO % No of SLO % No of SLO % No of SLO % No of SLO % A 9 11% 4 2% 3 15% 9 15% 23 37% 8 21% 19 10% 0% B 13 16% 83 42% 2 10% 21 34% 31 50% 15 38% 86 45% 0% C 11 13% 20 10% 5 25% 15 24% 8 13% 16 41% 11 6% 28 46% D 13 16% 23 12% 3 15% 17 27% 0% 0% 0% 15 25% E 8 10% 17 9% 2 10% 0% 0% 0% 15 8% 18 30% F 7 9% 20 10% 3 15% 0% 0% 0% 2 1% 0% G 0% 0% 0% 0% 0% 0% 8 4% 0% H 0% 0% 2 10% 0% 0% 0% 0% 0% N 0% 0% 0% 0% 0% 0% 49 26% 0% Q 21 26% 32 16% 0% 0% 0% 0% 0% 0% Total 82 100% 199 100% 20 100% 62 100% 62 100% 39 100% 190 100% 61 100% Summary of SLO Grade-IX (SSC I) 13
Assessment Framework 2022 Summary of SLO Grade-XI (HSSC I) Unit Bio Chemistry Computer Science English Mathematics Physics Urdu No of SLO % No of SLO % No of SLO % No of SLO % No of SLO % No of SLO % No of SLO % A 0% 1 0% 4 18% 9 14% 45 57% 7 4% 0% B 22 8% 146 44% 2 9% 23 36% 30 38% 44 23% 0% C 29 11% 41 12% 7 32% 16 25% 4 5% 23 12% 28 45% D 17 6% 22 7% 3 14% 16 25% 0% 21 11% 16 26% E 0% 63 19% 2 9% 0% 0% 43 22% 18 29% F 35 13% 11 3% 2 9% 0% 0% 28 14% 0% G 0% 45 14% 1 5% 0% 0% 0% 0% H 61 23% 0% 1 5% 0% 0% 0% 0% N 21 8% 0% 0% 0% 0% 28 14% 0% O 37 14% 0% 0% 0% 0% 0% 0% P 22 8% 0% 0% 0% 0% 0% 0% Q 24 9% 0% 0% 0% 0% 0% 0% Total 268 100% 329 100% 22 100% 64 100% 79 100% 194 100% 62 100% 14
15 Summative Examination All stakeholders High-Stake Examination Any summative examination is usually a highstake examination. Continuously evolving Assessment Framework Superintendent, Deputy Superitendent and Invigilation Staff Books are reference SLO Alignment The Question Paper / Assessment / Assessment method should be valid, reliable and consistent with the set objectives.
16 FAQs Is it forbidden to take any question from a book? NO, it is not. Are all the questions aligned with an SLO? Yes, these are. Is the K, U and A distribution defined by curriculum? Yes, it is, but the assessment body (in this case FBISE can also improvise.) 1777 2NLx4n4B 3dNBFHDG 16
Q & A Suggestions Written Feedback 01 02 03 With High Hopes & Best Wishes 17