Computer based test designs (cbt)

Computer-based test designs (cbt)

1. Computer-Based Test Designs (CBT) Presented By : Muhammad Munsif [email protected]

2. DEFINITION What is CBT? Computer Based Test (CBT), is defined as a test or assessment given by the computer whether they are stand-alone or dedicated network, or with other technology devices that are connected to the Internet or World Wide Web (WWW) and mostly use the Multiple Choice Question (MCQs). Computer Based Test itself has been applied since 1960 to test the knowledge and problem-solving test.

3. TYPES OF CBT There are two types of CBT which include: Linear Test - This involves a full-length examination in which the computer selects different questions for individuals without considering their performance level Adaptive Test - Here the computer selects the range of questions based on individuals‟ performance level. These questions are taken from a very large pool of possible questions categorized by content and difficulty

4. ADVANTAGES OF CBT Improved candidate reach: Delivered via the Internet or a specific computer, a CBT test online helps remove the geographical barriers and reach more candidates. Thus, the online test saves time, money and effort of the candidates as well as the examining authority Enriched results analysis: Unlike pen-and-paper testing that captures only the candidate’s responses, a computer-based test can gather plenty of valuable information. Data such as start and end time, time spent on each item & on the overall test. This information helps in arriving at a better judgement about the candidate

5. Streamlined process: Paper-based testing involves a lot of preparation starting months prior to the exam date to ensure smooth conduct. Tasks such as securing facilities, hiring invigilators, designing and printing of the test papers and ensuring their security and storage to maintain the exam integrity keep the exam administrators on their toes before the exam. Once the exam is over, retrieval, scanning and marking of the test papers, analyzing, preparing and delivering the result occupy the entirety of the exam bodies. Many of these tasks can be automated and the processes improved to free up the administrators to concentrate on important tasks Quick delivery of results: The possibility of instant scoring, especially in the case of multiple-choice question-based exams, help the exam body prepare and deliver results quickly Test integrity: Remote proctoring and other security features make computer-based testing extremely secure allowing for the test integrity to be maintained. Helpful for candidates with disability: Screen readers, magnification tools, text-to-voice and voice-to-text applications, Braille keyboards and other such tools help the differently-abled candidates to take up the tests more conveniently as compared to a pen-and-paper test.

6. DISADVANTAGES OF CBT You can't write stuff down on your screen Difficult to navigate back Computer glitches Errors in the content/problems Staring at a computer screen There is an uneven distribution of internet network as the internet network in some areas can be poor

7. CBT Models MST CAT

8. MST Multi-Stage Test

9. Multi-Stage Test (MST ) The first, and simplest model is the multi-stage test (MST). It begins by presenting each student with a first-stage or routing test, which will typically contain 10 or more items . Once the student completes the routing test, a score is produced and a decision is made. This decision is to choose among two or more second-stage tests by determining which is most appropriate given performance on the routing test. Following the standard principles of adaptive testing, students who performed well on the routing test are assigned a second-stage test compose mainly of more difficult items, while students who struggled are administered an easier second-stage test. Upon completion of the second-stage test, a two-stage MST ends and a final score is produced that aggregates performance across both the routing and second stages of the test.

10. CAT Computerized Adaptive Test

11. Computerized Adaptive Test (CAT) Computerized adaptive testing has been widely used in educational testing programs. CAT is a method of administering items sequentially according to the ability level of each examinee. In CAT, each item is selected by a pre-determined item selection rule according to the examinee’s current ability estimate based on the available responses in the test. Then, the difficulty of each item is well matched to the examinee’s ability level and other practical requirements. The process of selecting items continues until the stopping rule is met. Steps for administrating a CAT (He,2010) are: