The principle of high Quality Assessment

Key characteristics of high quality assessments include clear learning targets, appropriate assessment methods, validity, reliability, fairness, practicality, and productive uses that improve learning. Unproductive uses include grading, labeling, threatening, and ridiculing students.

1. By Cyril l. austria t-1, Tagbac elem.school ragay district PRINCIPLES OF HIGH - QUALITY ASSESSMENT

2. identify what constitutes high quality assessments list down the productive and unproductive uses of tests classify the various types of test

3. ASSESSMENT used to determine what a student knows or can do Assessment requires the gathering of evidence of student performance over a period of time to measure learning and understanding

4. Evaluation is used to determine the worth or value of a course or program Evaluation uses assessment information to support decisions on maintaining, changing, or discarding instructional or programmatic practices.

5. The Overall Goal of Assessment to improve student learning. Assessment provides students, parents/guardians, and teachers with valid information concerning student progress and their attainment of the expected curriculum

6. Characteristics of High - Quality Assessment Provide results that demonstrate and improve targeted student learning. Convey instructional decision making

7. Characteristics of High - Quality Assesment The criteria that must be considered to ensure the quality of test 1. Clear and Appropriate Learning Targets

8. Characteristics of High - Quality Assesment Learning Target a clear description of what students know and able to do.

9. Characteristics of High - Quality Assesment Five Learning Targets as Categorized by Stiggins and Conklin a. Knowledge learning target the ability of the student to master a substantive subject matter

10. b. Reasoning learning target the ability to use knowledge and solve problems

11. c. Skill learning target the ability to demonstrate achievement related skills like conducting experiments, playing basketball, and operating computers

12. d. Product learning target the ability to create achievement –related products such as written reports, oral presentations, and art products.

13. e . Affective learning target the attainment of affective traits such as attitudes, values, Interests, and self - efficacy

14. The criteria that must be considered to ensure the quality of test 2. Appropriateness of Assessment Methods

15. Matching Learning Targets with Assessment Method ASSESMENT METHODS TARGETS OBJECTIVE ESSAY PERFOR- MANCE BASED ORAL QUESTIONS OBSERVATION SELF REPORT KNOWLEDGE 5 4 3 4 3 2 REASONING 2 5 4 4 2 2 SKILLS 1 3 5 2 5 3 PRODUCT 1 1 5 2 4 4 AFFECTIVE 1 2 4 4 4 5

16. The criteria that must be considered to ensure the quality of test 3 . Validity Test validity is the degree to which a test measures what it is suppose to measure

17. Factors that influence the validity of the test Appropriateness of test items Directions Reading vocabulary Sentence structure

18. How Validity is Determined Different types of evidences to use in determining validity i . Content –related Validity a test or exam can be built with high content validity by: Identifying the subject matter topics and behavioral outcomes to be measured Building a table of specifications Constructing a test that tests closely fits the specifications

19. ii. Criterion -related validity determines the relationship between an assessment and another measure of the same trait.

20. iii. Construct –related validity determines which assessment is a meaningful measure of an observable trait or characteristics like intelligence, reading comprehension, honesty, motivation, attitude, learning style,

21. v. Instructional-related Validity determines to what extent the domain of contain in the test is taught in class.

22. b. Test Validity Enhancers The following are suggestions for enhancing the validity of classroom assessments: i . Prepare the table of specifications (TOS)

23. ii. Construct appropriate test items. iii. Formulate directions that are brief, clear and concise

24. iv. Consider the reading vocabulary of the examinees. v. Make the sentence structure of your test items simple. vi. Never have an identifiable pattern of answer.

25. vii. Arrange test items from easy to difficult. viii. Provide adequate time for student to complete the assessment

26. ix. Use different methods to assess the same thing. x. Use the test only for intended purpose .

27. The criteria that must be considered to ensure the quality of test 4. Reliability Refers to the consistency of a measure. Test is consider reliable if the same result get repeatedly. the extent to which a test is dependable, self –consistent, and stable.

28. Types of Reliability Test – Retest Method or Test of Stability   Used to assess the consistency of a measure The test is administered twice at two different points in time Assumes that there will be no change in the quality of or construct being measured Best used for things that are stable over time, such as intelligence.

29. Types of Reliability Split - half Method The test is administered once The items are divided into two halves The two halves of the test must be similar but not identical in content and difficulty .

30. Factors that affect test reliability: Factors that affect test reliability: 1. scorer’s inconsistency because of his/her subjectivity 2. limited sampling because of incidental inclusion and accidental exclusion of some materials in the test.

31. Factors that affect test reliability: 3. changes in the individual examinee himself/ herself and his/her instability during the examination 4. testing environment

32. a. How Reliability is Determined Ways of establishing test reliability: - length of the test - difficulty of the test - objectivity of the scorer

33. b. The Concept of Error in Assesment The observed score is the product of what true score or real ability or skill plus some degree of error r = true/total obtained or Observed Score = True score + Error True amount Error Measurement or value “ obtained “

34. Sources of Error Common Error Internal Error External Error Health Mood Motivation Test-taking skills Anxiety Fatigue General Ability Directions Luck Item Ambiguity Heat in the room Lighting Sample of items Observer Differences and Test Interpretation Scoring

35. Test Reliability Enhancers things that should be consider in enhancing the reliability of classroom assessments Use sufficient number of items or tasks. A longer test is more reliable.

36. ii. Use independent raters or observers who can provide similar scores to the same performances iii. Make sure the assessment procedures and scoring are objective iv. Continue assessment until the results are consistent.

37. v. Eliminate or reduce the influence of extraneous events or factors vi. Asses the difficulty level of the test vii. Use shorter assessments more frequently rather than a few long assessments.

38. The criteria that must be considered to ensure the quality of test 5. Fairness this pertain to the intent that each question should be made as clear as possible to the examinees and the test is absent of any biases

39. The criteria that must be considered to ensure the quality of test 6. Positive consequences Learning assessments provide students with effective feedback and potentially improve their motivation and/or self-esteem.

40. The criteria that must be considered to ensure the quality of test 7 . Practicality and Efficiency Administrability requires that a test must be administered with ease, clarity and uniformity. Directions must be specific so that students and teachers will understand what they must do exactly.

41. c. Scorability demands that a good test should be easy to score . d. Test results should readily be available to both students and teachers for remedial and follow-up measures. e. The teachers familiarity with the method, the time required and the cost is also considered

42. Productive Uses of Test Learning Analysis test are used to identify the reasons or causes why students do not learn and the solutions to help them learn. Improvement of Teacher in a reliable grading system, the class average is the grade the teacher has earned

43. Productive Uses of Test Improvement of Curriculum Poor performance in a test indicate that the teacher is - not explaining the material effectively - the textbook is not clear - the students are not properly taught - the students do not see meaningfulness of the materials

44. Productive Uses of Test If the entire class does poorly, the curriculum, the curriculum needs to be revised or special units need to be developed for the class to be continue . Improvement of Instructional Materials . tests measure how effective instructional materials are in bringing about intended

45. Productive Uses of Test Individualization. effective test always indicate differences in students’ learning. These can serve as bases for individual help. Selection. when enrollment opportunity or any other opportunity is limited, a test can be used to screen those who are more qualified

46. Productive Uses of Test Placement. test can be used to determine to which category a student belongs. Guidance and Counseling . help teachers and counselors guide students in assessing future academic and career posibilities

47. Productive Uses of Test Researh . Tests can be feedback tool to find effective methods of teachings and learn more about students, their interest, goals and achievements Identification of Exceptional Children . tests can reveal exceptional students inside the classroom

48. Productive Uses of Test Selling and Interpreting the School to the Community. Effective test help the community understand what the students are learning It also used to diagnose general schoolwide weaknesses and strengths that require community or government support

49. Productive Uses of Test Evaluation of Learning Program

50. Unproductive Uses of Test Grading – tests should not be used as the only determinants in grading a test. Ridiculing – this means using tests to deride students Threatening – tests losts their validity when used as disciplinary measures

51. Unproductive Uses of Test Unannounced Testing Allocating funds Labeling Tracking - students are grouped according to difficiences

52. Classifications of Tests Administration a. Individual – given orally and requires the examinees’ constant attention since the manner of answering maybe as important as the score. Examples: Wechsler Adult Intelligence Scale Power Point Presentation used as a performance tests in Speech Class

53. b. Group – for measuring cognitive skills to measure achievement. Most tests in school are considered group test where different test takers take the test as a group

54. Classifications of Tests 2. Scoring Objective – independent scores agree on the number of points the answer should receive. e.g. multiple choice and true or false. Subjective - answers can be scored through various ways, e.g., essays and performance test

55. Classifications of Tests 3. Sort of Response being Emphasized a. Power – allows examinees a generous time limit to be able to answer every item. b. Speed – with severely limited time constraints but the item are easy and only a few examinees are expected to make errors.

56. Classifications of Tests 4. Types of Response the Examinees must take a. performance – requires students to perform a task . Administered individually Measure the time the examinee has performed in each task b. Paper and Pencil Test – examinees are asked to write on paper.

57. Classifications of Tests 5 . What is Measured a. Sample – limited representative test designed to measure the total behavior of the examinee b. Sign Test – diagnostic test designed to obtain diagnostic signs to suggests that some form of remediation is needed .

58. Classifications of Tests 6 . Nature of the Group Being Compared a. Teacher - made test Contains the subject being taught by the same teacher who constructed the test b. Standardized test Constructed by test specialists working with curriculum experts and teachers

59. Other Types of Tests Mastery tests - measure the level of learning of a given set of materials and the level attained. Discriminatory tests – it distinguish the differences between students or groups of students . it indicates the areas where students need help.

60. Other Types of Tests 3. Recognition test -require students to choose the right answer from their memory. 4. Recall test -require students to supply the correct answer from their memory. 5. Specific recall tests -require short responses that are fairly objective .

61. Other Types of Tests 6. Free recall tests -require students to construct their own complex responses. There are no right answers but a given answer might be better than the other. 7. Maximum performance tests – require student to obtain the best score possible .

62. Other Types of Tests 8. Typical performance tests –measure the typical or usual or average performance. 9. Written tests –depend on the ability of the students to understand, read and write.

63. Other Types of Tests 10. Oral examinations depend on the examinee’s ability to speak. Logic is also required. 11. Language tests –require instructions and questions to be presented in words.

64. Other Types of Tests 12. Non-language tests are administered by means of pantomime, painting or signs and symbols. 13. Structured test have very specific, well- defined instructions and expected outcomes .

65. Other Types of Tests 14. Projective tests present ambiguous stimulus or questions designed to elicit highly individualized responses. 15. Product tests emphasize only the final answer.

66. Other Types of Tests 16. Process tests focus on how the examinees attack, solve, or work out a problem. 17. External reports are tests where a ratee is evaluated by another person.

67. Other Types of Tests 18. Internal reports are self evaluated. 19. Open books, tests depend on one’s understanding and ability to express one’s ideas and evaluate concept.

68. Other Types of Tests 20. Closed book test depend heavily on the memory of the examinees. 21. Non-learning format tests determine how much information the students know.

69. Other Types of Tests 22. Learning format test require the students to apply previously learned materials. 23. Convergent format tests purposely lead the examinees to several possible answer.

70. Other Types of Tests 24. Divergent format tests lead the examinees to several possible answer . 25. Scale measurements distribute ratings along a continuum.

71. Other Types of Tests Test measurements refer to the items being dichotomous or either right or wrong, but not both. Pre-tests measure how much is known about a material before it is presented.

72. Other Types of Tests 28. Post-tests measure how much has been learned after a learning material has been given. 29. Sociometrics reveal the interrelationship among members or the social structure of a group.

73. Other Types of Tests 30. Anecdotal records reveal episodes of behavior that may be indicate a profile of the students.

74. COMPARISON BETWEEN TEACHER MADE TESTS AND STANDARDIZED TESTS

75. CHARACTERISTIC TEACHER MADE TESTS STANDARDIZED TESTS Directions for administration and scoring Usually, no uniform directions are specified. Specific instructions standardized the administration and scoring procedures Sampling content Both content and sampling are determined by the classroom teacher. Content is determined by curriculum and subject matter experts construction May be hurriedly done because of time constraints; often no Test blueprints, item revision; quality of tests may be quite poor. It uses meticulous construction procedures that include objectives and test blueprints, item analysis and item revisions norms Only local classroom norms are available. In addition to local norms, it makes national, school, district, and school building norms. Purpose and use Best suited for measuring particular objective set by the teacher and interclass comparisons Best suited for measuring broader curriculum objectives and for interclass, school, and national comparisons

76. 1. Explain why validity implies reliability? 2. Generate some other qualities that you believe contribute to making good assessments. 3.List down your personal experiences of unfair assessments .

77. THANK YOU

78. Learning Assessment 1 - Ronald S.P. Elicay , Ph.D., Arnulfo Aaron R. Reganit Ed.D ., Cresencia C. Laguerta M.S.