Evaluation Research Design educational new

evaluation

1. EVALUATION RESEARCH DESIGNS Lecturer : Dr. Imron Rosidy, M. Th., M.Ed Presented By Habil Syahril Haj (230101210021) Muhammad Fery (230101210043)

2. Contents Overview Definition of E valuation R esearch Designs Basic Concepts of Evaluation Research Designs Types of Evaluation Research Design Characteristics of Evaluation Research Designs Methods of Evaluation Research Designs

3. Definition of evaluation research d esigns Evaluation research design is a scientific method used to determine the effectiveness of a program, policy, project, and specific activities that have been implemented, are ongoing, and future programs. Prof. Dr. Sugiyono, Evaluation Research Methods ( Bandung:Alfabeta , 2018), 3.

4. B asic concepts of evaluation research designs Data Collection Activities Comparing Implementation with Plan Comparing Results with Program objectives Plan implementation level information Program achievement level information Follow-up program & method improvements Prof. Dr. Sugiyono, Evaluation Research Methods ( Bandung:Alfabeta , 2018), 5.

5. T ype s of evaluation research designs Summative Evaluation Formative Evaluation Prof. Dr. Sugiyono, Evaluation Research Methods ( Bandung:Alfabeta , 2018), 10.

6. Summative Evaluation Outcome Evaluation Impact Evaluation Cost - evectivennes and cost benefit analysis Secondary analysis Meta- analysis Prof. Dr. Sugiyono, Evaluation Research Methods ( Bandung:Alfabeta , 2018), 11.

7. Formative Evaluation Needs assesment Evaluability asessment Structured conceptualization Implementation evaluation Process evaluation Prof. Dr. Sugiyono, Evaluation Research Methods ( Bandung:Alfabeta , 2018), 10.

8. The difference between summative and formative evaluation Aspects Formative Evaluation Summative Evaluation Uses Improving Programs Making program decisions in the future Audience Program Manager and staff Policymakers and consumers Main characteristics Obtain feedback for program implementers Make a decision whether the program is continued or not Design What information do you need? What standards are used to make decisions Purpose of data collection Finding flaws Judgmental Data collection frequency Often Infrequently Sample Size Small Big Prof. Dr. Sugiyono, Evaluation Research Methods ( Bandung:Alfabeta , 2018), 10.

9. Characteristics of Evaluation Research Designs Knowing the achievement of the vision, mission and goals Focusing on evaluators and stakeholders Evaluation results for decision making Instruments are arranged based on program objectives Publication limited to stakeholders

10. Methods Of Evaluation Research Designs Quantitative Methods Qualitative Methods John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And Qualitative Research (Boston: Pearson Education,2012), 283

11. John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And Qualitative Research (Boston: Pearson Education,2012), 283 emphasis on the quality of the hypotheses and variables the control of extraneous variables, and the importance of the discussion and its implications for research and practice. Quantitative Standards

12. Lincoln’s (1995) Philosophical Criteria: Creswell’s (2007) Procedural Criteria : Richardson’s (2000) Participatory and Advocacy Criteria John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And Qualitative Research (Boston: Pearson Education,2012), 285 Qua li tative Standards • Standards set in the inquiry community such as guidelines for publication. • Positionality: The “text” should display honesty or authenticity about its own stance and about the position of the author . • It employs a tradition of inquiry, such as case study, ethnography, grounded theory, or narrative inquiry as a procedural guide for the study . • It starts with a single focus on a central phenomenon rather than a comparison or relationship (as in quantitative research). • Substantive contribution: Does this piece contribute to our understanding of social life? • Aesthetic merit: Does this piece succeed aesthetically? Does the use of practices open up the text and invite interpretive responses? Is the text artistically shaped, satis

13. Checklist for Evaluating the Process of a Quantitative Study Title for the Study. Problem Statement. Review of the Literature. Purpose, Hypotheses, and Research Questions . Data Collection Data Analysis and Results. Writing John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And Qualitative Research (Boston: Pearson Education,2012), 286

14. Checklist for Evaluating the Process of a Qualitative Study Title for the Study. Problem Statement. Review of the Literature. Purpose and Research Questions Data Collection . Data Analysis and Findings Writing John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And Qualitative Research (Boston: Pearson Education,2012), 287

15. Conclusion Evaluation research is a method of in-depth analysis of an activity, program, or policy with the aim of measuring its effectiveness, efficiency, relevance, and impact. Through evaluation research, researchers can infer the extent to which a program has achieved its objectives, identify factors that influence its results, and provide recommendations for future improvement or development