Formulation of research questions

Formulation of research questions by Dr. Badr Aljaser as part of the 5th Research Summer School at KAIMRC

1. Formulation of Research Question BADR A ALJASIR MD, ABCM, MCERM, MSc, FRSPH Assistant Professor, Consultant Community Medicine & Epidemiology Director Community & Preventive Medicine – PHC – NGHA – WR

2. Formulating an Answerable Research Question From an Idea Research Summer School 2

3. Research Summer School 3 Purposes of research Exploration Description Explanation

4. Research Summer School 4 Exploration To develop an initial, rough understanding of a phenomenon Methods: literature reviews Interviews case studies key informants

5. Research Summer School 5 Description Precise measurement and reporting of the characteristics of the population or phenomenon What is the case? What is the nature of the relationship? Methods: census, surveys, qualitative studies

6. Research Summer School 6 Explanation Why is there a relation ? Justifiable relation

7. Research Idea Research idea provides the very basic foundation of research work Without research idea there cannot be a research A ‘ problem’ situation is not a ‘wrong’ situation but we are simply problematizing the situation Our intention is to enhance our knowledge about the situation Research Summer School 7

8. Problem or Opportunity Formulation The crucial first stage in the research process—determining the problem to be solved or the opportunity to be studied and the objectives of the research The Process of Problem or Opportunity Formulation Research Summer School 8

9. Research Problem Research problem is understanding and explaining the problem – what I am going to study, why and how? Research problem sets the frame of reference for the study Defining a research problem is clarifying oneself what is the problem and what the research is intended to do or what are the expected output Research Summer School 9

10. Setting Up Research Problem Looking for rational Arriving to this problem (interest, gap, need, educational/medical and policy change) Collecting preliminary information Reviewing the literature Discussing with the stakeholders, other researchers Research Summer School 10

11. Statement of the Problem We often need to write a section in our research proposal / thesis This section can be limited just in one sentence or can be few paragraphs long extending to more than a page Whatever its length be, it should define and delimit the problem It should also justify the problem Research Summer School 11

12. Recognizing & Choosing among Research Opportunities What situations or problems tend to fascinate, challenge, or interest you? List as many ideas as you can as quickly as possible Identify which are: Most interesting (I) Feasible (F) Fundable ($) Best overall (*) Write/Rewrite your best idea or research question? Research Summer School 12

13. Attributes of a good research topic (1) C apability: Is it feasible ? Are you fascinated by the topic ? Do you have the necessary research skills ? Can you complete the project in the time available ? Will the research still be current when you finish ? Do you have sufficient financial and other resources ? Will you be able to gain access to data? Research Summer School 13

14. Attributes of a good research topic (2) Appropriateness: is it worthwhile? Will the examining institute's standards be met? Does the topic contain issues with clear links to theory? Are the research questions and objectives clearly stated? Will the proposed research provide fresh insights into the topic? Are the findings likely to be symmetrical? Does the research topic match your career goals? Research Summer School 14

15. Attributes of a good research topic (3) And - (if relevant ) Does the topic relate clearly to an idea you were given - possibly by your organisation ? Research Summer School 15

16. What is Formulation? Formulation means translating and transforming the selected research problem into a scientifically answerable research question. This is the aim of the study. Research Summer School 16

17. 17 Research Question Gives specific focus to our study while staying within the research context as set by our research problem Begins with a general concern that should be narrowed down to a concrete researchable issue Defines exactly what we are going to do, how, and why Research Summer School 17

18. Research Question Helps to clarify what to expect as the findings of the research Is the process of operationalizing our research One critical concern: are we asking the question we want to study? Or, is our research question compatible with our research purpose Research Summer School 18

19. Generating research ideas Useful Techniques Rational thinking Creative thinking Searching the literature Scanning the media Brainstorming Relevance Trees Exploring past projects Discussion Keeping an ideas notebook Research Summer School 19

20. Research Question Based on literature/idea Includes sample description (e.g., Adult Saudi Hypertensive) Includes study design (e.g., relationship, difference between groups, etc.) Includes the independent & dependent variables Is measurable Research Summer School 20

21. Cycles of Research Question Development Research Summer School 21

22. Asking the Right Question Research Summer School 22

23. Why? "Ask a poor question and you will get a poor research. A clear question also helps the investigator rapidly assess whether the study is relevant to his or her own…practice". ( Counsell , 1997) Research Summer School 23

24. Benefits of Getting the Questions Right at the Start Improves clarity of the problem Facilitates subsequent steps of the research process Helps select appropriate literature for review Anticipates issues, resource needs Improves efficiency, minimizes wasted efforts Research Summer School 24

25. No hole in the literature The Research Process Define Research Question Conduct Literature Review Refine Question Hole in literature Design Study Obtain IRB Approval (medical research) Collect & Analyze Data Operationalize variables Write and Report Results Research Summer School 25

26. Research that Makes a Difference Investigates important questions Is ethical ? Connected to theory Connects the study to prior research Uses appropriate research design and analysis procedures Disseminates results Research Summer School 26

27. Question Formulating Process Problem or Issue Define population Define intervention Write Question Search terms Comparator Outcome measure P I C O Research Summer School 27

28. PICO PRINCIPLE A useful model to help structure an answerable question. Used to formulate research question. Breaks down the question into four key elements. Research Summer School 28

29. PICO P opulation, P atient, P roblem P I ntervention or Indicator I C omparator or Control C O utcome O Research Summer School 29

30. PEO P opulation, P atient, P roblem P E xposure E O utcome O Research Summer School 30

31. Example Research Question Do first-year medical students who complete a student-run anatomy review course score higher on the anatomy final exam than students who do not complete the review course? What is the population ? first-year medical students P What is the intervention ? Completing the review I What is the control ? students who don’t complete C What is the outcome ? Final exam score O Research Summer School 31

32. Population or Patient Who are you interested in? How would you describe the patients or population of interest? Be specific Research Summer School 32

33. Population or Patient Example Asthmatics Adults with mild to moderate asthma (treated with β2-agonists alone or with inhaled corticosteroids <1mg daily) Research Summer School 33

34. Intervention or Indicator Cause Risk factor Prognostic factor Treatment or intervention Be precise Be brief Research Summer School 34

35. Intervention or Indicator Example High saturated fat diet Smoking Regular use of salbutamol Research Summer School 35

36. Comparator or Control What is the alternative to the intervention? May not always be necessary Be precise Be brief Research Summer School 36

37. Comparator or Control Example Low saturated fat diet Not Smoking As Needed use of salbutamol Research Summer School 37

38. Outcome What do I hope to accomplish? What could this exposure really affect? Be precise Be brief Research Summer School 38

39. Outcome Example Death Glycemic control Asthma control Research Summer School 39

40. PICO Question In mild to moderate adult asthmatics (P) , does the regular use of salbutamol (I) compared to as needed use (C) result in worse asthma control (O) ? Research Summer School 40

41. No hole in the literature The Research Process Define Research Question Conduct Literature Review Refine Question Hole in literature Design Study Obtain IRB Approval (medical research) Collect & Analyze Data Operationalize variables Write and Report Results Research Summer School 41

42. Searching for Related Work Details in later workshop (search/appraise lit) Identify possible sources of information Colleagues and librarians Databases, PUBMED, PSYCLIT, Science Citation Index Journals, chapters, books, publications Read critically and summarize Citations referenced Sample size Study design and limitations Overall conclusions Research Summer School 42

43. No hole in the literature The Research Process Define Research Question Conduct Literature Review Refine Question Hole in literature Design Study Obtain IRB Approval (medical research) Collect & Analyze Data Operationalize variables Write and Report Results Research Summer School 43

44. Critique Your Question Clearly stated? Stated as a question? Testable? Defines variables to be studied? Defines sample to be studied? Describes the setting for the study? Research Summer School 44

45. FINER Research Question Feasible: adequate subject #, expertise, affordable, manageable in scope Interesting: to the investigator Novel: -confirm, extend or refute previous findings provide new findings Ethical: fulfill g uidelines for the p rotection of student s Relevant: to scientific knowledge to education policy to future research Research Summer School 45

46. Goldilocks test Clough and Nutbrown use what they call the Goldilocks test to decide if research questions are either too big two small too hot or just right/ Too big need significant funding Too small are likely to be insufficient substance Too hot maybe so because sensitivities that may be aroused as a result of doing the research . This may be because of the timing of the research or the many other reasons that may be upset key people who have a role to play. Just right are those just right for investigation at this time by this research in this setting Research Summer School 46

47. Hypothesis – Meaning and Importance Is a formal statement of the relationship between variables to be investigated Must contain two or more measurable variables and must specify how the variables are related Sets the framework for developing interpretations and drawing conclusions Is a prediction regarding the possible outcomes of the study. Research Summer School 47

48. Hypothesis Development The hypothesis is the narrowest expression of the research question. Summarizes the elements of the study through the design, sample, predictor and outcome variables. The purpose of the hypothesis is to establish a basis for statistical tests ( What test will be used). Research Summer School 48

49. Characteristics of a Good Hypothesis Simple vs. Complex Simple: contains one predictor and one outcome Complex: -More than one predictor or outcome. (Not easily tested .. Can break it into simple hypothesis). Specific vs. Vague Specific: Leaves no confusion about what the question is. Clear about what is being collected. Stated in Advance vs. After-the-Fact In Advance: provides a primary objective and a basis for interpreting study results. Research Summer School 49

50. Null and Alternative Hypothesis Alternative Non-directional: The difference is unknown Directional: Existing studies/data suggest direction of relationship, expressed as H A Null Actually, hypotheses are statistically tested in their null form Expressed as no relationship/association exists between variables, expressed as H Research Summer School 50

51. Example We believe that female educators have more positive leadership characteristics Our hypothesis (research or alternate, H A ): women educators have positive leadership characteristics Null hypothesis (H0): there is no association between gender of the medical educator and leadership characteristics Research Summer School 51

52. A Good Hypothesis A good hypothesis should be in a declarative sentence form specifying the relationship between variables; conditional statement cannot be a hypothesis It must be measurable and empirically testable, concise and with specific meaning (clarity is obtained by means of definitions) It should be linked with some theoretical / conceptual / analytical framework / tools Research Summer School 52

53. Isolate and Identify the Problem, Not the Symptoms Certain occurrences that appear to be the problem may only be symptoms of a deeper problem Good researchers must be creative in developing problem or opportunity formulations by investigating situations in new ways Operationalize variables Research Summer School 53

54. Determine the Unit of Analysis The researcher must specify whether the investigation will collect data about individuals, households, organizations, departments, geographical areas, or objects The Process of Problem or Opportunity Formulation Research Summer School 54

55. A written statement of the research design that includes a statement explaining the purpose of the study and a detailed, systematic outline of procedures associated with a particular research methodology The research proposal must communicate exactly what information will be obtained, where it will be obtained, and how it will be obtained The Research Proposal Research Summer School 55

56. Turning ideas into research projects Include SMART Personal objectives S pecific : What precisely do you hope to achieve from undertaking the research? M easurable: What measures will you use to determine whether you have achieved your objectives?(Secured a career-level first job in software design) A chievable: Are the targets you have set for yourself achievable given all the possible constraints? R ealistic: Given all other demands upon your time, will you have the time and energy to complete the research on time? T imely : Will you have time to accomplish all your objectives? Research Summer School 56

57. Conclusion Formulate PICO question Write a FINER (feasible, interesting, novel, ethical, relevant) educational research question Translate your question into a working hypothesis Research Summer School 57

58. Have a Great Afternoon Research Summer School 58

59. Workshop Please think of your research question in relation to the morning class

60. Examples of good research problems (in the form of questions) Does client-centered therapy produce more satisfaction in clients than traditional therapy? Does behavior modification reduce aggression in autistic children? Are the descriptions of people in social studies discussions biased? What goes on in an elementary school classroom during an average week? Do teachers behave differently toward students of different genders? (causal-comparative design ) How do parents feel about the school counseling program? How can a principal improve faculty morale? Research Summer School 60

61. Your research problem What is your area of interest? Where could you look for help in deciding upon a specific research problem? What criteria will you apply when deciding upon a specific research problem? How could you narrow down your research problem? How might your value-judgments (preconceived ideas) affect your research endeavors? Research Summer School 61

62. A good research question will… Be clearly linked to overall project goal Allow the target population to be identified Guide the appropriate level of aggregation (e.g. class, course, curriculum, institution) Identify the outcome variables and key predictors of those variables Determine what type of study is needed (e.g. descriptive, relational, experimental) Identify background characteristics that might influence outcomes Raise questions about how to best collect data Influence the number of participants in the study Research Summer School 62

63. Good Luck with your research Questions !! Research Summer School 63

64. Thank you Research Summer School 64