Qualitative Analysis: Process and Examples monographmatters.srcd.org
Videos, commentaries, teaching materials and more are available at monographmatters.srcd.org Wray-Lake, L. & Abrams, L. S. (2020). Pathways to civic engagement among urban youth of color. Monographs of the Society for Research in Child Development, 85 (2). doi.org/10.1111/mono.12415
Laura Wray-Lake, Ph.D. Associate Professor Department of Social Welfare University of California, Los Angeles Laura S. Abrams, Ph.D. Professor and Chair Department of Social Welfare University of California, Los Angeles monographmatters.srcd.org/
Introduction Qualitative analysis is perhaps the most difficult and integral part of a qualitative study. On the whole, qualitative analysis has fewer set customs to follow than quantitative analysis, as it: does not rest upon probabilistic interpretations; does not necessarily seek “generalizability”; and is often an ongoing process that informs the course of data collection during a study. Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Strategies to Approach Analysis A qualitative analysis strategy should be planned ahead of time in relation to the overall goal of the study, which might include: Thick description, such as in ethnography Theory building, such as in grounded theory Comparison among cases can focus on: Variation Unusual cases Typical cases Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Qualitative Data Analysis Steps (Drawing on Miles and Huberman, 1994) Data Collection Data Displays & Summaries Conclusion drawing Data Reduction & Management Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved. Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Managing your data can be a very overwhelming task. The first step is to organize your raw materials (names, dates, transcriptions) so that they make sense to you and your team. You must utilize organizing strategies that work for your personal style of record-keeping, etc. The next slide shows an example of how you might keep track of participants and raw data. Data Reduction and Management
ID PSEUDONYM AGE GENDER ETHNICITY 1101 Bruce 14 Male Black 1103 DeAndre 15 Male Black 1105 Marquis 13 Male Black 1106 Darnell 13 Male Latinx 1110 John 15 Male Black 1113 Andre 17 Male Black … … … … … Tracking Participants Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Step Two : Nearly all qualitative data analysis involves coding. A coding scheme is what you inductively develop by virtue of working with your data, reading transcripts, and making meaning of chunks of text. Coding is a lengthy, very involved process that takes time and patience to “ get it right ” and to be satisfied. Coding can be infinite - you have to realize you can ’ t CODE everything. Coding Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Primary Codes can be used to organize major clusters of codes. Some used in the Youth Voice Project were: Primary Codes Adult support Articulating community problems Broader society Defining community and community connections Defining community engagement Disconnection from community Empowerment Experiences with community engagement Solutions to community problems Police-community relations Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Codes need concrete definitions. Sample definitions from the Cluster labeled “ Articulating Community Problems ” included: Violence: Describing violence as a problem facing the community. Violence in the form of shootings, killings, homicide, fighting, gangs and gang activity. Drugs: Describing community problems of drug dealing, selling, and drug use. Sample Codebook Definitions Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Additional definitions of primary codes: Racism and Prejudice: Describing problem of racism, prejudice, discrimination, being judged based on appearance, color of skin. Being treated differently due to race. Prevalence of Problems: Descriptions of how widespread, long-lasting, or commonplace the problem is. How easy or difficult it is to identify or detect the problem. Sample Codebook Definitions Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Sub-Themes Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Qualitative Data Analysis Steps Data Collection Data Displays & Summaries Conclusion drawing Data Reduction & Management Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Data Displays and Summaries There are several ways to display your coded data. You may use more than one. It depends on what works for you and your style of learning, perception. Data displays can be quantitative or qualitative . The displays should move the analysis one step further toward identifying patterns, concepts, and themes. Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Use of Quantitative Displays Quantitative displays work best when you want a concise, visual summary of codes or a “count” of code frequency. Quantitative displays work better with larger samples and with more structured qualitative interviews or observations. Remember that code frequency is just one way to examine qualitative data. The next slide shows a qualitative display example from Table 3 of the monograph. Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
N % Summary of Subthemes Related to Community Problems Violence 73 83.9 Racism / prejudice 18 20.7 Drugs 15 17.2 Poverty and economic issues 12 13.8 Other problems* 29 33.3 Quantitative Display Example Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Qualitative displays help you see links among concepts and generate explanations for observed patterns . Examples might include: Diagrams, flow charts, process models, and visuals. Memos regarding data patterns, themes, and key inductive findings. Lists of participants’ quotes, organized by core themes or concepts. Qualitative Tools for Data Display Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Qualitative Display Example Qualitative Data Display Example Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Qualitative Display Example Qualitative Data Display Example Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Qualitative Data Analysis Steps Data Collection Data Displays & Summaries Conclusion drawing Data Reduction & Management Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Drawing Conclusions Drawing conclusions is a very difficult stage of the qualitative analysis process. Qualitative analysis requires you to go a step further than simply listing your results or listing codes. This stage is often considered the “art of interpretation”- and it is, indeed, an art. Drawing conclusions takes time, practice, and often consultation with a team of experts. Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Tools for Interpretation Refer back to memos, data displays. Use software to retrieve quotes for each section, balancing quotes against themes. Employ Member Checking , i.e., ask people from the community in which you collected data to check your interpretations. Work with team members who have diverse perspectives to discuss findings and identify themes. Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Example: Summarizing Data Patterns Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Subjectivity & Representation When interpreting findings and data patterns, it is important to ask: Have I double checked my findings? What are my filters and influences on data interpretation? Questions of representation: Am I adequately representing people’s voices and lives? Will my representation benefit the population of interest? Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Additional Questions Are the findings grounded in the data? Are inferences logical? Did I find something unexpected? Are alternative explanations accounted for? What strategies were used to enhance rigor and trustworthiness? Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Sample Interpretation Check Once the four pathways were identified, our team went back to each case to ensure that all participants fit into a distinct pathway. We created a “profile” of each participant and their associated pathway. All but 2 youth fit into one of the four pathways. This triangulation (i.e., this extra step) confirmed our overall interpretations of the data. Created by Laura Wray-Lake & Laura S. Abrams. All rights reserved.
Recommended resources Creswell, J. W., & Poth, C. N. (2016). Qualitative inquiry and research design: Choosing among five approaches . Sage. Christens, B. D. (2012). Toward relational empowerment. American Journal of Community Psychology, 50 (1-2), 114-128. https://doi.org/10.1007/s10464-011-9483-5 Lincoln, Y.S., & Guba, E. G. (1985). Naturalistic inquiry . Sage. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook . Sage. monographmatters.srcd.org
Wray-Lake, L. & Abrams, L.S. (2020). Pathways to civic engagement among urban youth of color. Monographs of the Society for Research in Child Development, 85 (2). doi.org/10.1111/mono.12415 Additional resources related to this monograph may be found at: monographmatters.srcd.org