The preceding chapters have covered many areas of existing research spanning various levels from the systemic level to individuals, teams, and organizations. The current chapter pivots from examining extant evidence to identifying the evidence that is missing. Thus, this chapter sets forth a research agenda, as directed by the committee’s Statement of Task, which states that the committee’s final consensus report will “define a research agenda to address gaps in knowledge in the evidence base to advance antiracism, diversity, equity, and inclusion.”
The committee developed this research agenda over the course of the study process. For each of the report’s chapters, the committee reviewed relevant areas of empirical research across multiple disciplines. Even though there is existing and ongoing research in this field, the committee identified numerous critical gaps. We found there is great need for more evidence-based research to better understand what produces sustainable antiracism, diversity, equity, and inclusion change in science, technology, engineering, mathematics, and medicine (STEMM). In addition to filling the gaps, the committee envisioned an agenda that could help facilitate a future line of transformational and groundbreaking work. Taken together, the committee sought to develop an aspirational research agenda that pushes the field forward in ways it identified as innovative, necessary, and challenging.
The research agenda includes priority areas for further examination. The order in which they are presented in this chapter corresponds to the organizational framework in Figure 9-1. The research agenda is organized first by the multiple levels that were discussed in previous chapters of the report, beginning with items that address the historical and contemporary
societal structures of the United States. Subsequently, the research agenda covers items that address the organization level; questions around teams; and finally, the interpersonal and individual levels. There are several instances in which research agenda items may be located within a specific level, but actually span multiple levels due to the complexity of how these levels are overlapping. Therefore, the overall organizational structure of the research agenda by level is meant to help guide the reader; it is not meant to enforce strict ideological boundaries between the levels. The second half of the research agenda addresses the research process. The committee found that knowledge gaps persist for two primary reasons. First, the gaps exist because there is a need to expand on what is being studied. Second, the gaps exist because methodological research practices that are implemented inform how the research is conducted. Taken together, the types of research questions asked and the ways in which science is conducted can inform, create, and sustain the evidence gaps in the scientific literature. The committee believed that to address the knowledge gaps and develop an innovative agenda, each part of the research process starting
from study development through publication needed to be taken into consideration. The items discussed in the research process are meant to apply to all levels of analysis from historical structures to the individual level. By addressing these factors, the body of empirical science would continue to become a more authentic representation of the human experience and help to meaningfully advance antiracism, diversity, equity, and inclusion in STEMM.
Overall, this chapter has implications for many STEMM stakeholders who take part in research, including but not limited to students, trainees, faculty, staff, statistical analysts, ethicists, scientists, administrators, and leaders. The committee believes that many stakeholders in STEMM may consider prioritizing the entire agenda as these numerous and multi-level gaps can be addressed simultaneously.
Based on its examination of the historical context, the committee found that there needs to be a more complete and comprehensive national and international investigation of reparations from national governments to groups of people who have been harmed by historic policies and practices (Darity and Mullen, 2020; U.S. Congress, 2021). Part of the investigations could include how a system could be implemented, and ultimately test what kind of impact reparations may have on minoritized individuals and their ability to enter into and thrive in STEMM, as well as the impact on the White majority group. There needs to be greater examinations of the following (Darity and Mullen, 2020; U.S. Congress, 2021):
There needs to be a greater examination of the impact of structural financial investments in communities of minoritized individuals in the United States. As these sectors underlie entry into STEMM, it is important to examine whether financial investments in areas in which minoritized individuals have faced systemic disinvestment and disadvantage would ultimately help improve wether presentation and their ability to thrive in STEMM for generations to come. There needs to be greater examinations of the following:
Similar to the previous point, there needs to be a greater examination of the impact of novel, emerging, existing, and historical policies that are
developed with the purpose of helping reduce racial hierarchy and remove structural barriers for minoritized individuals (e.g., Bailey et al., 2021). As these sectors listed below underlie entry into STEMM, it is important to examine whether policies that aim to help reduce inequality would ultimately help improve representation and ability to thrive in STEMM for generations to come. There needs to be greater examination of the following:
As stated previously in the report, Title VII of the Civil Rights Act of 1964 was a milestone in helping promote antiracism, diversity, equity, and inclusion in STEMM organizations. It made discrimination on the basis of race, along with other protected “classes,” unlawful. The committee encountered literature suggesting there may remain an exemption for small businesses, such that specific subsets (U.S. Equal Employment Opportunity Commission, n.d.) of small businesses may be exempt from following Title VII, and this may include small businesses in STEMM (Carlson, 2006; Chay, 1998; Lewallen, 2014; Roberson, 2019). There needs to be a greater empirical examination of the following:
There needs to be a greater examination of how federal agencies, such as but not limited to the National Science Foundation and National Institutes of Health, could use their convening and grant-making powers to support fundamental change in STEMM organizations that use and depend
on their resources. There needs to be a greater empirical examination of the following:
As discussed in Chapter 2, the committee found that while minority serving institutions (MSIs) have faced significant underfunding, they have advanced representation by helping minoritized students obtain STEMM degrees. Since MSIs are a critical asset, there needs to be a continued and more robust empirical investigation that helps better understand the ways in which the strengths of MSIs can be advanced and leveraged. There needs to be a greater empirical examination of the following:
There needs to be a greater assessment of persistence of students in the STEMM degrees, across all STEMM disciplines. This includes a strong focus on minoritized individuals. To accomplish this, it will be essential to know the demographics of the students entering college intending to study STEMM and their educational outcomes. There needs to be a greater empirical examination of the following questions:
Minoritized individuals with STEMM training who have left STEMM at various points may represent an unused and yet valuable workforce (Rahman et al., 2020). However, there is not much research focused on how to reintegrate these individuals back into the STEMM workforce. There needs to be a greater examination of these minoritized individuals who have left with the goal of facilitating their reentry and retaining the pool of lost talent. There needs to be a greater empirical examination of the following:
Additional organizational psychology research is needed to examine the organizational systems, dynamics, and incentives that inform advancements in antiracism, diversity, equity, and inclusion across several STEMM contexts, including STEMM departments within universities and various business units within industry settings. There also needs to be greater investigation on the role of community accountability in helping advance and sustain antiracism, diversity, equity, and inclusion.
The committee encountered some scholarship that has supported the greater or more systematic use of positionality statements in research-based spaces (e.g., Roberts et al., 2020). Positionality is defined broadly as a reflexive practice, during which an individual conducts an internal self-examination to critically consider how their unique “position” informs the way they conduct science, research, and other STEMM activities. This may include a complete examination of an individual’s own identities (e.g., demographic identities), political leaning, worldviews, experiences, and relations to systemic privilege as well as their relations to marginalization (Secules et al., 2021).
Scholars have noted that during the practice of determining an individual’s positionality, the person is considering their unique social location and their unique perspective, as it informs the entire process of science, from developing research questions, to selecting and interacting with participants, to interpreting and analyzing the results (Hampton et al., 2021). While emerging as a potential tool of helping fostering antiracism, diversity, equity, and inclusion, it remains an empirical question whether these
statements have a measurable impact in improving antiracism, diversity, equity, and inclusion in STEMM. There needs to be a greater empirical examination of the following:
There needs to be a continued investigation focused on identifying which organization-level interventions, including policies, practices, procedures, opportunity structures, trainings, and interventions, work in producing measurable and sustainable change in advancing antiracism, diversity, equity, and inclusion in STEMM organizations. There needs to be a greater empirical examination of the following:
There needs to be a more comprehensive examination of the organization-level White-centered “professionalism” standards that impact minoritized individuals. For instance, as discussed in Chapter 5, research has demonstrated that many minoritized individuals codeswitch in predominantly White contexts. However, further investigation into STEMM contexts is needed. There needs to be a greater empirical examination of the following:
More robust investigations are needed to focus on identifying which team-based interventions—including policies, practices, procedures, opportunity structures, trainings, and interventions—are most effective in producing measurable and sustainable change that advances antiracism, diversity, equity, and inclusion in STEMM teams. Specifically, there needs to be a
greater examination of the contact hypothesis in STEMM organizations. Namely, researchers should continue to identify the team-based factors that help facilitate bias reduction and increase experiences of inclusion within STEMM teams.
Additional research is needed from the perspective of minoritized individuals. Furthermore, there needs to be an examination of what it means to build a critical mass of minoritized individuals on STEMM teams, and the impact that has on team performance and minoritized individuals.
Chapters 5 and 6 articulated how racism is experienced or perpetuated at an individual level. However, there are likely conditions under which a given individual may experience racism and also perpetuate it. There needs to be a greater examination of this phenomenon.
The phenomenon of racism denial, while not a central focus of the report, needs a more robust examination as this may inform how interventions and strategies toward promoting antiracism, diversity, equity, and inclusion in STEMM are formed. There needs to be a greater empirical examination of the following:
In addition, there needs to be a continued, more robust, and more in-depth understanding of minoritized individuals’ sense of belonging and inclusion, beyond what is already known.
The committee determined that a continued examination of the factors, conditions, and mechanisms that predict a greater sense of belonging and inclusion across multiple STEMM contexts. Furthermore, there needs to
be a more robust body of qualitative and mixed-methods research capturing the lived experiences of minoritized individuals. This research should prioritize individuals that are not only minoritized in STEMM, but also minoritized in the empirical literature. These more in-depth data collection efforts may help provide a better understanding of the unique sets of barriers, opportunities, and points of interventions for specific individuals who remain at the furthest margins in STEMM.
Finally, there needs to be a more robust body of research examining both White identity and the emotions of White individuals. There needs to be a greater empirical examination of the following:
The committee notes that additional research is needed to examine the potential impact of other high-status individuals beyond senior mentors, including sponsors and champions, in helping promote greater representation and inclusion of minoritized individuals in STEMM contexts. This includes research that examines which specific features of a physical environment are most inclusive for minoritized individuals. Furthermore, additional research is needed to identify the specific components of summer bridge programs that may be significant factors in producing specific positive outcomes for minoritized individuals.
The committee found that additional research is needed to examine the psychological impacts of perpetuating racism from the perspective of the gatekeeper in STEMM. In addition, additional research is needed to identify ways to reduce the negative impacts of racialized trauma.
The body of research on Indigenous individuals’ experiences in STEMM education spaces and the workforce is scarce. A much more robust program of research is needed.1 Specific points of empirical investigation based on the committee’s review of the literature are included below:
___________________
1 This section draws on an expert review commissioned by the committee (Smith, 2022).
A much more robust and nuanced body of research focused on Asian Americans in STEMM contexts is needed.2 Asian Americans are not a monolithic group, and persons who identify as Asian American may claim many different geographical, ethnic, and immigrant roots. There needs to be a greater empirical examination of the following:
In addition, a much more robust and nuanced body of literature focusing on Latine individuals in STEMM contexts is needed.3 Latine is not a monolithic identity, but rather a group that comprises persons who identify as Latine claiming many different geographical, racial, and immigrant roots. There needs to be a greater empirical examination of the following:
___________________
2 This section draws on an expert review commissioned by the committee (Cobian et al., 2022).
3 This section draws on an expert review commissioned by the committee (Trujillo, 2022).
A much more robust and nuanced body of literature focused on Black individuals in STEMM is needed. There needs to be a greater empirical examination of the following:
As discussed previously, the second half of the research agenda addresses the research process. The items discussed in the research process are meant to apply to all levels of analysis ranging from historical structures to the individual level.
Federal agencies have supported many programs aimed at increasing diversity in STEMM. What is needed is a retrospective evaluation of the effectiveness of these programs—under what conditions were goals
achieved or not achieved? What is the effectiveness tradeoff between term (e.g., number of years) of support and sustainable effect? Similar reports or research publications at the same magnitude of the current report are needed for each minoritized group (Latine, Indigenous, and Asian American groups) in STEMM.
Much of the research examining minoritized individuals in STEMM (see Chapter 5) focuses heavily on those in the early training/career stages. Additional research examining the experiences and the consequences of racism among minoritized individuals in middle-stage and late-stages of their careers is needed.
Learners from minoritized populations may be likely to exit and reenter academic degree programs and start careers later in life. More robust data collection methods are needed to track minoritized individuals’ career pathways across institutions and life circumstances.
Many gaps in the antiracism, diversity, equity, and inclusion STEMM literature persist, in part, because of the ways in which certain theoretical frameworks are used. The incorporation of more of the suggested frameworks below will help permit certain research questions to be asked and necessary data to be collected.
Many existing studies on minoritized individuals use a deficit-based framework to understand existing challenges (see Chapter 5). While deficits and challenges are important to understand, there are also many assets that exist in these populations that are ignored and underutilized as a resource. There needs to be a greater shift from an overreliance on the deficit framework to an asset-based framework in the production of new research. There also needs to be a shift away from the framework of the hero’s journey (of individual resilience) to a framework that focuses more on relevant structures and conditions that promote antiracist systems.
In addition, there needs to be greater use and inclusion of an intersectional framework (Crenshaw, 1989, 2012).
Finally, the “leaky pipeline” metaphor is both false and harmful, and this framework should be abandoned (e.g., Cannady et al., 2014). Persons have agency and are not a commodity. Furthermore, the system through which the persons travel is not inert; rather, leaders have the responsibility for actively creating an inclusive environment. The “leaky pipeline” framework frequently describes the points where minoritized individuals exit STEMM. While it is critical to understand the factors that contribute to attrition and the points in which they occur, this framework limits empirical investigation. Like a leaking pipe, it is presumed that these individuals are lost forever, and there are no possibilities of reentry into the pipeline.
There needs to be a greater consideration of how antiracism, diversity, equity, and inclusion STEMM researchers can shift their structures and paradigms of science and science education to be inclusive of Indigenous ways of knowing.4 This will help increase inclusive participation, advancement, and creation and education of science across STEMM sectors.
Researchers need to examine how they can actively amplify alternative perspectives such as critical methodologies and standpoint epistemologies that actively center on challenging systems of oppressions in STEMM. Furthermore, antiracism is an emerging construct, and additional methodological research is needed to understand how to empirically measure this construct.
___________________
4 This section draws on an expert review commissioned by the committee (Smith, 2022).
Researchers who want to conduct racial and ethnic antiracism, diversity, equity, and inclusion-related STEMM research should center race and ethnicity as a primary lens of their research plan.
In addition, there needs to be a greater incorporation of factors that may vary by race and ethnicity. These are essential in understanding minoritized individuals’ experiences, barriers, and opportunities in STEMM contexts. Researchers should consider including measures that assess the following factors:
Data in STEMM contexts should be disaggregated by the following factors, when possible, to better understand the phenomenon of antiracism, diversity, equity, and inclusion in STEMM:
Additional research is needed that moves beyond using White participants as the only or primary comparator group. Many gaps would be filled if researchers in the areas of antiracism, diversity, equity, and inclusion and STEMM would include a robust description of the demographic data in sections of scientific papers (Roberts et al., 2020). Cross-sectional and longitudinal studies should continue to be conducted at each level of analysis (historical to individual).
To accurately fill the gaps in the evidence base, there needs to be a critical consideration of research ethics and how they factor into the production of knowledge. Researchers also need to critically consider how missing data for race and ethnicity are handled. The implications, risks, and benefits, of conclusions drawn from imputed race and ethnicity data should be considered carefully (Randall et al., 2021).
When collaborating and working with minoritized communities (Randall et al., 2021), there needs to be ongoing communication about the data collection, ownership of data, and transparency of the outcomes. Efforts to prevent harm to minoritized communities should be built into the ethical practices of the research studies.
In addition, researchers need to critically consider and minimize the potential risk of identifying single minoritized individuals (Randall et al., 2021), including when studying non-numerically diverse STEMM spaces. For example, there may only be one Black woman in a given department of interest. In these cases, methods may be employed to examine more aggregate patterns and protect individuals.
Study leaders who are examining antiracism, diversity, equity, and inclusion across a variety of STEMM contexts need to develop diverse research teams when studying these issues, as research team representation informs the knowledge gaps that are being filled.
Gaps in the body of literature can only be filled if spaces are actively constructed that allow these very gaps to be filled. These spaces exist in publication and distribution structures (see also Roberts et al., 2020).
The scientific evidence and lived experiences presented in this report offer critical insights and form a strong foundation for the committee’s research agenda. Stakeholders who conduct and fund STEMM research can use this research agenda to fill critical gaps in the empirical evidence base and improve how research is conducted. Attention to each of the priority areas identified by the committee will contribute to a more robust evidence base that is needed to advance antiracism, diversity, equity, and inclusion.
Bailey, Z.D., Feldman, J.M., and Bassett, M.T. (2021). How structural racism works—racist policies as a root cause of US racial health inequities. New England Journal of Medicine, 384(8), 768–773.
Beeler, W.H., Mangurian, C., and Jagsi, R. (2019). Unplugging the pipeline—a call for term limits in academic medicine. The New England journal of medicine, 381(16), 1508–1511.
Cannady, M.A., Greenwald, E., and Harris, K.N. (2014). Problematizing the STEM pipeline metaphor: Is the STEM pipeline metaphor serving our students and the STEM workforce?. Science Education, 98(3), 443–460.
Carlson, R. (2006). The small firm exemption and the single employer doctrine in employment discrimination law. St. John’s Law Review, 80, 1197.
Chay, K.Y. (1998). The impact of federal civil rights policy on black economic progress: Evidence from the equal employment opportunity act of 1972. ILR Review, 51(4), 608–632.
Coates, T. (2014). The case for reparations. https://www.theatlantic.com/magazine/archive/2014/06/the-case-for-reparations/361631/
Cobian, K., Fang, J., and Poon, O. (2022). A Call for a Critical Intersectional Lens for DEI and Anti-Racist Strategies to Include Asian Americans. Unpublished paper commissioned by the Committee on Advancing Antiracism, Diversity, Equity, and Inclusion in STEMM Organizations, National Academies of Sciences, Engineering, and Medicine.
Crenshaw, K.W. (2012). From private violence to mass incarceration: Thinking intersectionally about women, race, and social control. UCLA Law Review, 59, 1418.
________. (1989). Demarginalizing the intersection of race and sex: A Black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics. University of Chicago Legal Forum, 139–167.
Darity Jr, W.A., and Mullen, A.K. (2020). From here to equality: Reparations for Black Americans in the twenty-first century. UNC Press Books.
Hampton, C., Reeping, D., and Ozkan, D.S. (2021). Positionality statements in engineering education research: A look at the hand that guides the methodological tools. Studies in Engineering Education, 1(2).
Kim, V., Alcantar, C.M., and Teranishi, R.T. (2022). The AANAPISI-funded STEM Program: An institutional response to the needs of Asian American community college students. Community College Journal of Research and Practice, 1–15.
Lewallen, D. (2014). Follow the leader: Why all states should remove minimum employee thresholds in antidiscrimination statutes. Indiana Law Review, 47, 817.
McGee, E.O. (2020). Interrogating structural racism in STEM higher education. Educational Researcher, 49(9), 633–644.
Powell, C. (2018). Bias, employment discrimination, and Black women’s hair: Another way forward. BYU Law Review, 933. https://digitalcommons.law.byu.edu/lawreview/vol2018/iss4/7
Rahman, F., Billionniere, E., Brown, Q., and Gates, A.Q. (2020). RESET (Re-Enter STEM through Emerging Technology) finding re-entry pathways for women. Proceedings of the 51st ACM Technical Symposium on Computer Science Education, 173–174.
Randall, M., Stern, A., and Su, Y. (2021). Five ethical risks to consider before filling missing race and ethnicity data. Urban Institute.
Roberson, A.B. (2019). The migrant farmworkers’ case for eliminating small-firm exemptions in antidiscrimination law. Texas Law Review, 98, 185.
Roberts, S.O., Bareket-Shavit, C., Dollins, F.A., Goldie, P.D., and Mortenson, E. (2020). Racial inequality in psychological research: Trends of the past and recommendations for the future. Perspectives on Psychological Science, 15(6), 1295–1309.
Secules, S., McCall, C., Mejia, J.A., Beebe, C., Masters, A.S.L., Sánchez-Peña, M., and Svyantek, M. (2021). Positionality practices and dimensions of impact on equity research: A collaborative inquiry and call to the community. Journal of Engineering Education, 110(1), 19–43.
Smith, T.D. (2022). Natives in STEM Literature Review. Unpublished paper commissioned by the Committee on Advancing Antiracism, Diversity, Equity, and Inclusion in STEMM Organizations, National Academies of Sciences, Engineering, and Medicine.
Trujillo, G. (2022). Hispanic/Latinx Anti-racism, Diversity, Equity, and Inclusion in STEM: A Commissioned Paper. Unpublished paper commissioned by the Committee on Advancing Antiracism, Diversity, Equity, and Inclusion in STEMM Organizations, National Academies of Sciences, Engineering, and Medicine.
U.S. Congress (2021). H.R.40 - Commission to Study and Develop Reparation Proposals for African Americans Act. https://www.congress.gov/bill/117th-congress/housebill/40
U.S. Equal Employment Opportunity Commission. (n.d.) Get the facts series: Small business information. https://www.eeoc.gov/publications/get-facts-series-small-business-information