Chapter 2 highlighted the essential relevance of research to the core mission of the U.S. Environmental Protection Agency (EPA) to protect health and the environment, and it described how the Office of Research and Development (ORD) has provided substantial contributions in meeting the needs for that science for many decades. However, as the major challenges described in Chapter 3 illustrate, today’s needs for science to support EPA’s mission differ considerably from EPA’s traditional needs for research in support of statutory requirements. The growth of highly complex problems elevates the need for new systems thinking that crosses disciplinary boundaries, anticipates the integration of innovative methods and tools into ORD’s scientific enterprise, and involves enhanced collaboration and communication to make the most effective use of limited resources (see Chapter 3). Fortunately, systems thinking is not new to EPA. It was a cornerstone of the agency’s foundation in the 1970 Ash Commission report which noted, “The environment, despite its infinite complexity, must be perceived as a unified, interrelated system” (EPA, 1970), and there is some continued attention to it at ORD (Orme-Zavaleta, 20211).
These changing times call for new, comprehensive approaches by applying a systems-thinking One Envrionment–One Health approach, as well as a reimagined strategic planning and foresight process, as described in Chapter 3. Those actions are not, however, sufficient to ensure that ORD has the capabilities to fully embrace this new framework and to be well positioned for identifying and integrating scientific and technical advances into its research and development enterprise in the coming years. To that end, in this chapter the committee identifies four major actions ORD should take to ensure that it can implement systems thinking for a One Environment–One Health approach in the most effective way:
In addition, based on its collective judgment and experience, the committee discusses desirable characteristics and provides recommendations regarding approaches for implementing those actions.
The federal government has steadfastly maintained a commitment to innovative and longer-term research through institutions, such as the Defense Advanced Research Projects Agency (DARPA), the National Science Foundation (NSF), the U.S. Department of Energy (DOE) national laboratories, and most recently with the establishment of the National Institutes of Health’s Advanced Research Projects Agency for Health (ARPA-H). Continuation of these federal research enterprises has resulted from a clear rationale for their need (e.g., national security, energy independence, and global competitiveness) combined with diverse scientific and political coalitions that have supported their missions and funding over time.
___________________
1 J. Orme-Zavaleta, EPA, presentation to the committee, May 27, 2021.
Several ORD programs are specifically oriented toward promoting innovation in research and science at EPA.2 Outputs resulting from those programs include test methods; identification of risks; pollution control technologies; and approaches, tools, and data for use by partners.3 Table 4-1 lists a few of EPA’s innovation programs involving ORD, along with examples of projects and outputs.
ORD also has demonstrated the pursuit of innovation as a social process of scientific collaboration and coordination by maintaining Memoranda of Understanding (MOUs) with minority organizations (e.g., EPA, 2016). At a broader level, ORD maintains a Sustainable and Healthy Communities national program,4 with the predominant focus on contaminated sites.
Although ORD maintains a number of innovation initiatives, they tend not to be on a sufficient level of scale. ORD’s innovation initiatives are often designed to support specific needs of regulatory decision-makers, rather than being targeted at reconceptualizing the nature of a broader, recalcitrant problem or potential solution to that problem.
Uncertainties in ORD’s annual funding levels have reduced its ability to implement multi-year research plans, which could include collaboration with a broader team of research professionals and stakeholders. The rapid pace of environmental and marketplace change has contributed to ORD’s evolving research challenges and highlights the need for a workforce that is better integrated with other leading scientific organizations and has access to advanced technical tools.
TABLE 4-1 Several EPA Innovation Programs Involving ORD
| Program | Example Projects and Outputs |
|---|---|
| Pathfinder Innovation Projects: an annual, internal competition that provides ORD staff with time and funding to pursue innovative, high-risk, high-reward research ideas. |
|
| Challenge and Prizes Program: Strives to find solutions by tapping into the ingenuity and creativity of crowds. EPA outlines the specifications and criteria for a problem, and the public can submit ideas and proposals for successful solutions. |
|
| Regional Science Program: Supports collaborative research projects with partners, funded through internal EPA competitions, for projects focused on near-term priorities for EPA Regions, states, tribes, and communities. |
|
| Small Business Innovation Research Program: provides funding to small businesses to develop and commercialize innovative technologies that address environmental needs, such as clean and safe water. |
|
SOURCE: E. Trentacoste, EPA/ORD, personal communication, October 3, 2021.
___________________
2 See https://www.epa.gov/innovation/pathfinder-innovation-projects.
3 W. Cascio, EPA, personal communication, October 6, 2021.
4 See https://www.epa.gov/aboutepa/about-sustainable-and-healthy-communities-research-program.
In a broader context, the concept of innovation continues to be reexamined and driven, in large part, by global marketplace competition and major megatrends (e.g., climate change, food supply challenges, demographic changes, and demands for greater social and economic equity) that threaten to disrupt business operations and the stability of civil society and exacerbate environmental problems at current and newer levels of scale.
In previous generations, innovation in the private sector was designed and practiced very differently than contemporary approaches. Formerly, major corporations such as AT&T, Exxon, General Electric, General Motors, and IBM, for example, maintained major laboratories staffed with layers of skilled professionals who devoted many years to developing and commercializing innovative technologies for existing or new products. These and other companies would frequently conduct long-term research and analyze trends. The management philosophy evident one to two generations ago was to maintain core expertise in a range of disciplines to minimize dependency on external researchers and institutions.
Today’s innovation culture in the private sector differs substantially from the one just described. The restructuring and downsizing of major research institutions, reduction of discretionary research budgets, and greater emphasis on delivery of short-term financial results have spurred organizations to reconceive and restructure their approach to innovation.
Contemporary innovation thinking reflects a body of work by scholars and practitioners, such as the late Clayton Christensen, Mariana Mazzucato, and the late C. K. Prahalad, to name a few (Christensen, 1997; Mazzucato, 2013; Prahalad and Krishnan, 2008). A central feature of current concepts is to visualize innovation stemming from a set of both structured and informal relationships that exist within a supportive ecosystem. In this context, “ecosystem” is used as a metaphor to describe organizations with common or complementary features that are interconnected to exchange information and other resources.
Given ORD’s many scientific capabilities and areas of specialized expertise, it has the strong potential to become a highly valued innovation partner for many organizations. Creating and maintaining an effective innovation ecosystem includes these considerations:
Ultimately, “co-creation,” where ideas are shared and developed among multiple partners, is the pathway taken by leading innovative organizations in their quest to develop business, environmental, or social solutions at different levels of scale.
Applying enhanced stakeholder participation in its research planning (as described in Chapter 3), and building new collaborations to leverage the work of a host of existing and new partners, offers new talents and resources that can enable ORD to be a leader in innovation and more effectively support EPA’s transition to the new era of environmental decision-making that is already under way. The transformation of the U.S. economy will accelerate the demand for advanced tools and new kinds of data. If EPA is to successfully respond to the mass adoption of electric vehicles, the decarbonization of major energy supplies, increased use of biomanufacturing or bio-produced products, the expanded reformulation of consumer products, and pollution sources embedded in the restructuring of domestic and global supply chains, ORD cannot rely solely on its own resources, expertise, and voice to strengthen its knowledge and take advantage of emerging scientific and technological areas.
ORD has a history of collaboration across many issues that reach far beyond the regulatory process. Over the past several decades, EPA has managed literally hundreds of individual voluntary initiatives designed to improve environmental quality. These have ranged from toxics reduction (the 33/50 initiative), energy efficiency (Energy Star), multimedia pollution management (Project XL), the Green Suppliers Network (for manufacturers and their suppliers to improve the environmental performance of production processes), and Design for the Environment (to encourage the use of safer chemicals in products), to name a few. In addition, the work of other federal research agencies has periodically informed and reinforced the importance of EPA’s own work in such fields as combustion engineering (DOE), toxicological sciences (National Toxicology Program), risk assessment (U.S. Food and Drug Administration and California EPA), and climate change (NSF and National Oceanic and Atmospheric Administration). Examples of more recent collaborative research topics include nontargeted analysis trials, reducing exposures to wildland fire smoke, innovations in electronic health records; and advancing response and recovery capabilities from wide-area contamination incidents.5
In addition, ORD specifically has maintained a history of research collaborations with the extramural scientific community to generate scientific information relevant to policy development and assessment of risks through the multi-decade Science to Achieve Results (STAR) program. Projects funded through STAR have resulted in innovations in sensor development, partnerships with leading universities to advance the understanding of the health effects of criteria pollutants, and modeling and assessment of microenvironments, such as indoor air quality. As discussed in Chapter 2, because of constrained funding, ORD’s research relationships have been more limited in scope, with a reduced capacity in staff and budget to pursue multi-year research plans.
As the nature of public health and environmental challenges continues to change and become more systemic and global, ORD needs to move beyond its project- and subject-specific notion of collaboration
___________________
5 EPA presentations to the committee, November 17, 2021.
to one that is better adapted to addressing a new generation of complex problems and opportunities. ORD’s effective transformation from its traditional approach to contemporary collaboration efforts would include these characteristics:
ORD has some experience in this transformed era of collaboration through, for example, its ongoing funding and participation in the independent Health Effects Institute. However, there are major challenges that hinder new thinking and more entrepreneurial behavior, including administrative complexity that lengthens the time needed to develop collaborations; shorter-term research obligations for staff that frequently cause priorities and resources to shift and leave little room for high-risk/high-reward research; organizational inertia that results from a preference for maintaining the status quo; and a lack of sufficient cultural knowledge and interpersonal relationships for developing and managing collaborative relationships outside the boundaries of familiar disciplines.7
Despite the challenges mentioned above, there are substantial benefits for ORD, and EPA more generally, to be gained from participating at a broader and deeper scale of collaboration. The benefits include:
___________________
6 See https://www.epa.gov/water-research/cyanobacteria-assessment-network-cyan.
7 R. Thomas, EPA, presentation to the committee, October 6, 2021.
These benefits would, in turn, allow ORD to more effectively provide EPA with scientific information, assessments, and technologies necessary for problem identification and solutions development.
Major leadership commitments play a key role in developing future collaboration opportunities and supporting their successful implementation. Leadership can create the expectation that collaboration represents a core feature of how ORD will provide support to EPA in carrying out its mission. Leadership can also look for ways to streamline the organizational process for collaboration so that participants can more readily overcome many of the current bureaucratic obstacles that deter development of external partnerships.
Additional decisions and planning elements include:
ORD already possesses a number of mechanisms to expand its talent acquisition and scientific collaborations. In addition to its own intramural research programs, ORD’s continued evaluation of the opportunities for extramural grants, cooperative agreements, and interagency agreements to address its major priorities is warranted. Along with direct hires of new staff, other measures to supplement the expertise of core staff include fellowships; visiting scholar programs; new partnerships with universities; part-time employment; retention of skilled retired personnel; exchange programs; and intergovernmental personnel agreements with other federal, state, and local agencies and nongovernmental organizations.
The scientific community, including ORD, faces a substantially changed environment for communicating scientific information compared to previous decades. A revolution in communication technologies, emergence of organized groups that oppose evidenced-based public policy-making, and greater public skepticism toward all manner of institutions have greatly contributed to a growing number of scientific controversies concerning the credibility, applicability, and ethics of using specific data in policy-making. Ongoing debates include the morality and efficacy of mandating COVID-19 vaccinations, assessing the potential health co-benefits from instituting controls of mercury emissions from industrial sources, and long-term opposition to the scientific consensus for regulating carbon dioxide and other greenhouse gases.
The difficulty of these challenges is intensified by the fact that many of the tools traditionally used by scientists and regulatory agencies—presentation of scientific data at professional conferences, publication of scientific studies in the peer-reviewed literature, and public comment opportunities for scientific documents used in regulatory proceedings—are necessary but no longer sufficient to meet expanded public expectations for transparency and clarity of data use.
Those public expectations arise from technological platforms of social media which challenge the scientific community, including ORD’s scientists, in several ways. Social media is used to provide the public with large volumes of nonauthoritative or (at times) pseudo-scientific information and opinions to influence the credibility of scientific evaluations by established scientific institutions. They provide mass circulation of less scientifically based hypotheses or conclusions to challenge consensus-based evaluations from accredited scientists (Specter, 2009). Scientists employed by EPA and other government agencies have limited ability to respond to these developments on their own because of the nonpolitical nature of their work and the ethical principles and standards through which they operate.
This era of quick-reaction social media, in contrast to the more deliberative pace of traditional scientific research and assessments, challenges both the public’s scientific literacy and the scientific community’s ongoing work to ensure the accuracy, relevance, and public understanding of the data that are generated (Specter, 2009). At the same time, data collected from social media sites and other Internet-based sources are used to identify public health trends (Aiello et al., 2020).
Across the scientific community, four strategies, directly applicable to ORD, are emerging to strengthen scientists’ ability to perform their work and communicate it more effectively:
___________________
8 See www.climatefeedback.org.
Although ORD has invested in enhanced science communication, as efforts unfold to expand ORD’s capabilities and skill sets, so does the need for a new communications strategy especially in this rapidly changing communications landscape. Science communication performs a significant role in the rebuilding of public confidence in nonpartisan, high-quality, EPA-funded science and is a critical component to addressing high-priority public health and environmental problems.
Developing and maintaining the research capacities to guide the future of EPA science will depend on leadership, workforce, tools, and funding. This section discusses several administrative and management improvements for ORD and EPA that could help address challenges related to science implementation.
For science to truly be the “backbone” of EPA, it needs to receive strong leadership support. Much has been written about EPA leadership and its importance to the agency’s scientific enterprise. The National Research Council Committee on Science for EPA’s Future called for strengthening science leadership throughout the agency and enhanced responsibilities in an agency-wide science leadership position, including consideration of a “deputy administrator for science, a chief scientist, or a substantially strengthened version of the current science advisor position” (NRC, 2012, p. 164).
EPA’s Science Advisory Board Subcommittee on Science Integration also presented recommendations for strengthening science leadership, recommending that “managers should be engaged in and accountable for integrating science into decision-making starting with problem formulation and science assessment, in their own organizations and throughout EPA” (EPA SAB, 2012, p. 10).
The ORD Office of Science Advisor, Policy, and Engagement is well positioned to play a leadership role in advancing agency-wide collaboration and rethinking science integration into decision-making to define the future directions of research. In addition, cross-agency science committees, such as the EPA Science and Technology Policy Council and the Risk Assessment Forum, can play a key role in this regard. The Science and Technology Policy Council is composed of senior executives from across the agency for the purpose of identifying critical science and technology issues and developing and implementing policies to help advance EPA’s mission priorities.10 The Risk Assessment Forum, which consists of senior scientists from across EPA, was established to facilitate agency-wide consensus on difficult and controversial risk assessment issues and ensure that the consensus is incorporated into appropriate EPA risk assessment guidance.11
___________________
9 See https://www.epa.gov/report-environment.
10 See https://www.epa.gov/osa/charter-science-and-technology-policy-council-stpc.
11 See https://www.epa.gov/osa/basic-information-about-risk-assessment-guidelines-development.
ORD is a global leader in environmental science, with outstanding scientific personnel. However, most of the science staff is trained in traditional disciplines in biological and other natural sciences. The majority of employees in ORD are selected through the permanent hiring authorities. While there are many benefits to the permanent nature of the career workforce, that approach can serve to limit the acquisition of new talent in response to urgent or novel scientific challenges.
Science to support EPA’s mission in the future will require a greater mix of disciplines, reflecting rapidly evolving needs for expertise. Implementing a systems approach to address major challenges requires greater flexibility to recruit and retain staff with training and experience across the social and behavioral sciences (including environmental justice issues), information science, and data visualization, as well as scientists with cutting-edge capabilities in engineering, genetics, synthetic biology (engineering biology), and chemistry.
Enhancing and maintaining expertise in the areas of analytical chemistry (for nontargeted analyses) and data science and modeling would allow ORD to supplement its existing strengths in toxicology and exposure science. Although these latter areas are established, there needs to be continuing attention paid to identifying emerging hazards and addressing areas of toxicology that have not been well studied, such as the role of epigenetic changes in health and disease as well as the growing attention to New Approach Methods. For areas such as biotechnology and epidemiology, sufficient expertise would be needed to provide the agency with competent guidance and the ability to identify collaboration opportunities, including grants, that leverage expertise outside of EPA. The collaboration with the National Institute of Environmental Health Sciences on children’s environmental health research centers is a good example of amplifying EPA’s research efforts through judicious external partnerships that catalyze new science that advances its mission.
The Title 42 program is a flexible hiring program under Title 42, Section 209 of the U.S. Code that gives federal agencies the authority to appoint highly qualified consultants, scientists, and engineers with competitive salaries at a pay scale outside civil service laws in Title 5 and renewal terms from 1 to 5 years. ORD received limited authority for its Title 42 program in 2006, initially given authority to hire five scientists each year from 2006 through 2011. Since then, exercising this authority has been essential to ORD scientific leadership and capacity building in research areas ranging from cellular/subcellular to population/community levels. The number and terms of Title 42 scientists are still limited by Congress. In the 2022 Consolidated Appropriations Act, Congress expanded the Title 42 authority of EPA to employ up to 75 persons in ORD and 25 persons in the Office of Chemical Safety and Pollution Prevention. This appropriation also required EPA to enter into an agreement with the National Academies to conduct a study of the agency’s use of the authority over the past decade and how the hires have uniquely contributed to the agency’s mission. This study will build on past National Academies reports. For example, NRC (2010) recommended that Title 42 authority be permanently granted to EPA and expanded to allow the agency to define the total number of Title 42 positions on the basis of its programmatic needs and available funds.
ORD will also need a robust pipeline for future cross-disciplinary leaders. The Pathways Program for recent college graduates and traineeships and postdoctoral fellowships12 provide methods for casting a wide net to attract graduates from a broader range of disciplines, including transdisciplinary scientists working in environmental protection. Expansion of opportunities for interagency personnel agreements, visiting scholars, and cooperative agreements also offer a pathway for scientists from government, business, and academia to learn and contribute to science at EPA.
The future success of EPA will depend on its ability to anticipate and respond to the challenges of a changing environment. Recognizing the critical role of science in carrying out the substantial regulatory
___________________
12 See https://www.epa.gov/careers/opportunities-students-and-recent-graduates.
responsibilities of the agency, the committee has focused on practical approaches to address the needs of the growing urgency to prepare for emerging threats and future challenges in light of the immediate needs of EPA program offices. As mentioned above, success will depend on talent, tools, and resources.
The committee has described pathways to develop a stronger capacity for forward-looking science. Some of these approaches (i.e., improving science communication, strategic planning, and collaboration) build on extant strengths of the agency. However, building the infrastructure for the future (including equipment, new talent mix, and extramural research) will be difficult given funding trends. Succeeding in meeting these new opportunities and challenges will require sustained focus on the changes described—and leadership—to ensure that a multi-year plan for making progress each year toward a stronger future is developed and pursued.
Meeting the future challenges of environmental protection will require imagination, new kinds of collaboration, and innovation. EPA cannot rely on yesterday’s science to effectively address emerging threats and persistent, complex problems, such as climate change impacts, environmental justice and cumulative risks, and the intertwined nature of human and ecosystem health. So that it is better able to provide the science EPA needs, the committee offers findings and recommendations to help ORD position itself to take advantage of scientific and technological advances that can be applied using a One Environment–One Health systems approach.
Finding: Contemporary innovation is conceptualized as a set of both structured and more informal relationships within a supportive ecosystem of institutional relationships, resources, and personnel comprising a highly diverse set of skills. The practice of co-creation among multiple partners and enterprises is a major pathway that innovative organizations take in their quest to develop solutions at scale.
ORD has historically developed a number of innovative research initiatives in such fields as computational toxicology, combustion engineering, exposure assessment, and investigations of specific individual pollutants. However, ORD often lacks consistency or larger-scale planning in how it approaches research design or investments.
Given the major transformations under way in information technology, data management, materials science, manufacturing processes, and supply chain management, potential areas for innovation to better support EPA’s mission have broadened considerably in ORD. Innovation also includes new thinking and applications relating to culture, management, incentives, and social processes.
Recommendation 4-1: ORD should re-energize the role of innovation and expand its capacity for innovation to better support EPA’s mission. ORD should create and maintain an innovation ecosystem that exhibits the following attributes:
Finding: Although ORD has a history of collaboration with external research partners, the increased pace and scale of health and environmental challenges present the need for ORD to reconceptualize its approach to collaboration.
Recommendation 4-2: ORD leadership should create the expectation that collaboration represents a core feature of how ORD will provide support to EPA in carrying out its mission. ORD should institute an approach to research collaboration that achieves the following:
Finding: Science communication performs a significant role in the rebuilding of public confidence in nonpartisan, high-quality, EPA-funded science and is a critical component to addressing high-priority public health and environmental problems. ORD faces a daily challenge to communicate effectively to the scientific community, stakeholders, and the general public on all aspects of science and its application to standards setting, enforcement, policy guidance, and other decisions.
At the same time, a revolution in communication technologies, emergence of organized groups prepared to produce and disseminate misinformation and opposed to evidence-based decision-making, and greater public skepticism frame the context for research management and communication. The era of quick-reaction social media directly challenges the more deliberative pace of scientific inquiry, and most scientists are ill-prepared to participate in contemporary science debates on social media platforms. Attempting to correct misperceptions after they have been formed is not sufficient to help people navigate the current complexity of information and media landscape. Misinformation needs to be corrected at the time when people consume it.
ORD’s current approach to scientific communications has been substantial, but can be significantly improved through a multi-pronged effort to upgrade communication skills and tools, including a full array of social media utilization and collaborations with other organizations to promote good science.
Recommendation 4-3: ORD should develop and implement an organization-wide communications plan to expand awareness and understanding of its scientific results. The elements of such a plan include:
Recommendation 4-4: ORD should establish a program for training and strengthening the communication skills of its key scientists. Such a program should include:
Finding: The success of ORD in integrating scientific and technological advances into its research and development enterprise depends on strong support from EPA leadership and involvement of personnel from agency program offices and regional offices in the planning and implementation of research, as well as the application of research results.
Recommendations 4-5: To ensure an inclusive, agency-wide approach to the integration of scientific and technological advances, EPA leadership should consistently involve the Assistant Administrator for ORD and Chief Scientist as active participants in agency decision-making. Those efforts
also should include active representation of EPA national program and regional managers in the early stages of planning through science implementation and regulatory applications.
Recommendation 4-6: EPA leadership should:
Finding: EPA’s workforce will need to comprise a broader and more-nimble talent pool to meet the challenges of emerging environmental threats.
Recommendation 4-7: ORD should conduct an evaluation of current and future scientific staff needs, including the greater diversity of disciplines to address the social, ecological, public health, and data sciences to better account for pollution sources and risk factors, such as location, demography, income, gender, race, and education.
Recommendation 4-8: ORD should enhance and maintain expertise in the areas of analytical chemistry (for nontargeted analyses) and data science and modeling to supplement its existing strengths in human toxicology, ecotoxicology, and exposure science. It should also develop and maintain enough expertise in areas such as biotechnology and epidemiology to provide the agency with competent scientific guidance and identify collaboration opportunities, including grants that leverage expertise outside EPA.
Finding: ORD has had a precipitous decline in total funding, personnel, and the amount of extramural research support it can provide. Current funding levels and continual uncertainty about future funding restrict ORD’s capacity to provide critical science support to EPA for addressing future environmental threats.
Reductions to the STAR program have significantly limited ORDs ability to anticipate and respond to pressing and growing challenges by making initial investments in the most cutting-edge science for which ORD does not currently have in-house capability. The transfer of the STAR fellowships to other agencies has limited ORD’s ability to train, develop, and recruit emerging science leaders.
Funding limitations also undermine ORD’s ability to develop and maintain the computing capabilities and related infrastructure for data management which will become increasingly critical as machine learning and the ability to analyze big data, as described in Chapter 5, grow in scientific and policy importance.
Recommendation 4-9: Planning for meeting the needs in the coming years for EPA science identified through the ORD strategic planning process should include a strategic analysis of ORD resource needs for the future, including workforce development, intramural and extramural research support, emergency response capabilities, regulatory program support, and computing and other information technology resources.
Aiello, A. E., A. Renson, and P. N. Zivich. 2020. Social media– and internet-based disease surveillance for public health. Annual Review of Public Health 41(1):101-118.
Allison, E. H., A. L. Perry, M. C. Badjeck, W. N. Adger, K. Brown., D. Conway, A. S. Halls. G. M. Pilling, J. D. Reynolds, N. L. Andrew, and N. K. Dulvy. 2009. Vulnerability of national economies to the impacts of climate change on fisheries. Fish and Fisheries 10(2):173-196. https://doi.org/10.1111/j.1467-2979.2008.00310.x.
Carey, C. 2009. The impacts of climate change on the annual cycles of birds. Philosophical Transactions of the Royal Society B: Biological Sciences 364(1534):3321-3330. https://doi.org/10.1098/rstb.2009.0182.
Christensen, C. M. 1997. The Innovator’s Dilemma: When New Technologies Cause Great Firms to Fail. Harvard Business Review Press.
Doney, S. C., M. Ruckelshaus, J. E. Duffy, J. P. Barry, F. Chan, C. A. English, H. M. Galindo, J. M. Grebmeier, A. B. Hollowed, N. Knowlton, J. Polovina, N. N. Rabalais, W. J. Sydeman, and L. D. Talley. 2012. Climate change impacts on marine ecosystems. Annual Review of Marine Science 4:11-37. https://www.annualreviews.org/doi/abs/10.1146/annurev-marine-041911-111611.
EPA (U.S. Environmental Protection Agency). 1970. Ash Council Memo. Executive Office of the President. https://archive.epa.gov/epa/aboutepa/ash-council-memo.html.
EPA. 2016. EPA establishes memorandum of understanding (MOU) for water research with Chickasaw Nation. Science in Action. https://www.epa.gov/sites/default/files/2016-08/documents/chickasaw_mou_fact_sheet_081016.pdf.
EPA SAB (Science Advisory Board). 2012. Science Integration for Decision Making at the U.S. Environmental Protection Agency. July 6. https://sab.epa.gov/ords/sab/f?p=100:12:8777962449060.
Hagen, I., C. Huggel, L. Ramajo, N. Chacón, J. P. Ometto, J. C. Postigo, and E. J. Castellanos. 2022. Climate change-related risks and adaptation potential in Central and South America during the 21st century. Environmental Research Letters 17(3):033002. https://iopscience.iop.org/article/10.1088/1748-9326/ac5271.
Johnson, E. J., S. B. Shu, B. G. C. Dellaert, C. Fox, D. G. Goldstein, G. Häubl, R. P. Larrick, J. W. Payne, E. Peters, D. Schkade, B. Wansink, and E. U. Weber. 2012. Beyond nudges: Tools of a choice architecture. Marketing Letters 23:487-504. https://doi.org/10.1007/s11002-012-9186-1.
Mazzucato, M. 2013. The Entrepreneurial State: Debunking the Public vs Private Sector Myths. London: Anthem Press.
NASEM (National Academies of Sciences, Engineering, and Medicine). 2018. Open Science by Design: Realizing a Vision for 21st Century Research. Washington, DC: The National Academies Press. https://doi.org/10.17226/25116.
NRC (National Research Council). 2010. The Use of Title 42 Authority at the U.S. Environmental Protection Agency: A Letter Report. Washington, DC: The National Academies Press. https://doi.org/10.17226/12901.
NRC. 2012. Science for Environmental Protection: The Road Ahead. Washington, DC: The National Academies Press. https://doi.org/10.17226/13510.
Polman, P., and A. S. Winston. 2021. Net Positive: How Courageous Companies Thrive by Giving More Than They Take. Boston, MA. Harvard Business Review Press. Prahalad, C. K., and M. S. Krishnan. 2008. The New Age of Innovation. New York: McGraw-Hill.
Specter, M. 2009. Denialism: How Irrational Thinking Hinders Scientific Progress, Harms the Planet, and Threatens Our Lives. Penguin Press.
Thaler, R. H., and C. R. Sunstein. 2008. Nudge: Improving Decisions About Health, Wealth, and Happiness. New Haven, CT: Yale University Press.