Previous Chapter: 2 Literature Review Summary
Page 23
Suggested Citation: "3 Data Collection." National Academies of Sciences, Engineering, and Medicine. 2024. Transit Agency Goals and Non-Traditional Performance Indicators Focused on Equity. Washington, DC: The National Academies Press. doi: 10.17226/27922.

Image

CHAPTER 3

Data Collection

Traditionally, transit systems have tracked performance using metrics that gauge efficiency and effectiveness to respond to fiscally focused decision-makers and constituents. While fiscal responsibility is a cornerstone of any effective public program, metrics that gauge fiscal efficiency and effectiveness are not often published in a manner that facilitates advocacy, do not inform the systems about riders’ needs and wants, and cannot effectively account for questions about equity and justice. Furthermore, financial efficiency can be used to curtail service expansions, pilot programs, or other efforts to improve equity by providing services designed to respond to critical needs (which are also inherently more expensive than providing transit in established and/or traditional ways). However, in recent years, some transit systems and other related transportation entities (e.g., state DOTs, MPOs, and private sector transportation providers) have explored non-traditional indicators of performance tailored to understanding the transit experience from the user’s perspective to improve equity. The data collection process for this synthesis project was designed to learn more about these metrics, ranging from the activities that led to their creation and implementation to how the metrics have performed, and lessons learned to further improve this type of performance measurement.

To guide the data collection effort and provide respondents with a shared understanding of what equity means within the context of the project, the following definition of equity in transit was used:

Equity in transit is the fair and just distribution of the benefits and burdens associated with transit services and infrastructure across communities to address the needs of the people in a manner that acknowledges and accounts for historical and current disparities, considers and supports people’s unique circumstances and abilities, and continues to evolve as these factors change. At minimum, transit benefits are presumed to include sufficient access to destinations and opportunities.

Methodology

To enable this project to collect as much information from the industry as possible while offering respondents different ways of engaging with the data collection process, the synthesis team developed a multifaceted data collection methodology. A data portal was established in which potential participants could share documents and other resources not otherwise publicly available, self-schedule an informal interview with the researchers, or access a traditional online survey. To achieve consistency, the interviews and surveys were designed to use the same question set. For a more detailed description of each of the ways participants could engage with the project’s data collection process, see Appendix B.

Outcomes

The response to the synthesis team’s data collection effort was limited, which is likely due to numerous reasons; however, the only direct feedback the team received consisted of responses from potential participants who expressed they did not have the time to support the project.

Page 24
Suggested Citation: "3 Data Collection." National Academies of Sciences, Engineering, and Medicine. 2024. Transit Agency Goals and Non-Traditional Performance Indicators Focused on Equity. Washington, DC: The National Academies Press. doi: 10.17226/27922.

Despite the limited response, the synthesis team learned enough about two transit agencies to prioritize them for case examples—Envida and Durham Regional Transit. Additional information gleaned from the data collection process is presented in the following list:

  • Large or standardized data sets [e.g., the General Transit Feed Specification (GTFS)] can be useful in measures that gauge access to opportunities, although some transit agencies do not have the staff capacity and/or capability to create and update such data sets.
  • In general, staff capacity and data analysis capability are leading limiting factors for equity measurement.
  • Data availability can hamper efforts to measure equity or require aggregated analyses that may lack nuance (e.g., sidewalk networks or specific rider constraints).
  • Most efforts to measure access to opportunities, according to a consultant that facilitates such work, begin with an assessment of available resources (e.g., data, staffing) to gauge what type and/or depth of measurement is possible.

Data Collection Lessons

Based on responses from practitioners during the data collection process, the synthesis team believes multiple factors limited the response rate. While these factors are not the focus of this particular synthesis, they are presented here as lessons learned to aid future projects and provide insight into the challenges of the work associated with transit equity. If it is difficult to find the time to promote the work being done on equity, it is also likely difficult to gain traction and buy-in at the local level, which may curtail change.

  • Staff are overburdened and under-resourced.
    • During direct outreach, the synthesis team received multiple responses from participants who expressed a lack of time to participate and no one to delegate to. Based on these responses and conversations with other transit practitioners, the synthesis team considers it likely that one to two more people could not even take the time to turn the request down for each of these responses. This consideration could also indicate that some agencies lack leadership and/or dedicated guidance for staff related to the agency’s priorities, approach, or stance on equity.
    • Equity has become a popular research topic and mainstream media buzzword. One TCRP project’s data collection is not onerous to respond to; however, when multiple projects are happening simultaneously, in addition to all the other research requests agencies receive, it is easy to become overwhelmed. This fact is especially true for transit agencies considered “notable” in the industry, and staff from these agencies have stated as much while conversing with the synthesis team for this project and others.
  • Discussing and addressing equity is difficult and intimidating.
    • Those who work on equity are emotionally connected and often bring lived experience (sometimes traumatic) to their work. The idea of expending additional emotional energy to explain their work may be one step too far when they already fight every day to be understood in their own local environment.
    • Equity work is politically charged and often forced to “fly under the radar” to avoid being curtailed or otherwise limited. When functioning with such challenges, the prospect of one’s work being documented in a widely published and/or read document may be seen as counterproductive due to the unwanted attention it could attract.
    • Political realities facing transit agencies, such as the need to pursue public acceptance or buy-in one moment and the need to appease decision-makers the next, may contribute to fluctuating levels of priority and/or bandwidth depending on the current need to promote specific initiatives or objectives.
Page 25
Suggested Citation: "3 Data Collection." National Academies of Sciences, Engineering, and Medicine. 2024. Transit Agency Goals and Non-Traditional Performance Indicators Focused on Equity. Washington, DC: The National Academies Press. doi: 10.17226/27922.
  • Varying understanding exists regarding what equity in transit means.
    • Often, the synthesis team finds evidence of variability with regard to the definition of equity in transit, which was also evident in the literature review. While some practitioners see equity as being limited to Title VI requirements, others view equity as providing service throughout a jurisdiction that is the same and affordable, and still others approach equity as an aspect of public engagement. While these concepts of equity are relevant, it may not be obvious to those with such perspectives that equity can inform a comprehensive approach to transit provision and, therefore, be associated with dedicated goals and measurements.
Page 23
Suggested Citation: "3 Data Collection." National Academies of Sciences, Engineering, and Medicine. 2024. Transit Agency Goals and Non-Traditional Performance Indicators Focused on Equity. Washington, DC: The National Academies Press. doi: 10.17226/27922.
Page 23
Page 24
Suggested Citation: "3 Data Collection." National Academies of Sciences, Engineering, and Medicine. 2024. Transit Agency Goals and Non-Traditional Performance Indicators Focused on Equity. Washington, DC: The National Academies Press. doi: 10.17226/27922.
Page 24
Page 25
Suggested Citation: "3 Data Collection." National Academies of Sciences, Engineering, and Medicine. 2024. Transit Agency Goals and Non-Traditional Performance Indicators Focused on Equity. Washington, DC: The National Academies Press. doi: 10.17226/27922.
Page 25
Next Chapter: 4 Regional Case Examples
Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.