Data Integration, Sharing, and Management for Transportation Planning and Traffic Operations (2025)
Chapter: Front Matter
 |
|
|
NCHRP |
National |
Data Integration, Sharing, and
Management for Transportation
Planning and Traffic Operations
TRANSPORTATION RESEARCH BOARD 2024 EXECUTIVE COMMITTEE*
OFFICERS
CHAIR: Carol A. Lewis, Professor, Transportation Studies, Texas Southern University, Houston
VICE CHAIR: Leslie S. Richards, General Manager, Southeastern Pennsylvania Transportation Authority (SEPTA), Philadelphia
EXECUTIVE DIRECTOR: Victoria Sheehan, Transportation Research Board, Washington, DC
MEMBERS
Michael F. Ableson, CEO, Arrival Automotive–North America, Detroit, MI
James F. Albaugh, President and CEO, The Boeing Company (retired), Scottsdale, AZ
Carlos M. Braceras, Executive Director, Utah Department of Transportation, Salt Lake City
Douglas C. Ceva, Vice President, Customer Lead Solutions, Prologis, Inc., Jupiter, FL
Nancy Daubenberger, Commissioner of Transportation, Minnesota Department of Transportation, St. Paul
Marie Therese Dominguez, Commissioner, New York State Department of Transportation, Albany
Garrett Eucalitto, Commissioner, Connecticut Department of Transportation, Newington
Chris T. Hendrickson, Hamerschlag University Professor of Engineering Emeritus, Carnegie Mellon University, Pittsburgh, PA
Randell Iwasaki, President and CEO, Iwasaki Consulting Services, Walnut Creek, CA
Ashby Johnson, Executive Director, Capital Area Metropolitan Planning Organization (CAMPO), Austin, TX
Joel M. Jundt, Secretary of Transportation, South Dakota Department of Transportation, Pierre
Hani S. Mahmassani, W.A. Patterson Distinguished Chair in Transportation; Director, Transportation Center, Northwestern University, Evanston, IL
Scott C. Marler, Director, Iowa Department of Transportation, Ames
Ricardo Martinez, Adjunct Professor of Emergency Medicine, Emory University School of Medicine, Decatur, GA
Michael R. McClellan, Vice President, Strategic Planning, Norfolk Southern Corporation, Atlanta, GA
Russell McMurry, Commissioner, Georgia Department of Transportation, Atlanta
Craig E. Philip, Research Professor and Director, VECTOR, Department of Civil and Environmental Engineering, Vanderbilt University, Nashville, TN
Steward T.A. Pickett, Distinguished Senior Scientist, Cary Institute of Ecosystem Studies, Millbrook, NY
Susan A. Shaheen, Professor and Co-director, Transportation Sustainability Research Center, University of California, Berkeley
Marc Williams, Executive Director, Texas Department of Transportation, Austin
EX OFFICIO MEMBERS
Michael R. Berube, Deputy Assistant Secretary for Sustainable Transportation, U.S. Department of Energy, Washington, DC
Amit Bose, Administrator, Federal Railroad Administration, Washington, DC
Tristan Brown, Deputy Administrator, Pipeline and Hazardous Materials Safety Administration, U.S. Department of Transportation, Washington, DC
Steven Cliff, Executive Officer, California Air Resources Board, Sacramento
Rand Ghayad, Senior Vice President, Association of American Railroads, Washington, DC
LeRoy Gishi, Chief, Division of Transportation, Bureau of Indian Affairs, U.S. Department of the Interior, Germantown, MD
Robert C. Hampshire, Deputy Assistant Secretary for Research and Technology, U.S. Department of Transportation, Washington, DC
Jason Kelly, Deputy Commanding General for Civil Works and Emergency Operations, U.S. Army Corps of Engineers, Washington, DC
Zahra “Niloo” Parvinashtiani, Engineer, Mobility Consultant Solutions, Iteris Inc., Fairfax, VA, and Chair, TRB Young Members Coordinating Council
Ann Phillips (Rear Admiral, U.S. Navy, retired), Maritime Administrator, Maritime Administration, U.S. Department of Transportation, Washington, DC
Sophie Shulman, Deputy Administrator, National Highway Traffic Safety Administration, Washington, DC
Karl Simon, Director, Transportation and Climate Division, U.S. Environmental Protection Agency, Washington, DC
Paul P. Skoutelas, President and CEO, American Public Transportation Association, Washington, DC
Polly Trottenberg, Deputy Secretary of Transportation, U.S. Department of Transportation, Washington, DC
Jim Tymon, Executive Director, American Association of State Highway and Transportation Officials, Washington, DC
Veronica Vanterpool, Acting Administrator, Federal Transit Administration, Washington, DC
Michael Whitaker, Administrator, Federal Aviation Administration, U.S. Department of Transportation, Washington, DC
Kristin White, Acting Administrator, Federal Highway Administration, U.S. Department of Transportation, Washington, DC
Vinn White, Deputy Administrator, Federal Motor Carrier Safety Administration, Washington, DC
___________________
* Membership as of November 2024.
NATIONAL COOPERATIVE HIGHWAY RESEARCH PROGRAM
NCHRP RESEARCH REPORT 1121
Data Integration, Sharing, and Management for Transportation Planning and Traffic Operations
Kelly Klaver
Vaishali Shah
AEM CORPORATION
Reston, VA
Brian Burkhard
JACOBS
San Francisco, CA
Edward F. Granzow
JACOBS
Reno, NV
Dan Seedah
JACOBS
Dallas, TX
Michael McGurrin
MCGURRIN CONSULTING
Vienna, VA
Ryan Fetchko
VANASSE HANGEN BRUSTLIN, INC.
Orlando, FL
Pat Noyes
PAT NOYES & ASSOCIATES
Boulder, CO
Subscriber Categories
Highways • Operations and Traffic Management • Planning and Forecasting
Research sponsored by the American Association of State Highway and Transportation Officials in cooperation with the Federal Highway Administration
NATIONAL COOPERATIVE HIGHWAY RESEARCH PROGRAM
Systematic, well-designed, and implementable research is the most effective way to solve many problems facing state department of transportation (DOT) administrators and engineers. Often, highway problems are of local or regional interest and can best be studied by state DOTs individually or in cooperation with their state universities and others. However, the accelerating growth of highway transportation results in increasingly complex problems of wide interest to highway authorities. These problems are best studied through a coordinated program of cooperative research.
Recognizing this need, the leadership of the American Association of State Highway and Transportation Officials (AASHTO) in 1962 initiated an objective national highway research program using modern scientific techniques—the National Cooperative Highway Research Program (NCHRP). NCHRP is supported on a continuing basis by funds from participating member states of AASHTO and receives the full cooperation and support of the Federal Highway Administration (FHWA), United States Department of Transportation.
The Transportation Research Board (TRB) of the National Academies of Sciences, Engineering, and Medicine was requested by AASHTO to administer the research program because of TRB’s recognized objectivity and understanding of modern research practices. TRB is uniquely suited for this purpose for many reasons: TRB maintains an extensive committee structure from which authorities on any highway transportation subject may be drawn; TRB possesses avenues of communications and cooperation with federal, state, and local governmental agencies, universities, and industry; TRB’s relationship to the National Academies is an insurance of objectivity; and TRB maintains a full-time staff of specialists in highway transportation matters to bring the findings of research directly to those in a position to use them.
The program is developed on the basis of research needs identified by chief administrators and other staff of the highway and transportation departments, by committees of AASHTO, and by the FHWA. Topics of the highest merit are selected by the AASHTO Special Committee on Research and Innovation (R&I), and each year R&I’s recommendations are proposed to the AASHTO Board of Directors, the FHWA, and the National Academies. Research projects to address these topics are defined by NCHRP, and qualified research agencies are selected from submitted proposals. Administration and oversight of research contracts are the responsibilities of NCHRP.
The needs for highway research are many, and NCHRP can make significant contributions to solving highway transportation problems of mutual concern to many responsible groups. The program, however, is intended to complement, rather than to substitute for or duplicate, other highway research programs.
NCHRP RESEARCH REPORT 1121
Project 08-119
ISSN 2572-3766 (Print)
ISSN 2572-3774 (Online)
ISBN 978-0-309-73229-1
Library of Congress Control Number 2024951910
Digital Object Identifier: 10.17226/28690
© 2025 by the National Academy of Sciences. National Academies of Sciences, Engineering, and Medicine and the graphical logo are trademarks of the National Academy of Sciences. All rights reserved.
COPYRIGHT INFORMATION
Authors herein are responsible for the authenticity of their materials and for obtaining written permissions from publishers or persons who own the copyright to any previously published or copyrighted material used herein.
Cooperative Research Programs (CRP) grants permission to reproduce material in this publication for classroom and not-for-profit purposes. Permission is given with the understanding that none of the material will be used to imply TRB, AASHTO, APTA, FAA, FHWA, FTA, GHSA, or NHTSA endorsement of a particular product, method, or practice. It is expected that those reproducing the material in this document for educational and not-for-profit uses will give appropriate acknowledgment of the source of any reprinted or reproduced material. For other uses of the material, request permission from CRP.
Cover photo credits (clockwise from left): Envato Elements Item, AZ-BLT; iStock.com, Flashmovie; Envato Elements Item, ABBPhoto; iStock.com, Aleksei Glustsenko; Envato Elements Item, puhimec; iStock.com, Jason Finn; iStock.com, solarseven; iStock.com, Booblgum.
NOTICE
The research report was reviewed by the technical panel and accepted for publication according to procedures established and overseen by the Transportation Research Board and approved by the National Academies of Sciences, Engineering, and Medicine.
This material is based upon work supported by the FHWA under Agreement No. 693JJ32350025. The opinions, findings, and conclusions or recommendations expressed or implied in this publication are those of the researchers who performed the research and are not necessarily those of the Transportation Research Board; the National Academies of Sciences, Engineering, and Medicine; the FHWA; or the program sponsors.
The Transportation Research Board does not develop, issue, or publish standards or specifications. The Transportation Research Board manages applied research projects which provide the scientific foundation that may be used by Transportation Research Board sponsors, industry associations, or other organizations as the basis for revised practices, procedures, or specifications.
The Transportation Research Board; the National Academies of Sciences, Engineering, and Medicine; and the sponsors of the National Cooperative Highway Research Program do not endorse products or manufacturers. Trade or manufacturers’ names or logos appear herein solely because they are considered essential to the object of the report.
Published research reports of the
NATIONAL COOPERATIVE HIGHWAY RESEARCH PROGRAM
are available from
National Academies Press
500 Fifth Street, NW, Keck 360
Washington, DC 20001
(800) 624-6242
and can be ordered through the Internet by going to
https://nap.nationalacademies.org
Printed in the United States of America
The National Academy of Sciences was established in 1863 by an Act of Congress, signed by President Lincoln, as a private, nongovernmental institution to advise the nation on issues related to science and technology. Members are elected by their peers for outstanding contributions to research. Dr. Marcia McNutt is president.
The National Academy of Engineering was established in 1964 under the charter of the National Academy of Sciences to bring the practices of engineering to advising the nation. Members are elected by their peers for extraordinary contributions to engineering. Dr. John L. Anderson is president.
The National Academy of Medicine (formerly the Institute of Medicine) was established in 1970 under the charter of the National Academy of Sciences to advise the nation on medical and health issues. Members are elected by their peers for distinguished contributions to medicine and health. Dr. Victor J. Dzau is president.
The three Academies work together as the National Academies of Sciences, Engineering, and Medicine to provide independent, objective analysis and advice to the nation and conduct other activities to solve complex problems and inform public policy decisions. The National Academies also encourage education and research, recognize outstanding contributions to knowledge, and increase public understanding in matters of science, engineering, and medicine.
Learn more about the National Academies of Sciences, Engineering, and Medicine at www.nationalacademies.org.
The Transportation Research Board is one of seven major program divisions of the National Academies of Sciences, Engineering, and Medicine. The mission of the Transportation Research Board is to mobilize expertise, experience, and knowledge to anticipate and solve complex transportation-related challenges. The Board’s varied activities annually engage about 8,500 engineers, scientists, and other transportation researchers and practitioners from the public and private sectors and academia, all of whom contribute their expertise in the public interest. The program is supported by state departments of transportation, federal agencies including the component administrations of the U.S. Department of Transportation, and other organizations and individuals interested in the development of transportation.
Learn more about the Transportation Research Board at www.TRB.org.
COOPERATIVE RESEARCH PROGRAMS
CRP STAFF FOR NCHRP RESEARCH REPORT 1121
Monique R. Evans, Director, Cooperative Research Programs
Waseem Dekelbab, Deputy Director, Cooperative Research Programs, and Manager, National Cooperative Highway Research Program
Zuxuan Deng, Senior Program Officer
Anthony P. Avery, Senior Program Assistant
Natalie Barnes, Director of Publications
Heather DiAngelis, Associate Director of Publications
Janet M. McNaughton, Senior Editor
NCHRP PROJECT 08-119 PANEL
Field of Transportation Planning—Area of Planning Methods & Processes
Jessie X. Jones, Arkansas Department of Transportation, Little Rock, AR (Chair)
Weiyan Chen, Colorado Department of Transportation, Golden, CO
John Engle, Michigan Department of Transportation, Holt, MI
Sreenath Reddy Gangula, Washington State Department of Transportation, Olympia, WA
Patricia Hendren, The Eastern Transportation Coalition, Silver Spring, MD
Nikola Ivanov, University of Maryland, College Park, College Park, MD
Jan-Mou Li, Metropolitan Washington Council of Governments, Washington, DC
Heather Monteiro, Leidos, Topton, NC
Mohamed Semmah, Maryland Department of Transportation, Hanover, MD
James D. Colyar, FHWA Liaison
Penelope Z. Weinberger, AASHTO Liaison
FOREWORD
By Zuxuan Deng
Staff Officer
Transportation Research Board
NCHRP Research Report 1121: Data Integration, Sharing, and Management for Transportation Planning and Traffic Operations presents tools, methods, and guidelines for improving data integration, sharing, and management practices through case studies, proof-of-concept product development, and deployment assistance. The material in this report will be of immediate interest to leaders, engineers, and planners dealing with data at state and local transportation agencies.
Planning and operating transportation systems involves the exchange of large volumes of data that must be shared between partnering transportation agencies (i.e., multimodal transportation, planning, public safety, and emergency response agencies at the city, regional, and state levels); private-sector interests (e.g., transportation network companies, navigation providers, freight managers); travelers; and intelligent devices (e.g., traffic signals, ramp meters, connected vehicles). However, the sharing of data between transportation agencies and practitioners involved in data analysis and reporting has been limited by the lack of common data definitions and formats, concerns with safeguarding proprietary and sensitive information, the persistence of traditional data management systems, and issues with data quality. Modern, well-designed data structures, processes, and systems can improve the efficiency of data-driven processes and can support innovation.
Under NCHRP Project 08-119, “Data Integration, Sharing, and Management for Transportation Planning and Traffic Operations,” the AEM Corporation team was asked to develop tools, methods, and guidelines for improving data integration, sharing, and management practices to enable transportation agencies, in collaboration with private- and public-sector stakeholders, to make better planning and operations decisions. The research team investigated representative planning and operational use cases (e.g., integrated corridor management, smart cities initiatives, traffic incident management, performance management, regional planning, work zone management, and active traffic and demand management) that would benefit from improved data integration, management, and sharing practices. For each of the use cases, the team documented best practices and lessons learned; developed products to address the limitations expressed by public- and private-sector stakeholders and extend the uses of the data and new data sources; tested and refined the proof-of-concept of the products; and provided deployment assistance for a limited number of organizations to help demonstrate the value of the products.
The final report is accompanied by a web-based compilation of best practices identified through the project and additional resources that are housed at the National Operations Center of Excellence (NOCoE) at https://data.transportationops.org/.
This page intentionally left blank.
CONTENTS
Overview of Research and Organization of Report
Chapter 2 Information Gathering and Identification of Products
Assessment of Challenges and Needs and Identification of Use Cases
Identification of Research Products for Development
Chapter 3 Documentation of Effective Practices, Challenges, and Needs: Web-Based Knowledge Library
Chapter 4 Development of Research Products
Data Decision Tree for Big Data in Freight Transportation Planning and Operations
Freight Data Interoperability Framework: Update
Use of Waze for Cities Partnership Data for Operations and Planning
Uses of Smart Work Zone Devices for Work Zone Data Feeds: Five Case Studies
Shared Mobility Data: A Resource Guide
Managing Sensitive Shared Mobility Data
Opportunities and Challenges in Improving the Use of Data in Integrated Corridor Management Systems
Using Connected Vehicle Data for Transportation System Management
Chapter 5 Summary and Recommendations for Future Research
Recommendations for Future Research
Recommendations Based on Data Application Areas and Use Cases
Recommendations to Expand Products Developed by the Research Team
Chapter 6 Data Decision Tree for Big Data in Freight Transportation Planning and Operations
How Do DOTs Currently Use Freight Data?
What Challenges Do DOTs Have When Working with Big Data?
What Are Gaps and Challenges with Existing Big Data Sources?
What Are Some Recommendations Regarding the Use of and Access to Big Data?
Product Assumptions and Constraints
Opportunities for Further Development
Chapter 7 Freight Data Interoperability Framework: Update
Freight Data Querying Methodology
Suggested Data Attribute Mapping
Analysis of Safety, Bridge Condition, or Bridge Vertical Clearance
Conclusion, Recommendations, and Next Steps
Chapter 8 Use of Waze for Cities Partnership Data for Operations and Planning
Examples of Waze for Cities Partnerships
Waze for Cities Partnership Considerations
Strategies and Tools for Deriving the Greatest Value
Agency Concerns, Needs, and Future Opportunities for Waze
The Eastern Transportation Coalition
Agency Vehicle Probe Data Applications
TIM Data Sharing Challenges and Limitations
Examples of Successful Data Sharing in TIM
Recommendations to Improve Sharing of TIM Data
TIM Data Quality Challenges and Limitations
Recommendations for Improving TIM Data Quality
Data Management Challenges and Limitations
Data Management Recommendations
Address Data Quality and Standards
Take a Collaborative Approach to Data
Adopt Modern Data Management Practices
Chapter 11 Uses of Smart Work Zone Devices for Work Zone Data Feeds: Five Case Studies
The Work Zone Data Exchange Specification
Integration of Smart Work Zone Device Data with Work Zone Data Feeds
Kentucky Transportation Cabinet
Regional Transportation Commission of Southern Nevada
Crosscutting Summary and Analysis
Multiple Feeds and Their Roles
Relationship Between WZDx Feeds and Other Feeds with Work Zone Information
Existing Traveler Information Data Feeds
Chapter 12 Shared Mobility Data: A Resource Guide
Literature and Online Resources
Sample Documents or Agreements
Standards Efforts and Software Tools
Public Dashboards and Datasets
Appendix: Data Sharing Section of Minneapolis, MN’s, Licensing Agreement
Chapter 13 Managing Sensitive Shared Mobility Data
Interrelationship Between Privacy and Cybersecurity
The Context for Exchanging Mobility Data
Determine the Data Needed for Each Use Case
Policies Regarding Sensitive Data
Examples of Privacy Principles and Policies
Protection Controls and Methods
Data Desensitization: Anonymization, Data Redaction, Aggregation, and Fuzzing
Appendix 13-A: Examples of Taxi and TNC Data-Reporting Requirements and Publicly Released Data
Appendix 13-B: The Mobility Data Specification and Improved Privacy by Design
Trial Run: Access, Install, and Run LinkerAT
Chapter 16 Using Connected Vehicle Data for Transportation System Management
Security Credential Management System
Transportation System Management with CV Data
Vehicular-Based CV Applications for Transportation Management
