Quality Management for Digital Model–Based Project Development and Delivery (2025)

Chapter: APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK

Visit NAP.edu/10766 to get more information about this book, to buy it in print, or to download it as a free PDF.
Previous Chapter: APPENDIX E: TASK 8 METHODOLOGY REVIEW PACKET
Page 127
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel

APPENDIX F. TASK 8 METHODOLOGY REVIEW FEEDBACK

Participants were provided with a survey to capture feedback on testing the methodology proposed by the research team. A summary of the questions and responses is presented below:

  1. What is your role or what are your general responsibilities at your agency?
    • Previously a Designer, now a Project Manager
    • Designer
    • Project Manager
    • I am a bridge design engineer specialized in BIM. In some of the pilot projects, I am working with the bridge designer to implement The BIM Uses defined in BEP (BIM Execution Plan).
    • Designer, Project Manager, Digital Delivery Specialist
    • Designer
    • Bridge Designer
  2. Which agency do you represent?
    • Utah DOT
    • Utah DOT
    • CalTrans
    • Kimely-Horn – supporting UDOT, ADOT, and TxDOT
    • Kimely-horn & UDOT
    • CalTrans
Page 128
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
  1. Which review type does your agency CURRENTLY HAVE a policy or procedure for?

The graph shows a horizontal axis with five labeled bars. The data given in the graph are as follows: Survey: 2; 3D model integrity: 1; 3D model standards: 2; Clash detection and spatial coordination: 1; Discipline design review: 2.

  1. Which review types is your agency DEVELOPING a policy or procedure for?

The graph shows a horizontal axis with five labeled bars. The data given in the graph are as follows: Survey: 1; 3D model integrity: 3; 3D model standards: 3; Clash detection and spatial coordination: 1; Discipline design review: 3.

  1. Which disciplines were included in the model you used to test the procedures?

The graph shows a horizontal axis with six labeled bars. The data given in the graph are as follows: Bridge: 2; Drainage: 1; Geotech: 1; Roadway: 2; Traffic: 1; Utilities: 1.

Page 129
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
  1. Which reviews did you test?

The graph shows a horizontal axis with four labeled bars and five categories. The data given in the graph are as follows: Survey: 0; 3D model integrity: 2; 3D model standards: 2; Clash detection and spatial coordination: 1; Discipline design review: 1.

  1. Regarding the testing packet, please indicate your reaction to these statements.

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: I had enough time to read and digest the packet provided to me: 3.7, which appears closer to the right side of the scale than the left; I was able to test the review procedures as thoroughly as I wanted to: 3, about midway between the left and right sides of the scale; I understand how the review packet supports the research goals: 4, closer to the right side than the left.

  1. To what extent do you agree with these statements about CONSISTENCY of reviews?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: My agency's current model-based design review process results in consistent contract documents and models: 5, Strongly agree; Having review procedures that result in more consistent contract documents and models is important: 5, Strongly agree; The methodology I tested can help my agency deliver more consistent contract documents and models: 4.5, close to the right side of the scale.

Page 130
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
  1. To what extent do you agree with these statements about REPEATABILITY of reviews?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: My agency's current model-based design review process is repeatable from one project to the next: 3.5, closer to the right side than the left; Having review procedures implemented in a repeatable way is important: 5, Strongly agree; The methodology I tested can help my agency implement repeatable review procedures: 4, closer to the right side than the left.

  1. To what extent do you agree with these statements about the REPRODUCIBILITY of reviews?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: My agency's current model-based design review process is reproducible from one person to the next: 3.5, closer to the right side than the left; Having review procedures implemented in a reproducible way is important: 5, Strongly agree; The methodology I tested can help my agency implement reproducible review procedures: 4, closer to the right side than the left.

  1. To what extent do you agree with these statements about the TRACEABILITY of reviews?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: My agency's current model-based design review process results in documentation where decision-making is traceable: 3.5, closer to the right side than the left; Having review procedures that result in documentation that traces decision-making is important: 5, Strongly agree; The methodology I tested can help my agency implement review procedures that are documented in a way that traces the decision-making: 4, closer to the right side than the left.

Page 131
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
  1. What other attributes of review procedures do you believe are important?
    • Version control – the ability to track what has been reviewed and what still needs to be reviewed; the ability to compare one milestone to the next; the ability to verify the final version.
    • Methods for review and how the review is documented. Each DOT will do this differently, but guidance is preferred.
    • Simplicity-Structured-Documentation and Record Keeping of Model QA/QC – QA/QC Procedures Fit within ISO 9001 Framework.
  2. To what extent do you agree with these statements about the 3D Model Integrity Review?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review definition is comprehensive: 5, Strongly agree; My agency has a standard or manual that defines performance requirements for the elements that define the review: 4.5, close to the right side of the scale.

  1. Please provide any constructive feedback regarding the 3D Model Integrity review definition.
    • In my experience, the 3D Model Integrity Review would take place with the 3D Modeling Standards Review (LOD and LOIN) or within the Discipline Design Review. Consider Combing for simplicity.
Page 132
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
  1. To what extent do you agree with these statements about 3D Model Standards Review?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review definition is comprehensive: 4.5, close to the right side of the scale; My agency has a standard or manual that defines performance requirements for the elements that define the review: 5, Strongly agree.

  1. Please provide any constructive feedback regarding the 3D Model Standards review definition.
    • Metadata definition is also used to define POIN attributes in Utah. Consider using ‘File Metadata.’
  2. To what extent do you agree with these statements about the Clash Detection and Spatial Coordination Review?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review definition is comprehensive: 5, Strongly agree; My agency has a standard or manual that defines performance requirements for the elements that define the review: 1, Strongly disagree.

  1. Please provide any additional feedback regarding the Clash Detection and Spatial Coordination review definition.
    • Utah does have standards for Sight Distance. Both of these review cases are done in the Discipline Design Review.
Page 133
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
  1. To what extent do you agree with these statements about the Discipline Design Review?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review definition is comprehensive: 5, Strongly agree; My agency has a standard or manual that defines performance requirements for the elements that define the review: 4.5, close to the right side of the scale.

  1. To what extent do you agree with these statements about the 7-step process?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The overarching 7-step process is comprehensive: 4.5, close to the right side of the scale; My agency has a standard, manual, or policy that describes review procedure requirements: 3.7, closer to the right side than the left; The overarching 7-step process is relatable and useful for my agency: 5, Strongly agree.

  1. To what extent do you agree with these statements about the review scope and documents lists?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review scopes were comprehensive and relatable: 3, about midway between the left and right sides of the scale; My agency has a standard or manual that fits or describes the reference and review documents listed in the tables: 2.5, closer to the left side than the right; The list of required documents is helpful for my agency: 4, closer to the right side than the left.

Page 134
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
  1. To what extent do you agree with these statements about the review scope and documents lists?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph for each statement is 4, which appears closer to the right side of the scale than the left. The statements in the graph are: The review procedures were comprehensive; The review procedures were understandable and relatable; The core competencies were understandable and relatable; The procedures and core competencies were helpful for my agency.

  1. Which of the following job aids did you use?

The graph shows a horizontal axis with three labeled bars. The data given in the graph are as follows: Glossary of 3D modeling and quality management terms: 2; The model element table: 1; The quality control checklists: 2.

  1. To what extent do you agree with these statements about the supplied job aids?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The glossary of terms was comprehensive: 4.5, close to the right side of the scale; The glossary of terms was useful and terms were relatable: 4, closer to the right side than the left; The Model Element Table was useful: 3.5, closer to the right side than the left; The Model Element Table was confusing: 1.5, close to the left side of the scale; The checklists were useful and relatable: 4.5, close to the right side of the scale.

Page 135
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
  1. Did you use the Model Element Table?

The graph shows a horizontal axis with three categories and one labeled bar. The data given in the graph are as follows: Yes: 0; I wanted to but didn't have time: 0; No: 3.

  1. Which checklist did you use?

The graph shows a horizontal axis with four categories and one labeled bar. The data given in the graph are as follows: Del DOT 3D model integrity: 0; N C DOT survey: 0; N C H R P Project 10 113 3D model integrity: 0; My own agency's checklist or checklists: 2.

Page 127
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
Page 127
Page 128
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
Page 128
Page 129
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
Page 129
Page 130
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
Page 130
Page 131
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
Page 131
Page 132
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
Page 132
Page 133
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
Page 133
Page 134
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
Page 134
Page 135
Suggested Citation: "APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
Save
Cancel
Page 135
Next Chapter: APPENDIX G: IHEEP 2023 WORKSHOP SUMMARY
Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.