
As detailed in the Data Collection Plan completed as part of Task 1, the research team will conduct at least three but not more than six virtual focus group sessions (based on availability) with subject matter experts and practitioners. The team will target 8-12 participants for each focus group, the majority of whom will have completed the Phase I study survey. The focus group sessions will capture qualitative data that will enable a more complete understanding of topics related to VPI practices and experiences during the COVID-19 pandemic. Focus groups will enable delving deeper into VPI successes, failures, challenges, and benefits experienced and foster sharing and learning about VPI practices among participants.
To provide a diverse range of experiences and would like to propose the following cohorts for the focus groups:
The focus groups will take place in May and June. Recruitment for the focus group discussions will begin once the survey analysis is complete. A draft discussion guide has been provided in this document for panel review. In addition to panel suggestions, final questions or prompts may vary based on survey results.
This consent is part of an informed consent process for a research study and it will provide information that will help you decide whether you want to take part in this study. It is your choice to take part or not. After all your questions have been answered and you wish to take part in the research study, you will be asked to sign this consent form. You will be given a copy of the form to keep if you wish. Your alternative to taking part in the research is not to take part in it.
You are being asked to take part in research being conducted by Karen Alexander who is a senior researcher with the Voorhees Transportation at Rutgers University. The purpose of this study is to address a major gap in the public involvement guidance currently available to transportation agencies seeking to use virtual tools and techniques to facilitate two-way communication with the public.
This focus group will take approximately 60 minutes to complete. We would also like your permission to allow us to audiotape (digitally record) our interview today to ensure we capture your thoughts accurately. The recording(s) will be used for analysis by the research team. If you say anything that you believe at a later point may be hurtful and/or damage your reputation, then you can ask the interviewer to rewind the recording and record over such information OR you can ask that certain text be removed from the dataset. The recording(s) will be stored on a secure password protected server location maintained by Rutgers University. Upon completion of the project and subsequent publication of study results, the digital recording(s) will be permanently deleted.
There are no foreseeable risks to participation in this focus group. Breach of confidentiality is a risk of harm but a data security plan is in place to minimize such a risk. Your participation is completely voluntary, and you may choose to not answer any questions you are not comfortable answering; and, if at any time during our conversation you wish to stop participating, you are completely free to do so with no consequence. If you decide to quit the interview your responses will NOT be saved.
There are no direct benefits to you for taking part in this research. You will be contributing to knowledge that will help the research team understand your organization’s experiences and thoughts related to conducting public outreach using virtual tools and techniques.
You will not be paid to take part in this study.
All efforts will be made to keep your responses confidential, but total confidentiality cannot be guaranteed. We will ask you to provide your name and job title during the interview. The research team, project sponsor, and the Institutional Review Board (IRB) at Rutgers University are the only parties that will be allowed to see the data, except as may be required by law. Please note that the name of your agency/organization and the name of the program/service you discuss in our interview will be included in our final research report, any publication(s) of this research, and at presentations made at professional conferences. Your name will also be included unless you indicate that you do not want us to disclose your name.
All research data will be kept for at least three years. Research may be used or distributed to investigators for other research without obtaining additional informed consent from you.
Your participation is voluntary. If you choose to take part now, you may change your mind and withdraw later. In addition, you can choose to skip interview questions that you are not comfortable answering or stop the interview at any time. You may also withdraw your consent for use of responses you provided during the interview, but you must do this in writing to the Principal Investigator, Karen Alexander.
If you have questions about taking part in this study, you can contact the Principal Investigator: Karen Alexander, Voorhees Transportation Center, by phone at 848-932-2831 or by email at karen.alexander@ejb.rutgers.edu.
If you have questions, concerns, problems, information, or input about the research or would like to know your rights as a research subject, you can contact the Rutgers IRB or the Rutgers Human Subjects Protection Program.
By beginning the interview, you acknowledge that you are 18 years of age or older, have listened to me read the consent information and agree to take part in the research, with the knowledge that you are free to withdraw your participation without penalty. Do you give your consent to participate and permission to digitally record our focus group with you?
Thank you.
First, let me begin by saying thank you. We all know that everyone is extremely busy so we truly appreciate you volunteering to participate in our focus group today.
My name is _____________ and I’m honored to lead our conversation on your agency’s experience with virtual public involvement (VPI).
The information we collect today will be instrumental in helping us to report on the state of the practice for virtual public involvement. The report will provide guidance to agencies, organizations, consultants, and others who seek to implement effective, equitable, and efficient virtual public involvement (VPI) practices for transit. VPI refers to the use of digital technology to engage and interact with individuals or to visualize projects and plans. It can include virtual meeting platforms such as Zoom, interactive tools or engagement platforms, social media, and other methods. The COVID-19 pandemic forced all or most of us to transition to incorporation of some virtual public involvement into our outreach, engagement, and communications. It is important that we capture the lessons learned and integrate those lessons into our guidance to lay a path for future communications and engagement that employ the most effective, equitable, and efficient techniques.
If you have never participated in a focus group like this before, please know that these types of facilitated discussions are used in all kinds of research projects and they give us an opportunity to learn more about specific topics – like in this case we are interested in learning about your experiences and opinions related to your agency’s practices.
Before we start, I want to share with you some general guidelines for our discussion today:
Now I would like to read aloud a form to you that asks for your consent to participate in our discussion today. As researchers, any work we undertake that involves human subjects (which you are today) requires we receive consent from each of you before we begin. READ CONSENT, INCLUDING AUDIOTAPING REQUEST, ALOUD.
Let’s start by taking a few minutes to introduce ourselves.
Please tell us your first name and the transit agency you represent.
Now that we all know each other a little better, let’s begin our discussion.
What types of virtual public involvement tools have you used?
Which tools did you find to be the most effective and why?
Which tools were the most challenging and why?
After discussing these challenges, please tell me which challenge you see as the MOST SIGNIFICANT related to VPI?
Can you give us one example of a virtual public involvement experience/initiative that was successful in a surprising or unexpected way?
In what contexts have you used VPI? For instance, do you use VPI for customer feedback, for planning projects, or for communicating service changes, public meetings, or hearings? Are there tools or techniques that are more or less useful for specific contexts?
What are some of the ways that you have used data gathered from VPI? For example, do you use VPI to influence service planning or for discretionary grant applications?
Thinking back on your experiences using virtual public involvement, have there been any specific populations that engage less with VPI than traditional outreach and communication methods?
Have there been any populations for which virtual public involvement made it easier to reach?
Can you tell us a little bit about your experience with VPI and the following groups:
Has there been a particular tool or strategy that was most helpful in reaching these vulnerable groups?
Has your transit agency quantified participation for vulnerable groups or your general customer base? If so, has VPI improved the quality of that data?
Have you noticed concentrations of residents with a lack of connectivity or impacted by the digital divide?
Are there locations in your service area that lack internet or cell phone coverage? In what if any ways have you addressed that challenge?
Now we have a pretty good picture of the types of VPI tools you’ve used and some of the challenges you faced, I would like to turn our attention to discussing staffing and training for VPI.
How prepared were you and your staff for implementing the shift to VPI during the COVID-19 pandemic?
Did you provide your staff/team with any formal training on virtual public involvement?
What types of resources relating to VPI have you used to help guide your efforts and your initiatives? Has there been any resource that was particularly effective or helpful?
What do you see as the most useful/most vital skillsets for employees implementing VPI?
Let’s conclude by stepping back for a minute and thinking about how VPI might continue to shape public involvement in the future. We want to hear your thoughts/impressions about bigger trends and impacts on your agency and the transit field.
How do you think virtual public involvement will change your needs or create unexpected opportunities? What kinds of new engagement opportunities might there be that otherwise would not have been available?
How do you think virtual public involvement will integrate with in-person engagement? Do you see a future for a hybrid approach that is sustainable and effective?
Is there anything we didn’t discuss that you feel is important to share with the group?
Thank you again for your time and commitment. This research will be published later this year in a technical report.
Thank you for participating today!
August 3, 2022, 3–4:30 PM EST
On August 3, 2022, the research team conducted a focus group with small transit agencies from across the country to obtain feedback on their experiences using virtual public engagement (VPI) prior to the COVID-19 pandemic, during the COVID-19 pandemic, and currently.
The facilitated focus groups were held virtually on the Microsoft Teams platform.
The study team identified potential participants from a database of transit agency representatives who completed the Phase I study survey. The potential participants were sorted by agency size and region to ensure that invitees represented agencies across the country. Small agencies are identified as those with four million or fewer annual trips, medium agencies with four to 20 million annual trips, and large agencies with more than 20 million trips.
Focus group participants included:
A focus group discussion guide was shared with participants prior to the meeting to help them prepare. Focus groups were led by a facilitator from the study team. Participants joined the virtual meeting unmuted with their cameras on. Following the reading of study participation ground rules and a round of participant and facilitator introductions, the facilitator led the discussion using questions from the discussion. General topics included:
Participants reported that each of their agencies was currently using forms of VPI and that VPI usage had increased because of the COVID-19 pandemic. Agencies saw an increased volume of public participation due to the implementation of VPI. Some participants reported that some in-person outreach activities were paused at the beginning of the COVID-19 pandemic and have not resumed. Technology was not a significant issue for the agencies, as they were able to adapt quickly, with one transit agency even providing support to other non-transit agencies in their state. Technology has been a limiting factor in the expansion of some VPI techniques, particularly the ability to conduct hybrid virtual/in-person meetings.
September 21, 2022, 3–4:30 PM EST
On September 21, 2022, the research team conducted a focus group with medium transit agencies from across the country to obtain feedback on their experiences using virtual public engagement (VPI) prior to the COVID-19 pandemic, during the COVID-19 pandemic, and currently.
The facilitated focus groups were held virtually on the Microsoft Teams platform.
The study team identified potential participants from a database of transit agency representatives who completed the Phase I study survey. The potential participants were sorted by agency size and region to ensure that invitees represented agencies across the country. Small agencies are identified as those with four million or fewer annual trips, medium agencies with four to 20 million annual trips, and large agencies with more than 20 million trips.
Focus group participants included:
A focus group discussion guide was shared with participants prior to the meeting to help them prepare. Focus groups were led by a facilitator from the study team. Participants joined the virtual meeting unmuted with their cameras on. Following the reading of study participation ground rules and a round of participant and facilitator introductions, the facilitator led the discussion using questions from the discussion. General topics included:
Participants reported that their agencies were currently all using forms of VPI and that VPI usage had increased because of the COVID-19 pandemic. Agencies saw increased public participation due to the implementation of VPI. Some participants reported the use of a hybrid mode for outreach activities. There were some steep curves in learning how to properly use some virtual tools.
September 29, 2022, 3–4:30 PM EST
On September 29, 2022, the research team conducted a focus group with large transit agencies from across the country to obtain feedback on their experiences using virtual public engagement (VPI) prior to the COVID-19 pandemic, during the COVID-19 pandemic, and currently.
The facilitated focus groups were held virtually on the Microsoft Teams platform. The study team identified potential participants from a database of transit agency representatives who completed the Phase I study survey. The potential participants were sorted by agency size and region to ensure that invitees represented agencies across the country. Small agencies are identified as those with four million or fewer annual trips, medium agencies with four to 20 million annual trips, and large agencies with more than 20 million trips.
Focus group participants included:
A focus group discussion guide was shared with participants prior to the meeting to help them prepare. Focus groups were led by a facilitator from the study team. Participants joined the virtual meeting unmuted with their cameras on. Following the reading of study participation ground rules and a round of participant and facilitator introductions, the facilitator led the discussion using questions from the discussion. General topics included:
Participants reported that their agencies were currently all using different forms of VPI and that VPI usage had increased because of the COVID-19 pandemic. The implementation of VPI helped these large agencies to notice a substantial increase in public participation. Some participants
reported using a hybrid mode for outreach activities and many of them are planning to use hybrid approaches in the future. Many of the agencies reported issues with their IT departments when implementing VPI and reliance on consultants to overcome those barriers. Generally, these agencies had greater experience using VPI before the pandemic than medium and smaller-sized agencies. Several agencies noted that while hybrid outreach will be expected or required going forward, they will be placing greater emphasis on reestablishing in-person outreach channels in the near- to mid-term.
they have employed as a standard operating procedure for in-person meetings predating the pandemic.
This page intentionally left blank.