Methodology

The REDI Scorecard assessment was no small feat; it took 12 months to complete from start to finish!

We intentionally combined a variety of measurement practices and approaches to ensure that the most marginalized experiences and perspectives had a platform for meaningful input.

Here’s what we did and how we did it:
Identify Trends
First, we did research to understand the current state of our ecosystem in numbers. We framed and planned out the data collection process & mapped the main points of input. With this, we felt confident to begin the exploration process.
Listen
After mapping out our ecosystem, we began gathering qualitative data from key stakeholders through a 4-month Listening Tour. This included a series of deep dive 1-on-1 interviews and 4 virtual Town Halls held during January and February 2021. We wanted to understand the main assets, gaps and key areas to prioritize within our local ecosystem.
Snapshot
  • Dates: December 1, 2020 - March 31, 2021
  • Participants: 563 
  • Data Points: 290 quotes & 23 total hrs of recordings
  • Analysis: We analyzed the data utilizing an inductive qualitative content methodology, allowing us to evaluate and code emerging patterns.
Ask
For the quantitative data collection section of our REDI assessment, we partnered with Forward Cities, authors of the E3 Scorecard, a self-assessment tool that measures the health and equity of an entrepreneurial ecosystem. After adapting the survey to our local landscape, we applied this 64-question tool for 3 months, gathering over 1000 responses from our community.
Snapshot
  • Dates: March 1st, 2021 - June 30th, 2021
  • Respondents: 1128 
  • Sample: Based on a thorough cleaning criteria, the final sample size used for the statistical analysis is 436 responses.
  • Analysis: The results were analyzed through STATA, utilizing statistical tests like ANOVA, Chi Square and others to understand the differences between subgroups and stratifications. The statistically significant differences among groups are highlighted throughout the report. Some subgroups are not mentioned or included in the analysis given a sample size that was too small.
Analyze
After gathering quantitative and qualitative data for several months, we began the analysis process to capture and distill trends, main findings and potential solutions to the gaps identified.
Share
For this last phase, we developed dynamic content to engage different audiences locally and nationally. Instead of consolidating our findings into an academic report, we leveraged online platforms, storytelling and social media to make the content easily accessible and dynamic for multiple groups.
Identify Trends
Objective: Understand the current state of the ecosystem through preliminary research of secondary and primary sources.

Query: What are the current trends that impact REDI experiences?

Tactic: Plan the data collection process and map out the primary channels of stakeholder input.
Listen
Objective: Understand the diversity of experiences from a broad group of stakeholders through qualitative data collection.

Query: What are our ecosystem's REDI gaps, priorities and assets?

Tactic: Conduct a listening tour over a four (4) month period, including a series of deep dive 1-on-1 interviews and four (4) virtual community-wide town hall convenings.
Snapshot
  • Dates: December 1, 2020 - March 31, 2021
  • Participants: 563 
  • Data Points: 290 salient quotes & 23 total hours of recorded interviews
  • Analysis: Analyze data utilizing an inductive qualitative content methodology, which allows for thorough evaluation and coding of emerging patterns.
Ask
Objective: Understand the diversity of ecosystem experiences from a broad group of stakeholders through quantitative data collection.

Query: What are our ecosystem's REDI gaps, priorities and assets?

Tactic: Through a collaboration with Forward Cities, we adapted their E3 Scorecard, an assessment tool that measures the health and equity of an entrepreneurial ecosystem, to align with the survey component of the REDI Scorecard model as a 64 inquiry point questionnaire. Over a three (3) month period, we collected over 1000 responses from community members.
Snapshot
  • Dates: March 1, 2021 - June 30, 2021
  • Respondents: 1128 
  • Sample: Based on a thorough cleaning criteria, the final sample size used for the statistical analysis is 436 responses.
  • Analysis: Respondent data were analyzed through STATA, utilizing statistical tests like ANOVA, Chi Square and others to understand the differences between distinct subgroups and stratifications. This report notes the statistically significant differences among subsets and groups, those not referenced or included in the analysis given a sample size were too small.
Analyze
Objective: Analyze all data collected using a defensible approach and accepted research methods.

Query: How might we create a data set to benchmark our ecosystem's level of REDI?

Tactic: We analyzed all quantitative and qualitative information gathered to distill trends, main findings and potential solutions to the identified gaps.  Quantitative respondent data were analyzed through STATA, utilizing statistical tests like ANOVA, Chi Square and others to understand the differences between distinct subgroups and stratifications.
Share
Objective: Develop dynamic content to share the results of the assessment.

Query: How might we share the results to engage diverse audiences locally and nationally?

Tactic: Instead of consolidating our findings into a static academic report, we developed a dynamic website, storytelling content, and social media campaign to make the results more accessible and dynamic for multiple stakeholder groups.