Methodological Progress Note: Group Level Assessment

Data Analysis

Analyzing the data generated through a GLA is an iterative process incorporated into steps three to seven as described above and often continues after the GLA session is complete. Step seven can be scheduled as a separate action-planning session depending on time constraints and the study goals. This final step moves the group toward interpretation and dissemination as themes are prioritized and used to drive action steps toward a programmatic, policy, or community change. In some studies, themes will be aggregated across multiple GLAs to integrate the findings from several sessions. This step is sometimes completed with a smaller group of stakeholders, an advisory board, or the research team.

Complementary Data and Synthesis

Research teams often collect additional sources of data that are later used to analyze and interpret the initial stakeholder-developed findings (ie, demographic surveys) and to identify priority areas. Field notes, photographs of completed charts, and recorded participant quotes can also be incorporated into the thematic analysis. Small and large group discussions could be audio recorded and transcribed to capture participants’ individual comments and interpretations. In Choe et al. the team recorded detailed notes, including quotations from participants, and collected a demographic survey. After each GLA session, Choe and colleagues compiled all of the stakeholder-driven findings to develop an overarching set of themes related to communication with LEP families and priority areas that could inform subsequent action. Similar to the qualitative validation strategy of member checking, the authors shared and revised this overarching set of themes in discussion with stakeholders to ensure that participant ideas were adequately and accurately represented.⁸

Compared to traditional qualitative methods such as one-on-one interviews and focus groups, GLA is designed for large groups and is used to promote active engagement of diverse stakeholders in the participatory process. Unlike many other qualitative methods, GLA provides a stakeholder-driven, structured format to elicit diverse stakeholder viewpoints in the moment and build consensus in a participatory manner about priorities and subsequent actions. The progression of the GLA process is collaborative, with stakeholders generating, analyzing, and prioritizing data from their own perspectives. In a focus group or one-on-one interviews, researchers would conduct the analysis after the audio recordings were transcribed. In GLA, stakeholders conduct a thematic analysis in real time, an aspect that adds the stakeholder perspective to analysis of the findings, interpretation, and implications. GLA offers a fun and interactive experience that can build a sense of community among participants (eg, walking around, impromptu conversation, working in small groups, sharing perspectives on the same issue from different vantage points, etc.). GLA is a versatile, flexible methodology that can be used to address different research objectives, be modified for use with various size groups, and be adapted based on the needs and characteristics of stakeholders (eg, children, people with disabilities, etc.).¹ When used in recruitment, GLA is designed to include stakeholders representing different roles and levels of a system. GLA can be particularly useful when engaging underserved communities in research because the process is nonthreatening and promotive of shared perspectives and decision-making. Importantly, the final step of GLA provides interested stakeholders with a way to stay involved in the research through prioritization and action.