Two‐stage or not two‐stage? That is the question for IPD meta‐analysis projects

Riley, Richard D.; Ensor, Joie; Hattle, Miriam; Papadimitropoulou, Katerina; Morris, Tim P.

Abstract

Individual participant data meta‐analysis (IPDMA) projects obtain, check, harmonise and synthesise raw data from multiple studies. When undertaking the meta‐analysis, researchers must decide between a two‐stage or a one‐stage approach. In a two‐stage approach, the IPD are first analysed separately within each study to obtain aggregate data (e.g., treatment effect estimates and standard errors); then, in the second stage, these aggregate data are combined in a standard meta‐analysis model (e.g., common‐effect or random‐effects). In a one‐stage approach, the IPD from all studies are analysed in a single step using an appropriate model that accounts for clustering of participants within studies and, potentially, between‐study heterogeneity (e.g., a general or generalised linear mixed model). The best approach to take is debated in the literature, and so here we provide clearer guidance for a broad audience. Both approaches are important tools for IPDMA researchers and neither are a panacea. If most studies in the IPDMA are small (few participants or events), a one‐stage approach is recommended due to using a more exact likelihood. However, in other situations, researchers can choose either approach, carefully following best practice. Some previous claims recommending to always use a one‐stage approach are misleading, and the two‐stage approach will often suffice for most researchers. When differences do arise between the two approaches, often it is caused by researchers using different modelling assumptions or estimation methods, rather than using one or two stages per se.

Citation

Riley, R. D., Ensor, J., Hattle, M., Papadimitropoulou, K., & Morris, T. P. (in press). Two‐stage or not two‐stage? That is the question for IPD meta‐analysis projects. Research Synthesis Methods, 14(6), 903-910. https://doi.org/10.1002/jrsm.1661

• Journal Article Type: Article
• Acceptance Date: Jul 22, 2023
• Online Publication Date: Aug 22, 2023
• Deposit Date: Sep 7, 2023
• Journal: Research Synthesis Methods
• Print ISSN: 1759-2879
• Electronic ISSN: 1759-2887
• Publisher: Wiley
• Peer Reviewed: Peer Reviewed
• Volume: 14
• Issue: 6
• Pages: 903-910
• DOI: https://doi.org/10.1002/jrsm.1661
• Keywords: individual participant data (IPD), two‐stage approach, one‐stage approach, meta‐analysis
• Public URL: https://keele-repository.worktribe.com/output/546209