Cross Validated
2026-10-08 12:08 UTC
By Vicci
AI-113-20261008-social-media-5b43bd96
Are there established risk-of-bias instruments for correlational primary studies in a meta-analysis?
I am conducting a meta-analysis of correlational field studies in organisational research. The effect size is a product-moment correlation between a predictor measured at the individual or team level and a performance, creativity or innovation outcome. PRISMA 2020 requires a risk-of-bias assessment for each included study. Instruments I am aware of — Cochrane RoB 2, ROBINS-I, the JBI prevalence checklist, AXIS — were developed for trials or for prevalence and diagnostic studies, and their domains do not map onto correlational field research. Is there an established instrument for appraising risk of bias in correlational primary studies contributing to a meta-analysis? Or is the convention for reviewers to declare a study-specific set of criteria? For context, the criteria I have drafted are: construct validity of the predictor measure; reliability of all measures; justification of the rule used to combine sub-dimensions into a composite; common-method variance; alignment between level of measurement, aggregation and analysis; sampling frame and response rate; temporal separation between predictor and outcome; and selective reporting within the study. I rate each low / unclear / high rather than summing them. Many thanks! Vicci
I am conducting a meta-analysis of correlational field studies in organisational research. The effect size is a product-moment correlation between a predictor measured at the individual or team level and a performance, creativity or innovation outcome. PRISMA 2020 requires a risk-of-bias assessment for each included study. Instruments I am aware of — Cochrane RoB 2, ROBINS-I, the JBI prevalence checklist, AXIS — were developed for trials or for prevalence and diagnostic studies, and their domains do not map onto correlational field research. Is there an established instrument for appraising risk of bias in correlational primary studies contributing to a meta-analysis? Or is the convention for reviewers to declare a study-specific set of criteria? For context, the criteria I have drafted are: construct validity of the predictor measure; reliability of all measures; justification of the rule used to combine sub-dimensions into a composite; common-method variance; alignment between level of measurement, aggregation and analysis; sampling frame and response rate; temporal separation between predictor and outcome; and selective reporting within the study. I rate each low / unclear / high rather than summing them. Many thanks! Vicci
Full article content could not be extracted automatically. Read the original below.
Source:
Cross Validated
· stats.stackexchange.com