Statistical power and effect size
Within the current empirical or clinical context, are you measuring for a relatively small or large effect size?
Some researchers just have NO IDEA what type of effect size they want to measure for in their studies. In these cases, a pilot study of between 150-300 observations of the outcome of interest may be warranted. Pilot studies can yield effect sizes that can be used in both post hoc power analyses and a priori power analyses for future studies.
When the outcome of interest is measured at a continuous level, the effect size is the absolute difference in means, standard deviations, beta weights, and/or standard errors between independent groups (between-subjects design), across multiple observations of an outcome (within-subjects design), or association (multivariate design).
When the outcome of interest is categorical or nominal, the effect size is the absolute difference in proportions, odds, or risk between independent groups (between-subjects designs), across multiple observations of an outcome (within-subjects designs), or adjusted beta weights and distributions (multivariate designs). It is important to understand up front that when researchers choose categorical or nominal outcomes, they automatically will have to collect larger sample sizes to detect significant effects.
The magnitude of an effect is the actual size of the effect. If you are using categorical outcomes, it is the percentage difference between independent groups (between-subjects designs) or observations across time (within-subjects designs). If you expect one group to have a 50% proportion for an outcome and another group to have a 25% prevalence of the outcome, then the effect size is 25%. When using continuous outcomes, the magnitude is the absolute difference in means between independent groups or within-subjects. If you hypothesize that a pre-test score will be 75 and that the post-test score after an educational intervention will be 95, then the effect size is 20 points.
Defining and operationalizing an effect size as being either small or large is done within the current relative clinical or empirical context. Small effect sizes, especially in the case of using categorical outcomes, will drastically increase the needed sample size. If large effect sizes are hypothesized between independent groups or within-subjects, regardless of categorical or continuous measurement, the needed sample size will always decrease and statistical power will increase.
How large or small will the effect size be in the research study?
Hire A Statistician - Statistical Consulting for Professionals
Eric Heidel, Ph.D. will provide statistical consulting for researchers, professionals, and organizations at $100/hour. Secure checkout is available with Stripe or PayPal.
- Statistical Analysis
- Research Design
- Sample Size Calculations
- Diagnostic Testing and Epidemiological Calculations
- Survey Design and Psychometrics
AppNotch: Convert this website into an Android and iOS app.
AppNotch team will notify you when your app gets approved in Google Play and Apple iTunes App Stores. Once your app goes live, enter your App Store URLs in this property window, publish your Weebly site and your app store icons will be visible in this page.
Please visit AppNotch.com FAQ to learn more about how to add App Store icons to your website, update your app, send Push notifications and more.
Hire A Statistician!
Copyright © 2019 Scalë. All Rights Reserved. Patent Pending.