Nomograms are predictive tools that give relative contexts and probabilities of clinical outcomes
Steps for creating a nomogram
1. The first step in creating a nomogram is to explicitly define the population of interest that the nomogram will be applied to in clinical practice. The population should be defined in an a priori fashion with thorough inclusion and exclusion criteria. It is preferable to have population-level data when building nomograms because it allows for the model to be more generalizable. The ability of clinicians to correctly apply the predicted probabilities of a nomogram is entirely dependent upon how well they understand the population of interest that the nomogram was based upon.
2. The second step in creating a nomogram is to operationally define the outcome of interest. Describing the outcome in a precise and accurate fashion is important when creating nomograms. Remember, the whole purpose of a nomogram is to be able to predict for the probability of an outcome occurring. Therefore, the outcome needs to be as precise and accurate as possible and be easily understood by both clinicians and patients.
3. The third step in creating a nomogram is to select several covariates that have a pathophysiological link to the outcome of interest. When building a nomogram, all potential covariates associated with an outcome should be included in the model, so long as they all fit in the pathophysiology of developing the outcome. The covariates should be selected in an a priori fashion and should be grounded in clinical evidence rather than statistical significance.
4. The fourth step in creating a nomogram is to select a prediction model, the covariates to be entered into the model, and make sure that all of the statistical assumptions of the prediction model (regression) are met. The type of regression to be used for a nomogram is based upon the scale of measurement of the outcome. The covariates are chosen based on the available data, the pathophysiological framework associated with the disease state, and clinical evidence. The types of statistical assumptions that are tested in all regression models such as multicollinearity, interactions, normality, homoscedasticity, and model fit (residual analysis).
5. The fifth step is to finalize the prediction model using validation, discrimination, and calibration methods. Validation methods include cross-validation (split-group validation and bootstrap validation) and external validation (seeing if the model holds up with a new population or dataset). Predictive accuracy of discrimination is how well a model differentiates between patients with and without the outcome of interest. Discrimination is assessed by the concordance index (or c-index) that is yielded from ROC analyses (c-statistics or area under the curve, "AUC"). Calibration of regression models is measured by plotting the predicted probabilities of the model against the actual probabilites. This is also known as residual analysis. Calibration is essential a measure of model fit.
6. The sixth step is to interpret the final nomogram that has been validated and assessed for concordance and model fit. The relative effects of each covariate are converted into a point scale ranging from 0 to 100. These "scores" for each covariate are added together and correspond to the predicted probability of a patient having the outcome of interest. The scoring method is as follows:
Take the covariate with the highest beta value (regardless of statistical significance) and assign it 100 points. With the rest of the covariates, divide their respective beta values by the highest beta value to yield the amount of points they represent in the nomogram. By doing this, researchers are assigning points to other covariates proportionally based on their effect size in relation to the largest beta value. Add up all the points from all of the covariates in the model and match them to the corresponding predicted probability yielded from the regression model.
7. The seventh and final step is to correctly apply and/or generalize the nomogram in clinical practice. Clinicians should ask themselves the following: Does the patient have clinical and prognostic similarities to the population used when validating the nomogram? Are all the pertinent/correct covariates accounted for in the nomogram as it relates to your patient? Do the point estimates of the regression model make sense in your current clinical context? What degree of uncertainty do you have with the nomogram and its underlying regression model? Can you provide patients with a probability that contains uncertainty or varying effects from patient to patient?
Hire A Statistician - Statistical Consulting for Professionals
Eric Heidel, Ph.D. will provide statistical consulting for researchers, professionals, and organizations at $100/hour. Secure checkout is available with Stripe or PayPal.
- Statistical Analysis
- Research Design
- Sample Size Calculations
- Diagnostic Testing and Epidemiological Calculations
- Survey Design and Psychometrics
AppNotch: Convert this website into an Android and iOS app.
AppNotch team will notify you when your app gets approved in Google Play and Apple iTunes App Stores. Once your app goes live, enter your App Store URLs in this property window, publish your Weebly site and your app store icons will be visible in this page.
Please visit AppNotch.com FAQ to learn more about how to add App Store icons to your website, update your app, send Push notifications and more.
Hire A Statistician!
Copyright © 2019 Scalë. All Rights Reserved. Patent Pending.