R: visualize_calibratR

visualize_calibratR {CalibratR}

R Documentation

visualize_calibratR

Description

this method offers a variety of visualisations to compare implemented calibration models

Usage

visualize_calibratR(calibrate_object, visualize_models = FALSE,
  plot_distributions = FALSE, rd_partitions = FALSE,
  training_set_calibrated = FALSE)

Arguments

`calibrate_object`	the list component `calibration_models` from the `calibrate` method
`visualize_models`	returns the list components `plot_calibration_models` and `plot_single_models`
`plot_distributions`	returns a density distribution plot of the calibrated predictions after CV (External) or without CV (internal)
`rd_partitions`	returns a reliability diagram for each model
`training_set_calibrated`	returns a list of ggplots. Each plot represents the calibrated predictions by the respective calibration model of the training set. If the list object `predictions` in the `calibrate_object` is empty, `training_set_calibrated` is returned as NULL.

Value

An object of class list, with the following components:

`histogram_distribution`	returns a histogram of the original ML score distribution
`density_calibration_internal`	returns a list of density distribution plots for each calibration method, the original and the two input-preprocessing methods scaling and transforming. The plot visualises the density distribution of the calibrated predictions of the training set. In this case, training and test set values are identical, so be careful to evaluate the plots.
`density_calibration_external`	returns a list of density distribution plots for each calibration method, the original and the two input-preprocessing methods scaling and transforming. The plot visualises the density distribution of the calibrated predictions, that were returned during Cross Validation. If more than one repetition of CV was performed, run number 1 is evaluated
`plot_calibration_models`	maps the original ML scores to their calibrated prediction estimates for each model. This enables easy model comparison over the range of ML scores See also `compare_models_visual`.
`plot_single_models`	returns a list of ggplots for each calibration model, also mapping the original ML scores to their calibrated prediction. Significance values are indicated. See also `plot_model`
`rd_plot`	returns a list of reliability diagrams for each of the implemented calibration models and the two input-preprocessing methods "scaled" and "transformed". The returned plot visualises the calibrated predictions that were returned for the test set during each of the n run of the n-times repeated CV. Each grey line represents one of the n runs. The blue line represents the median of all calibrated bin predictions. Insignificant bin estimates are indicated with "ns". If no CV was performed during calibration model building using the `calibrate` method, `rd_plot` is returned as NULL
`calibration_error`	returns a list of boxplots for the calibration error metrics ECE, MCE, CLE and RMSE. The n values for each model represent the obtained error values during the n times repeated CV. If no CV was performed during calibration model building using the `calibrate` method, `calibration_error` is returned as NULL
`discrimination_error`	returns a list of boxplots for the discrimination error AUC, sensitivity and specificity. The n values for each model represent the obtained error values during the n times repeated CV. If no CV was performed during calibration model building using the `calibrate` method, `discrimination_error` is returned as NULL
`cle_class_specific_error`	If no CV was performed during calibration model building using the `calibrate` method, `cle_class_specific_error` is returned as NULL
`training_set_calibrated`	returns a list of ggplots. Each plot represents the calibrated predictions by the respective calibration model of the training set. If the list object `predictions` in the `calibrate_object` is empty, `training_set_calibrated` is returned as NULL.
`GUESS_1_final_model`	plots the the returned conditional probability p(x\|Class) values of the GUESS_1 model
`GUESS_2_final_model`	plots the the returned conditional probability p(x\|Class) values of the GUESS_2 model

Author(s)

Johanna Schwarz

Examples

## Loading dataset in environment
 data(example)
 calibration_model <- example$calibration_model

 visualisation <- visualize_calibratR(calibration_model, plot_distributions=FALSE,
 rd_partitions=FALSE, training_set_calibrated=FALSE)

[Package CalibratR version 0.1.2 Index]