Calibration {CSTools} | R Documentation |
Forecast Calibration
Description
Five types of member-by-member bias correction can be performed.
The "bias"
method corrects the bias only, the "evmos"
method
applies a variance inflation technique to ensure the correction of the bias
and the correspondence of variance between forecast and observation (Van
Schaeybroeck and Vannitsem, 2011). The ensemble calibration methods
"mse_min"
and "crps_min"
correct the bias, the overall forecast
variance and the ensemble spread as described in Doblas-Reyes et al. (2005)
and Van Schaeybroeck and Vannitsem (2015), respectively. While the
"mse_min"
method minimizes a constrained mean-squared error using three
parameters, the "crps_min"
method features four parameters and
minimizes the Continuous Ranked Probability Score (CRPS). The
"rpc-based"
method adjusts the forecast variance ensuring that the
ratio of predictable components (RPC) is equal to one, as in Eade et al.
(2014). Both in-sample or our out-of-sample (leave-one-out cross
validation) calibration are possible.
Usage
Calibration(
exp,
obs,
exp_cor = NULL,
cal.method = "mse_min",
eval.method = "leave-one-out",
multi.model = FALSE,
na.fill = TRUE,
na.rm = TRUE,
apply_to = NULL,
alpha = NULL,
memb_dim = "member",
sdate_dim = "sdate",
dat_dim = NULL,
ncores = NULL
)
Arguments
exp |
A multidimensional array with named dimensions (at least 'sdate' and 'member') containing the seasonal hindcast experiment data. The hindcast is used to calibrate the forecast in case the forecast is provided; if not, the same hindcast will be calibrated instead. |
obs |
A multidimensional array with named dimensions (at least 'sdate') containing the observed data. |
exp_cor |
An optional multidimensional array with named dimensions (at least 'sdate' and 'member') containing the seasonal forecast experiment data. If the forecast is provided, it will be calibrated using the hindcast and observations; if not, the hindcast will be calibrated instead. If there is only one corrected dataset, it should not have dataset dimension. If there is a corresponding corrected dataset for each 'exp' forecast, the dataset dimension must have the same length as in 'exp'. The default value is NULL. |
cal.method |
A character string indicating the calibration method used,
can be either |
eval.method |
A character string indicating the sampling method used,
can be either |
multi.model |
A boolean that is used only for the |
na.fill |
A boolean that indicates what happens in case calibration is
not possible or will yield unreliable results. This happens when three or
less forecasts-observation pairs are available to perform the training phase
of the calibration. By default |
na.rm |
A boolean that indicates whether to remove the NA values or
not. The default value is |
apply_to |
A character string that indicates whether to apply the
calibration to all the forecast ( |
alpha |
A numeric value indicating the significance level for the
correlation test. Only useful if |
memb_dim |
A character string indicating the name of the member dimension. By default, it is set to 'member'. |
sdate_dim |
A character string indicating the name of the start date dimension. By default, it is set to 'sdate'. |
dat_dim |
A character string indicating the name of dataset dimension. The length of this dimension can be different between 'exp' and 'obs'. The default value is NULL. |
ncores |
An integer that indicates the number of cores for parallel computation using multiApply function. The default value is NULL (one core). |
Details
Both the na.fill
and na.rm
parameters can be used to
indicate how the function has to handle the NA values. The na.fill
parameter checks whether there are more than three forecast-observations pairs
to perform the computation. In case there are three or less pairs, the
computation is not carried out, and the value returned by the function depends
on the value of this parameter (either NA if na.fill == TRUE
or the
uncorrected value if na.fill == TRUE
). On the other hand, na.rm
is used to indicate the function whether to remove the missing values during
the computation of the parameters needed to perform the calibration.
Value
An array containing the calibrated forecasts with the dimensions nexp, nobs and same dimensions as in the 'exp' array. nexp is the number of experiment (i.e., 'dat_dim' in exp), and nobs is the number of observation (i.e., 'dat_dim' in obs). If dat_dim is NULL, nexp and nobs are omitted. If 'exp_cor' is provided the returned array will be with the same dimensions as 'exp_cor'.
Author(s)
VerĂ³nica Torralba, veronica.torralba@bsc.es
Bert Van Schaeybroeck, bertvs@meteo.be
References
Doblas-Reyes F.J, Hagedorn R, Palmer T.N. The rationale behind the success of multi-model ensembles in seasonal forecasting-II calibration and combination. Tellus A. 2005;57:234-252. doi:10.1111/j.1600-0870.2005.00104.x
Eade, R., Smith, D., Scaife, A., Wallace, E., Dunstone, N., Hermanson, L., & Robinson, N. (2014). Do seasonal-to-decadal climate predictions underestimate the predictability of the read world? Geophysical Research Letters, 41(15), 5620-5628. doi: 10.1002/2014GL061146
Van Schaeybroeck, B., & Vannitsem, S. (2011). Post-processing through linear regression. Nonlinear Processes in Geophysics, 18(2), 147. doi: 10.5194/npg-18-147-2011
Van Schaeybroeck, B., & Vannitsem, S. (2015). Ensemble post-processing using member-by-member approaches: theoretical aspects. Quarterly Journal of the Royal Meteorological Society, 141(688), 807-818. doi: 10.1002/qj.2397
See Also
Examples
mod1 <- 1 : (1 * 3 * 4 * 5 * 6 * 7)
dim(mod1) <- c(dataset = 1, member = 3, sdate = 4, ftime = 5, lat = 6, lon = 7)
obs1 <- 1 : (1 * 1 * 4 * 5 * 6 * 7)
dim(obs1) <- c(dataset = 1, member = 1, sdate = 4, ftime = 5, lat = 6, lon = 7)
a <- Calibration(exp = mod1, obs = obs1)