Confidence on standardized parameters
This page is not yet finished!
This Page will discuss getting CIs on standardized parameters. Often, raw parameters are valuable: They give us a read-out of effects in the natural units of the variables in the model, e.g. change in miles per gallon per kg of extra vehicle weight, instead of change in SDs of miles per gallon per SD of weight, which is less meaningful.
However, especially in social science, readers are used to standardized effects. In addition, readers might want an idea of the relative size of an effect, and standardized parameters convey this.
To standardize models in umx, you typically add std=TRUE
to the summary method. Getting SEs around these standardized values can be more involved. There are four ways umx can give CIs on standardized values.
- Using SEs from
umxSummary
(for RAM models). - Running the model on standardized data.
- Using
mxSE
to compute a standardized effect, along with mxCIs on these. - Adding mxAlgebras to compute standardized effects, along with
mxCI
s added for these algebras. This approach is most accurate, can be time consuming, is not guaranteed (models can have problems moving parameters to non-significant levels without them hitting boundaries or illegal values.)
1. Using SEs
Method 1 is easiest, and this is what umxSummary
does for you for RAM models.
Given a RAM model, umxSummary
can report either raw or standardized parameter estimates, and also the SE or standardized SE.
m1 = umxRAM("tim", data = mtcars,
umxPath(c("wt", "disp"), to = "mpg"),
umxPath("wt", with = "disp"),
umxPath(v.m. = c("wt", "disp", "mpg"))
)
umxSummary(m1, std=T)
name | Std.Estimate | Std.SE | CI |
---|---|---|---|
disp_to_mpg | -0.36 | 0.18 | -0.36 [-0.71, -0.02] |
wt_to_mpg | -0.54 | 0.17 | -0.54 [-0.89, -0.2] |
mpg_with_mpg | 0.22 | 0.07 | 0.22 [0.08, 0.35] |
disp_with_disp | 1.00 | 0.00 | 1 [1, 1] |
disp_with_wt | 0.89 | 0.04 | 0.89 [0.81, 0.96] |
wt_with_wt | 1.00 | 0.00 | 1 [1, 1] |
one_to_mpg | 5.89 | 0.68 | 5.89 [4.56, 7.22] |
one_to_disp | 1.89 | 0.30 | 1.89 [1.31, 2.47] |
one_to_wt | 3.34 | 0.45 | 3.34 [2.45, 4.23] |
χ²(0) = 0, p = 1.000; CFI = 1; TLI = 1; RMSEA = 0
The calculate 95% confidence intervals around the standardized parameter values are based on std estimate - (1.96 × std.SE)
and std estimate + (1.96 × std.SE)
.
PS: If you haven’t tried umxAPA
have a look now: it can take many objects, and turn them into APA-style report format. For instance, data, lm results, and also effects/SE pairings.
2. Using scaled data
A second method is to scale()
your data (the easiest way is with umxScale
, which handles skipping over binary and factor variables properly), and run the model on this z-scored data. All estimates are automatically in standardized terms. You can also add mxCI calls to the model to get profile-based estimates of confidence rather than extrapolate from the SEs.
2. Adding algebras which compute the scaled value and calling mxCI
If you are an advanced user, you might add mxAlgebra
calls which compute the standardized parameters (umxACE
does this, for instance).
To get CIs around these algebras, you can either call mxSE
(), giving it the model and the algebra you wish to estimate CIs for, or add mxCI
calls to the model requesting CIs for the cells you want from these algebras. The underlying parameters of the model are then varied when the model is run seeking the values which drive the model-fit to the edge of the requested confidence limit. This is done for each of the CIs you request.
nb: For large, complex, raw-data or ordinal models, profile CIs can be very time-consuming.
library(umx);
data(myFADataRaw, package="OpenMx")
manifests = paste0("x",1:6)
a1 = umxRAM("m1", data = myFADataRaw, type = "cov",
umxPath(from = "g", to = manifests),
umxPath(var = manifests),
umxPath(var = "g", fixedAt = 1)
)
umxSummary(a1)
Now, we can add a set of standardization algebras
a1 = umxConfint(a1, parm = "all", run=TRUE)
parameter | lbound | estimate | ubound |
---|---|---|---|
g_to_x1 | 0.731 | 0.803 | 0.880 |
g_to_x2 | 0.729 | 0.803 | 0.881 |
g_to_x3 | 0.697 | 0.770 | 0.848 |
g_to_x4 | 0.754 | 0.825 | 0.902 |
g_to_x5 | 0.737 | 0.810 | 0.888 |
g_to_x6 | 0.748 | 0.820 | 0.898 |
x1_with_x1 | 0.302 | 0.350 | 0.407 |
x2_with_x2 | 0.327 | 0.379 | 0.439 |
x3_with_x3 | 0.337 | 0.389 | 0.450 |
x4_with_x4 | 0.274 | 0.320 | 0.374 |
x5_with_x5 | 0.319 | 0.370 | 0.430 |
x6_with_x6 | 0.297 | 0.346 | 0.403 |