summary.MxModel: Model Summary
In OpenMx: Extended Structural Equation Modelling
summary.MxModel R Documentation
Model Summary
Description
This function returns summary statistics of a model. These include model statistics (parameters, degrees of freedom and likelihood),
fit statistics such as AIC, parameter estimates and standard errors (when available), as well as version and timing information
and possible warnings about estimates.
Usage
## S3 method for class 'MxModel'
summary(object, ..., verbose=FALSE)
Arguments
object
A MxModel object.
...
Any number of named arguments (see below).
verbose
Whether to include extra diagnostic information.
Details
mxSummary allows the user to set or override the following parameters of the model:
- numObs
Numeric. Specify the total number of observations for the model.
- numStats
Numeric. Specify the total number of observed statistics for the model.
- refModels
List of MxModel objects. Specify a saturated and independence likelihoods in single argument for testing.
- SaturatedLikelihood
Numeric or MxModel object. Specify a saturated likelihood for testing.
- SaturatedDoF
Numeric. Specify the degrees of freedom of the saturated likelihood for testing.
- IndependenceLikelihood
Numeric or MxModel object. Specify an independence likelihood for testing.
- IndependenceDoF
Numeric. Specify the degrees of freedom of the independence likelihood for testing.
- indep
- \lifecycle
deprecated
- verbose
logical. Changes the printing style for summary (see Details)
- boot.quantile
numeric. A vector of quantiles to be used to
summarize bootstrap replication.
- boot.SummaryType
character. One of ‘quantile’ or ‘bcbci’.
Standard Output
The standard output consists of a table of free parameters, tables of model and fit statistics, information on the time taken to run the model, the optimizer used, and the version of OpenMx.
Table of free parameters
Free parameters in the model are reported in a table with columns for the name (label) of the parameter, the matrix, row and col containing the parameter, the parameter estimate itself, and any lower or upper bounds set for the parameter.
Additional columns: standard errors, exclamation marks ("!"), and the 'A' (asymmetry) warning column
When the information matrix is available, either approximated by the Hessian or from bootstrap resampling, standard errors are reported in the column "Std.Error".
An exclamation mark ("!") can appear in two places: after a lower or upper bound, and in the 'A' column. When an exclamation mark appears after a bound in the lbound or ubound columns, it indicates that the solution was sufficiently close to the bound that the optimizer could not ignore the bound during its last few iterations.
An exclamation mark may also appear under the 'A' column, but in this case it has a different meaning. If the information matrix was estimated using finite differences then an additional diagnostic column 'A' is displayed. An exclamation point in the 'A' column indicates that the gradient appears to be asymmetric and the standard error might not accurately reflect the sampling variability of that parameter. As a precaution, it is recommended that you compare the SEs with profile likelihood-based confidence intervals (mxCI) or bootstrap confidence intervals.
Fit statistics
AIC and BIC Information Criteria are reported in a table showing different versions of the information criteria obtained using different penalties. AIC is reported with both a Parameters Penalty and a Degrees of Freedom Penalty version. AIC generally takes the form Fit + 2*k. With the Parameters Penalty version, k is the number of free parameters: AIC.param = Fit + 2*param. With the Degrees of Freedom Penalty, k is minus one times the model degrees of freedom. So the penalty is subtracted instead of added: AIC.param = Fit - 2*df. The Degrees of Freedom penalty was used in Classic Mx. BIC is defined similarly: Fit + k*log(N) where k is either the number of free parameters or minus one times the model degrees of freedom. The Sample-Size-Adjusted BIC is only defined for the parameters penalty: Fit + k*log((N+2)/24). Similarly, the Sample-Size-Adjusted AIC is Fit + 2*k + 2*k*(k+1)/(N-k-1). For raw data models, Fit is the minus 2 log likelihood, -2LL. For covariance data, Fit is the Chi-squared statistic. The -2LL and saturated likelihood values reported under covariance data are not necessarily meaningful on their own, but their difference yields the Chi-squared value.
Additional fit statistics
When the model has a saturated likelihood, several additional fit indices are printed, including Chi-Squared, CFI, TLI, RMSEA and p RMSEA <= 0.05. For covariance data, saturated and independence models are fitted automatically so all fit indices are reported.
For raw data (to save computational time), the reference models needed to compute these absolute statistics are not estimated by default. They are available once you fit reference models.
The refModels, SaturatedLikelihood, SaturatedDoF, IndependenceLikelihood, and IndependenceDoF arguments can be used to obtain these additional fit statistics. An easy way to make reference models for most cases is provided by the mxRefModels function (see the example given in mxRefModels).
When the SaturatedLikelihood or IndependenceLikelihood arguments are used, OpenMx attempts to calculate the appropriate degrees of freedom. However, depending on the model, it may sometimes be necessary for the user to also explicitly provide the corresponding SaturatedDoF and/or IndependenceDoF. Again, for the vast majority of cases, the mxRefModels function handles these situations effectively and conveniently.
Notes on fit statistics
With regard to RMSEA, it is important to note that OpenMx does not currently make a multigroup adjustment that some other structural equation modeling programs make. In particular, we do not multiply the single-group RMSEA by the square root of the number of groups as suggested by Steiger (1998). The RMSEA we use is based on the model likelihood (and degrees of freedom) as compared to the saturated model likelihood (and degrees of freedom), and we do not feel the adjustment is appropriate in this case.
OpenMx does not recommend (and does not compute) some fit indices including GFI, AGFI, NFI, and SRMR. The Goodness of Fit Index (GFI) and Adjusted Goodness of Fit Index (AGFI) are not recommended because they are strongly influenced by sample size and have rather high Type I error rates (Sharma, Mukherjee, Kumar, & Dillon, 2005). The Normed Fit Index (NFI) has no penalty for model complexity. That is, adding more parameters to a model always improves the NFI, regardless of how useful those parameters are. Because the Non-Normed Fit Index (NNFI), also known as the Tucker-Lewis Index (TLI), does adjust for model complexity it is used instead. Lastly, the Standardized Root Mean Square Residual (SRMR) is not reported because it (1) only applies to covariance models, having no direct extension to missing data, (2) has no penalty for model complexity, similar to the NFI, and (3) is positively biased (Hu & Bentler, 1999).
verbose
The verbose argument changes the printing style for the summary of a model. When verbose=FALSE, a relatively minimal amount of information is printed: the free parameters, the likelihood, and a few fit indices. When verbose=TRUE, the compute plan, data summary, and additional timing information are always printed. Moreover, available fit indices are printed regardless of whether or not they are defined. The undefined fit indices are printed as NA. In addition, the condition number of the information matrix, and the maximum absolute gradient may also be shown.
note: The verbose argument only changes the printing style, all of the same information is calculated and exists in the output of summary. More information is displayed when verbose=TRUE, and less when verbose=FALSE.
Summary for bootstrap replications
Summarization of bootstrap replications is controlled by two options: ‘boot.quantile’ and ‘boot.SummaryType’. To obtain a two-sided 95% width confidence interval, use boot.quantile=c(.025,.975). Options for ‘boot.SummaryType’ are ‘quantile’ (using R's standard stats::quantile function) and ‘bcbci’ for bias-corrected bootstrap confidence intervals. The latter, ‘bcbci’, is the default due to its superior theoretical properties.
References
The OpenMx User's guide can be found at https://openmx.ssri.psu.edu/documentation/.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
Savalei, V. (2012). The relationship between root mean square error of approximation and model misspecification in confirmatory factor analysis models. Educational and Psychological Measurement, 72(6), 910-932.
Sharma, S., Mukherjee, S., Kumar, A., & Dillon, W.R. (2005). A simulation study to investigate the use of cutoff values for assessing model fit in covariance structure models. Journal of Business Research, 58, 935-43.
Steiger, J. H. (1998). A note on multiple sample extensions of the RMSEA fit index. Structural Equation Modeling: A Multidisciplinary Journal, 5(4), 411-419. DOI: 10.1080/10705519809540115
See Also
mxBootstrap
mxCI
as.statusCode
Examples
library(OpenMx)
data(demoOneFactor) # load the demoOneFactor dataframe
manifests <- names(demoOneFactor) # set the manifest to the 5 demo variables
latents <- c("G") # define 1 latent variable
model <- mxModel(model="One Factor", type="RAM",
manifestVars = manifests,
latentVars = latents,
mxPath(from = latents, to=manifests, labels = paste("b", 1:5, sep = "")),
mxPath(from = manifests, arrows = 2, labels = paste("u", 1:5, sep = "")),
mxPath(from = latents, arrows = 2, free = FALSE, values = 1.0),
mxData(cov(demoOneFactor), type = "cov", numObs = 500)
)
model <- mxRun(model) # Run the model, returning the result into model
# Show summary of the fitted model
summary(model)
# Compute the summary and store in the variable "statistics"
statistics <- summary(model)
# Access components of the summary
statistics$parameters
statistics$SaturatedLikelihood
# Specify a saturated likelihood for testing
summary(model, SaturatedLikelihood = -3000)
# Add a CI and view it in the summary
model = mxRun(mxModel(model=model, mxCI("b5")), intervals = TRUE)
summary(model)
OpenMx documentation built on Nov. 8, 2023, 1:08 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| summary.MxModel | R Documentation |
Model Summary
Description
This function returns summary statistics of a model. These include model statistics (parameters, degrees of freedom and likelihood), fit statistics such as AIC, parameter estimates and standard errors (when available), as well as version and timing information and possible warnings about estimates.
Usage
## S3 method for class 'MxModel'
summary(object, ..., verbose=FALSE)
Arguments
object |
A MxModel object. |
... |
Any number of named arguments (see below). |
verbose |
Whether to include extra diagnostic information. |
Details
mxSummary allows the user to set or override the following parameters of the model:
- numObs
Numeric. Specify the total number of observations for the model.
- numStats
Numeric. Specify the total number of observed statistics for the model.
- refModels
List of MxModel objects. Specify a saturated and independence likelihoods in single argument for testing.
- SaturatedLikelihood
Numeric or MxModel object. Specify a saturated likelihood for testing.
- SaturatedDoF
Numeric. Specify the degrees of freedom of the saturated likelihood for testing.
- IndependenceLikelihood
Numeric or MxModel object. Specify an independence likelihood for testing.
- IndependenceDoF
Numeric. Specify the degrees of freedom of the independence likelihood for testing.
- indep
- \lifecycle
deprecated
- verbose
logical. Changes the printing style for summary (see Details)
- boot.quantile
numeric. A vector of quantiles to be used to summarize bootstrap replication.
- boot.SummaryType
character. One of ‘quantile’ or ‘bcbci’.
Standard Output
The standard output consists of a table of free parameters, tables of model and fit statistics, information on the time taken to run the model, the optimizer used, and the version of OpenMx.
Table of free parameters
Free parameters in the model are reported in a table with columns for the name (label) of the parameter, the matrix, row and col containing the parameter, the parameter estimate itself, and any lower or upper bounds set for the parameter.
Additional columns: standard errors, exclamation marks ("!"), and the 'A' (asymmetry) warning column
When the information matrix is available, either approximated by the Hessian or from bootstrap resampling, standard errors are reported in the column "Std.Error".
An exclamation mark ("!") can appear in two places: after a lower or upper bound, and in the 'A' column. When an exclamation mark appears after a bound in the lbound or ubound columns, it indicates that the solution was sufficiently close to the bound that the optimizer could not ignore the bound during its last few iterations.
An exclamation mark may also appear under the 'A' column, but in this case it has a different meaning. If the information matrix was estimated using finite differences then an additional diagnostic column 'A' is displayed. An exclamation point in the 'A' column indicates that the gradient appears to be asymmetric and the standard error might not accurately reflect the sampling variability of that parameter. As a precaution, it is recommended that you compare the SEs with profile likelihood-based confidence intervals (mxCI) or bootstrap confidence intervals.
Fit statistics
AIC and BIC Information Criteria are reported in a table showing different versions of the information criteria obtained using different penalties. AIC is reported with both a Parameters Penalty and a Degrees of Freedom Penalty version. AIC generally takes the form Fit + 2*k. With the Parameters Penalty version, k is the number of free parameters: AIC.param = Fit + 2*param. With the Degrees of Freedom Penalty, k is minus one times the model degrees of freedom. So the penalty is subtracted instead of added: AIC.param = Fit - 2*df. The Degrees of Freedom penalty was used in Classic Mx. BIC is defined similarly: Fit + k*log(N) where k is either the number of free parameters or minus one times the model degrees of freedom. The Sample-Size-Adjusted BIC is only defined for the parameters penalty: Fit + k*log((N+2)/24). Similarly, the Sample-Size-Adjusted AIC is Fit + 2*k + 2*k*(k+1)/(N-k-1). For raw data models, Fit is the minus 2 log likelihood, -2LL. For covariance data, Fit is the Chi-squared statistic. The -2LL and saturated likelihood values reported under covariance data are not necessarily meaningful on their own, but their difference yields the Chi-squared value.
Additional fit statistics
When the model has a saturated likelihood, several additional fit indices are printed, including Chi-Squared, CFI, TLI, RMSEA and p RMSEA <= 0.05. For covariance data, saturated and independence models are fitted automatically so all fit indices are reported.
For raw data (to save computational time), the reference models needed to compute these absolute statistics are not estimated by default. They are available once you fit reference models.
The refModels, SaturatedLikelihood, SaturatedDoF, IndependenceLikelihood, and IndependenceDoF arguments can be used to obtain these additional fit statistics. An easy way to make reference models for most cases is provided by the mxRefModels function (see the example given in mxRefModels).
When the SaturatedLikelihood or IndependenceLikelihood arguments are used, OpenMx attempts to calculate the appropriate degrees of freedom. However, depending on the model, it may sometimes be necessary for the user to also explicitly provide the corresponding SaturatedDoF and/or IndependenceDoF. Again, for the vast majority of cases, the mxRefModels function handles these situations effectively and conveniently.
Notes on fit statistics
With regard to RMSEA, it is important to note that OpenMx does not currently make a multigroup adjustment that some other structural equation modeling programs make. In particular, we do not multiply the single-group RMSEA by the square root of the number of groups as suggested by Steiger (1998). The RMSEA we use is based on the model likelihood (and degrees of freedom) as compared to the saturated model likelihood (and degrees of freedom), and we do not feel the adjustment is appropriate in this case.
OpenMx does not recommend (and does not compute) some fit indices including GFI, AGFI, NFI, and SRMR. The Goodness of Fit Index (GFI) and Adjusted Goodness of Fit Index (AGFI) are not recommended because they are strongly influenced by sample size and have rather high Type I error rates (Sharma, Mukherjee, Kumar, & Dillon, 2005). The Normed Fit Index (NFI) has no penalty for model complexity. That is, adding more parameters to a model always improves the NFI, regardless of how useful those parameters are. Because the Non-Normed Fit Index (NNFI), also known as the Tucker-Lewis Index (TLI), does adjust for model complexity it is used instead. Lastly, the Standardized Root Mean Square Residual (SRMR) is not reported because it (1) only applies to covariance models, having no direct extension to missing data, (2) has no penalty for model complexity, similar to the NFI, and (3) is positively biased (Hu & Bentler, 1999).
verbose
The verbose argument changes the printing style for the summary of a model. When verbose=FALSE, a relatively minimal amount of information is printed: the free parameters, the likelihood, and a few fit indices. When verbose=TRUE, the compute plan, data summary, and additional timing information are always printed. Moreover, available fit indices are printed regardless of whether or not they are defined. The undefined fit indices are printed as NA. In addition, the condition number of the information matrix, and the maximum absolute gradient may also be shown.
note: The verbose argument only changes the printing style, all of the same information is calculated and exists in the output of summary. More information is displayed when verbose=TRUE, and less when verbose=FALSE.
Summary for bootstrap replications
Summarization of bootstrap replications is controlled by two options: ‘boot.quantile’ and ‘boot.SummaryType’. To obtain a two-sided 95% width confidence interval, use boot.quantile=c(.025,.975). Options for ‘boot.SummaryType’ are ‘quantile’ (using R's standard stats::quantile function) and ‘bcbci’ for bias-corrected bootstrap confidence intervals. The latter, ‘bcbci’, is the default due to its superior theoretical properties.
References
The OpenMx User's guide can be found at https://openmx.ssri.psu.edu/documentation/.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
Savalei, V. (2012). The relationship between root mean square error of approximation and model misspecification in confirmatory factor analysis models. Educational and Psychological Measurement, 72(6), 910-932.
Sharma, S., Mukherjee, S., Kumar, A., & Dillon, W.R. (2005). A simulation study to investigate the use of cutoff values for assessing model fit in covariance structure models. Journal of Business Research, 58, 935-43.
Steiger, J. H. (1998). A note on multiple sample extensions of the RMSEA fit index. Structural Equation Modeling: A Multidisciplinary Journal, 5(4), 411-419. DOI: 10.1080/10705519809540115
See Also
mxBootstrap
mxCI
as.statusCode
Examples
library(OpenMx)
data(demoOneFactor) # load the demoOneFactor dataframe
manifests <- names(demoOneFactor) # set the manifest to the 5 demo variables
latents <- c("G") # define 1 latent variable
model <- mxModel(model="One Factor", type="RAM",
manifestVars = manifests,
latentVars = latents,
mxPath(from = latents, to=manifests, labels = paste("b", 1:5, sep = "")),
mxPath(from = manifests, arrows = 2, labels = paste("u", 1:5, sep = "")),
mxPath(from = latents, arrows = 2, free = FALSE, values = 1.0),
mxData(cov(demoOneFactor), type = "cov", numObs = 500)
)
model <- mxRun(model) # Run the model, returning the result into model
# Show summary of the fitted model
summary(model)
# Compute the summary and store in the variable "statistics"
statistics <- summary(model)
# Access components of the summary
statistics$parameters
statistics$SaturatedLikelihood
# Specify a saturated likelihood for testing
summary(model, SaturatedLikelihood = -3000)
# Add a CI and view it in the summary
model = mxRun(mxModel(model=model, mxCI("b5")), intervals = TRUE)
summary(model)
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.