README.md
In rmBayes: Performing Bayesian Inference for Repeated-Measures Designs

Bayesian Interval Estimation for Repeated-Measures Designs

For both the homoscedastic and heteroscedastic cases in one-way within-subjects (repeated-measures) designs, this Stan-based R package provides multiple methods to construct the credible intervals for condition means, with each method based on different sets of priors. The emphasis is on the calculation of intervals that remove the between-subjects variability that is a nuisance in within-subjects designs, as proposed in Loftus and Masson (1994), the Bayesian analog proposed in Nathoo, Kilshaw, and Masson (2018), and the adaptation presented in Heck (2019).

| Type | Source | Command | |-------------|------------------------------------|----------------------------------------------------| | Release | CRAN | install.packages("rmBayes") | | Development | GitHub | remotes::install_github("zhengxiaoUVic/rmBayes") |

R 4.0.1 or later is recommended. Prior to installing the package, you need to configure your R installation to be able to compile C++ code. Follow the link below for your respective operating system for more instructions (Stan Development Team, 2020):

Installation time of the source package is about 11 minutes (Stan models need to be compiled). If you have R version 4.0.1 or later on Mac, Windows, or Ubuntu, you can find the binary packages HERE. Or, directly install the binary package by preferably calling

install.packages("rmBayes", type = "binary")

#Or, install from GitHub (archived)
install.packages("rstan")
install.packages("rmBayes", repos = "https://zhengxiaouvic.github.io/drat", type = "binary")

AppVeyor and GitHub Action failure may be due to current rstan version.

When the homogeneity of variance holds, a linear mixed-effects model $\mathcal{M}_1$ for the mean response in a one-way within-subjects design is $\mathcal{M}_1:\ Y_{ij}=\mu+\sigma_\epsilon (t_i+b_j)+\epsilon_{ij}\quad\text{versus}\quad\mathcal{M}_0:\ Y_{ij}=\mu+\sigma_\epsilon b_j+\epsilon_{ij},$ $\epsilon_{ij}\overset{\text{i.i.d.}}{\sim}\mathcal{N}(0,\sigma_\epsilon^2), \ i=1,\dotsb,a;\ j=1,\dotsb,n,$

where $Y_{ij}$ represents the mean response for the $j$ th subject under the $i$ th level of the experimental manipulation; $\mu$ is the overall mean, $\tau_i = \sigma_\epsilon t_i$ is the $i$ th level of the experimental manipulation; $\mu_i = \mu + \tau_i$ , for the means model, is the $i$ th condition mean; $b_j$ are the standardized subject-specific random effects; $a$ is the number of levels; $n$ is the number of subjects. The effects $t_i$ and $b_j$ are both standardized relative to the standard deviation of the error $\sigma_\epsilon$ and become dimensionless (Rouder, Morey, Speckman, & Province, 2012).

Nathoo et al. (2018) derived a Bayesian within-subject interval by conditioning on maximum likelihood estimates of the subject-specific random effects. An assumption articulated in Method 0 is the Jeffreys prior for the condition means $\mu_i$ and residual variance $\sigma_\epsilon^2$ , i.e., $\pi(\mu_1,\dotsb,\mu_a,\sigma_\epsilon^2)\varpropto\frac{1}{\sigma_\epsilon^2}.$

Method 0 constructs the highest-density interval (HDI) as $\text{HDI}=M_{i\centerdot}\pm\sqrt{\frac{\textit{SS}_{S\times C}}{n(n-1)a}}\cdot t_{1-\frac{\alpha}{2},\ a(n-1)}^{*}.$

Note: The sample mean for the $i$ th condition is $M_{i\centerdot}=\frac{1}{n}\sum_{j=1}^{n}Y_{ij}$ .

The sample mean for the $j$ th subject is $M_{\centerdot j}=\frac{1}{a}\sum_{i=1}^{a}Y_{ij}$ .

The overall mean is $M=\frac{1}{an}\sum_{i=1}^{a}\sum_{j=1}^{n}Y_{ij}$ .

The within-group sum-of-squares (SS) is $\textit{SS}_W=\sum_{i=1}^{a}\sum_{j=1}^{b}\left(Y_{ij}-M_{i\centerdot}\right)^2$ .

The interaction SS is $\textit{SS}_{S\times C}=\sum_{i=1}^{a}\sum_{j=1}^{n}\left(Y_{ij}-(M_{\centerdot j}-M)-M_{i\centerdot}\right)^2$ .

$t^*$ refers to the two-sided $t$ -distribution critical value.

library(rmBayes)

str(recall.long)

rmHDI(recall.long, method = 0)

Heck (2019) proposed modifying the conditional within-subjects Bayesian interval to account for uncertainty and shrinkage in the estimated random effects. He derived a modification by applying the HDI equation in Method 0 for the within-subjects Bayesian interval at each iteration of a Markov chain Monte Carlo (MCMC) sampling algorithm and then taking the average interval across posterior samples. Priors used in Method 4 are the Jeffreys prior for the condition means and residual variance, a $g$ -prior structure for standardized subject-specific random effects (i.e., $b_j\mid g_b\overset{\text{ind.}}{\sim}\mathcal{N}(0,g_b)$ ), and independent scaled inverse-chi-square priors with one degree of freedom for the scale hyperparameters of the $g$ -priors (i.e., $g_b\sim\text{Scale-inv-}\chi^2(1,h_b^2)$ ).

Method 4 constructs the HDI as $\text{HDI}=\mathbb{E}\left[\mu_{i}\pm\frac{\sigma_{\epsilon}}{\sqrt{n}}\cdot t_{1-\frac{\alpha}{2},\ a(n-1)}^{*}\mid\text{Data}\right].$

rmHDI(recall.long, method = 4, seed = 277)

To assess the robustness of HDI results with respect to the choice of a prior distribution for the standard deviation of the subject-specific random effects in the within-subjects case, two additional priors are considered: uniform and half-Cauchy ( $\sigma_\epsilon\sqrt{g_b}\sim\text{Unif}(0,1)$ or $\sigma_\epsilon\sqrt{g_b}\sim\text{Half-Cauchy}(0,1)$ ) for Methods 5 and 6, respectively.

rmHDI(recall.long, method = 5, seed = 277)

rmHDI(recall.long, method = 6, seed = 277)

Methods 0 and 4-6 arbitrarily assume improper uniform priors for the condition means. In this work, we expanded the space of possible priors by appling the HDI equation in Method 0 to derive the newly proposed intervals from MCMC sampling, but assuming default $g$ -priors for standardized treatment effects. In other words, Method 1 uses the Jeffreys prior for the overall mean (rather than the condition means), i.e., $\pi(\mu,\sigma_\epsilon^2)\varpropto\frac{1}{\sigma_\epsilon^2}.$

rmHDI(recall.long, seed = 277)

Similar to Methods 5 and 6, two additional priors are considered: uniform and half-Cauchy ( $\sigma_\epsilon\sqrt{g_b}\sim\text{Unif}(0,1)$ or $\sigma_\epsilon\sqrt{g_b}\sim\text{Half-Cauchy}(0,1)$ ) for Methods 2 and 3, respectively, for the standard deviation of the subject-specific random effects in the within-subjects case.

rmHDI(recall.long, method = 2, seed = 277)

rmHDI(recall.long, method = 3, seed = 277)

MCMC sampling of condition means $\mu_i$ can also be used to obtain the standard HDI, which, unlike Methods 0-6, does not remove the between-subjects variability that is not of interest in within-subjects designs. This method assumes the Jeffreys prior for the overall mean and residual variance, a $g$ -prior structure for standardized treatment effects, and independent scaled inverse-chi-square priors with one degree of freedom for the scale hyperparameters of the $g$ -priors.

rmHDI(recall.long, design = "between", seed = 277)

When modeling fixed effects, Rouder et al. (2012, p. 363) proposed default priors by projecting a set of $a$ main effects into $a-1$ parameters such that $t_i^{\star}\mid g\overset{\text{ind.}}{\sim}\mathcal{N}(0,g)$ , $(t_1^{\star},\dotsb,t_{a-1}^{\star})=(t_1,\dotsb,t_{a})\cdot\mathbf{Q}$ , and $\mathbf{I}_a-a^{-1}\mathbf{J}_a=\mathbf{Q}\cdot\mathbf{I}_{a-1}\cdot\mathbf{Q^{\top}}$ ,

where $\mathbf{I}_a$ is the identity matrix of size $a$ , $\mathbf{J}_a$ is the all-ones matrix of size $a$ , $\mathbf{Q}$ is an $a\times (a-1)$ matrix of the $a-1$ eigenvectors of unit length corresponding to the nonzero eigenvalues of $\mathbf{I}_a-a^{-1}\mathbf{J}_a$ , and $(t_1,\dotsb,t_{a})$ is the row vector.

rmHDI(recall.long, treat = "fixed", seed = 277)

When the homogeneity of variance does not hold, the resulting HDI widths for conditions are unequal. Two approaches are currently provided for the heteroscedastic within-subjects data: Implementing the approach developed by Nathoo et al. (2018, p. 5);

rmHDI(recall.long, method = 0, var.equal = FALSE)

Or, implementing the heteroscedastic standard HDI method on the subject-centering transformed data (subtracting from the original response the corresponding subject mean minus the overall mean). If a method option other than 0 or 1 is used with var.equal=FALSE, a pooled estimate of variability will be used just as in the homoscedastic case, and a warning message will be returned.

rmHDI(recall.long, var.equal = FALSE)

Check the Rhat statistic and effective sample size of MCMC draws.

rmHDI(recall.long, seed = 277, diagnostics = TRUE)$diagnostics

Heck, D. W. (2019). Accounting for estimation uncertainty and shrinkage in Bayesian within-subject intervals: A comment on Nathoo, Kilshaw, and Masson (2018). Journal of Mathematical Psychology, 88, 27–31.

Loftus, G. R., & Masson, M. E. J. (1994). Using confidence intervals in within-subject designs. Psychonomic Bulletin & Review, 1, 476–490.

Nathoo, F. S., Kilshaw, R. E., & Masson, M. E. J. (2018). A better (Bayesian) interval estimate for within-subject designs. Journal of Mathematical Psychology, 86, 1–9.

Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012). Default Bayes factors for ANOVA designs. Journal of Mathematical Psychology, 56, 356–374.

Stan Development Team (2020). RStan: the R interface to Stan. R package version 2.21.2. https://mc-stan.org

Any scripts or data that you put into this service are public.

rmBayes documentation built on Sept. 14, 2022, 9:06 a.m.

rdrr.io home R language documentation Run R code online

CRAN packages Bioconductor packages R-Forge packages GitHub packages

Note that we can't provide technical support on individual packages. You should contact the package authors for that.

rmBayes
Performing Bayesian Inference for Repeated-Measures Designs

README.md
In rmBayes: Performing Bayesian Inference for Repeated-Measures Designs

Bayesian Interval Estimation for Repeated-Measures Designs

Installation

Statistical Model

Method 0

Methods 4-6

Methods 1 (Default) and 2-3

Standard HDI

Random Versus Fixed Effects

Heteroscedasticity

MCMC Diagnostics

References

Try the rmBayes package in your browser

R Package Documentation

Browse R Packages

We want your feedback!

rmBayes Performing Bayesian Inference for Repeated-Measures Designs

README.md In rmBayes: Performing Bayesian Inference for Repeated-Measures Designs

Bayesian Interval Estimation for Repeated-Measures Designs

Installation

Statistical Model

Method 0

Methods 4-6

Methods 1 (Default) and 2-3

Standard HDI

Random Versus Fixed Effects

Heteroscedasticity

MCMC Diagnostics

References

Try the rmBayes package in your browser

R Package Documentation

Browse R Packages

We want your feedback!

rmBayes
Performing Bayesian Inference for Repeated-Measures Designs

README.md
In rmBayes: Performing Bayesian Inference for Repeated-Measures Designs