levelSceptical: Computes the level for the sceptical p-value

Description Usage Arguments Value Author(s) References Examples

View source: R/levelSceptical.R

Description

The level for the sceptical p-value is computed based on the specified alternative and calibration type.

Usage

1
2
3
4
5
levelSceptical(
  level,
  alternative = c("one.sided", "two.sided"),
  type = c("golden", "nominal", "liberal", "controlled")
)

Arguments

level

Numeric vector of required replication success levels.

alternative

Either "one.sided" (default) or "two.sided". Specifies if the replication success level is one-sided or two-sided. If the replication success level is one-sided, then a one-sided level for the sceptical p-value is computed.

type

The calibration type can be either "golden" (default), "nominal", "liberal", or "controlled". type = "golden" ensures that for an original study just significant at the specified level, replication success is only possible if the replication effect estimate is larger than the original one. If type = "controlled", the type-I error rate is equal to level^2 (for alternative ="two.sided") or 2 *level^2 (for alternative = "one.sided") if the variance ratio is equal to 1. The type "nominal" ensures that the type-I error rate is always smaller than level^2. Significance of both the original and replication study at level is then a necessary but not sufficient requirement for replication success. If type is "liberal" then significance of both studies is a sufficient requirement for replication success if the variance ratio is equal to 1.

Value

Levels for the sceptical p-value.

Author(s)

Leonhard Held

References

Held, L. (2020). A new standard for the analysis and design of replication studies (with discussion). Journal of the Royal Statistical Society: Series A (Statistics in Society), 183, 431-448. doi: 10.1111/rssa.12493

Held, L. (2020). The harmonic mean chi-squared test to substantiate scientific findings. Journal of the Royal Statistical Society: Series C (Applied Statistics), 69, 697-708. doi: 10.1111/rssc.12410

Held, L., Micheloud, C., Pawel, S. (2021). The assessment of replication success based on relative effect size. https://arxiv.org/abs/2009.07782

Examples

1
2
3
4
levelSceptical(level = 0.025, alternative = "one.sided", type = "nominal")
levelSceptical(level = 0.025, alternative = "one.sided", type = "liberal")
levelSceptical(level = 0.025, alternative = "one.sided", type = "controlled")
levelSceptical(level = 0.025, alternative = "one.sided", type = "golden")

ReplicationSuccess documentation built on July 16, 2021, 9:08 a.m.