PreCheck: Check pre-period alignment between treatment and control

In google/abpackage: Pre-Period Enhanced A/B Testing

Description

Check pre-period alignment between treatment and control

Usage

PreCheck(data, n.samples = 50000)

Arguments

data	A data.frame with several variables. The variable condition indicates the treatment assignment (control or treatment) for each row. The variable pre indicates the observed value during the pre-period for each row. The variable metric indicates the name of each metric. If omitted, all rows are assumed to be from the same metric.
n.samples	Number of samples used for the permutation.

Details

If all metrics are independent, 5 to be classified as * (light misalignment), 4 be classified as ** (medium misalignment), and 1 expected to be classified as *** (heavy misalignment). P-values are computed using oneway_test.

Value

A data.frame with a column metric, a column p-value and a column misalignemnt indicating the level of misalignemnt between the treatment and the control.

Examples

  data <- SampleData(n.metrics = 20)
  (ans <- PreCheck(data))

google/abpackage documentation built on May 8, 2019, 11:44 a.m.