Performance.Poisson: Calculates statistical power, expected time to signal and...

In Sequential: Exact Sequential Analysis for Poisson and Binomial Data

Calculates statistical power, expected time to signal and expected sample size for group and continuous sequential analysis with Poisson data.

Description

The Performance.Poisson function calculates three different performance metrics for group and continuous sequential analysis with Poisson data: the statistical power, the expected time to signal when the null hypothesis is rejected and the expected sample size at the end of the analysis whether the null hypothesis was rejected or not. The user specifies the relative risk under the alternative hypothesis (RR), as well as the sequential analysis parameters. To calculate the statistical significance level alpha, RR=1, in which case the power output value is the alpha level.

Usage

Performance.Poisson(SampleSize, D = 0, M = 1, cv, RR = 2,GroupSizes="n",Tailed="upper")

Arguments

SampleSize	The upper limit on the sample size (length of surveillance) expressed in terms of the expected number of events under the null hypothesis. The SampleSize must be greater than 0. There is no default value.
D	The expected number of events under the null hypothesis at the first look at the data. The default is D=0, which is also the best choice. This means that there is no delay in the start of the sequential analysis. It is required that D\leqSampleSize.
M	The minimum number of events needed to be observed before the null hypothesis can be rejected. The default is M=1, which means that even a single event can reject the null hypothesis if it occurs sufficiently early. A good rule of thumb is to set M=4 (Kulldorff and Silva, 2015).
cv	The critical value constituting the upper rejection boundary. This can be calculated using the CV.Poisson function.
RR	The relative risk under the alternative hypothesis. It is required that RR\geq 1. The default value is RR=2.
GroupSizes	Vector containing the expected number of events under H0 for each test. The values must be positive numbers. The dimension of this vector must be equal to the maximum number of sequential tests. Thus, the sum of the entries in GroupSizes has to be equal to SampleSize. The default is GroupSizes="n" for continuous sequential analysis.
Tailed	Tailed="upper" (default) for H0:RR<=1, and Tailed="lower" for H0:RR>=1 or Tailed="two" for H0:RR=1.

Details

For group and continuous sequential analysis with Poisson data, the Performance.Poisson function calculates the statistical power, the expected time to signal when the null hypothesis is rejected and the expected sample size until the analysis ends whether the null is rejected or not. The sample size is expressed in terms of the expected number of events under the null hypothesis. Large values of the SampleSize, greater than say 1000, may leads to long computing times. When the statistical power is close to 1, then the expected time to signal will be very close to the expected sample size, since both are measured in information time, using the expected events under the null hypothesis as the unit.

To avoid very large computation times, we suggest not using values greater than 1000. Typically, this is not a major restriction. For example, for RR=1.1 and alpha=0.01, the statistical power is approximately 1 for a maximum sample size greater than 500.

Value

Power	The statistical power.
ESignalTime	The expected time to signal given that the null hypothesis is rejected.
ESampleSize	The expected sample size when the sequential analysis ends (length of surveillance) whether the null hypothesis was rejected or not.

Acknowledgements

Development of the Performance.Poisson function was funded by:
- Food and Drug Administration, Center for Biologics Evaluation and Research, through the Mini-Sentinel Post-Rapid Immunization Safety Monitoring (PRISM) program (v1.0).
- National Council of Scientific and Technological Development (CNPq), Brazil (v1.0).
- Bank for Development of the Minas Gerais State (BDMG), Brazil (v1.0).
- National Institute of General Medical Sciences, NIH, USA, through grant number R01GM108999 (v2.0.1,2.0.2).

See also

CV.Poisson: Calculates critical values for continuous sequential analysis with Poisson data.
SampleSize.Poisson: Sample size calculations for continuous sequential analysis with Poisson data.

Author(s)

Ivair Ramos Silva and Martin Kulldorff

References

Kulldorff M, Davis RL, Kolczak M, Lewis E, Lieu T, Platt R. (2011). A Maximized Sequential Probability Ratio Test for Drug and Vaccine Safety Surveillance. Sequential Analysis, 30: 58–78. Kulldorff M, Silva IR. (2015). Continuous Post-market Sequential Safety Surveillance with Minimum Events to Signal. REVSTAT Statistical Journal, 15(3): 373–394.

Examples

# Example 1:
## Suppose we want to find the statistical power to detect a relative risk
## of 2 when doing up to at most 20 months of surveillance, as well as the
## expected time to signal when the null hypothesis is rejected. During 
## each month, we expected to see 0.5 events if the null hypothesis is true. 
## This means that the upper limit on the sample size is 20*0.5=10 expected
## events under the null hypothesis. We will then first calculate the critical
## value for an upper limit on the sample size equal to 10 and a significance
## level of alpha=0.05:

# cvt<- CV.Poisson(SampleSize=10,alpha=0.05)
# cvt
# [1] 3.467952

## After that, we use the Performance.Poisson function to calculate the
## power and the expected time to signal when the null hypothesis is
## rejected for the alternative hypothesis with a relative risk equal to 2:

## Power, expected signal time and expected sample size for a relative risk
## equal to 2:
# Performance.Poisson(SampleSize=10,cv=cvt,RR=2)
#         Power    ESignalTime    ESampleSize 
# [1,] 0.6850634     4.130985      5.979353

## From the results, we see that the statistical power is 68.5%. When the null
## is rejected, the expected time to signal is 4.13 in the unit of events
## expected under the null. If data is collected uniformly over time at the
## rate of 0.5 expected counts per month,the expected time to signal is
## 4.13/0.5= 8.26 months.

## The above calculations can also be accomplished using one single command line:

#  Performance.Poisson(SampleSize=10,cv=CV.Poisson(SampleSize=10,alpha=0.05),RR=2)
#         Power    ESignalTime    ESampleSize
#  [1,] 0.6850634     4.130985      5.979353

# Example 2:
## First use the CV.Poisson function to calculate the critical value for
## 5 sequential looks  at the data, spaced six units apart, and with a
## statistical significance level of 0.05:

cvt<- CV.Poisson(SampleSize=30,alpha=0.05,GroupSizes=c(6,6,6,6,6))

## For an alternative hypothesis of a relative risk of RR=1.5, calculates the
## statistical power, the expected time to signal, and the expected sample size
## at the end of the sequential analysis.

(Performance.Poisson(SampleSize=30,cv=cvt,GroupSizes=c(6,6,6,6,6),RR=1.5))

Sequential documentation built on Oct. 27, 2023, 1:07 a.m.