Computes FDR estimates and confidence intervals for a sequence of potential significance thresholds.

1 |

`obs_vec` |
observed vector of p-values. |

`perm_list` |
list of dataframes that include a column of permutation p-values (or statistics) in each. The length of the list permp = number of permutations. |

`pname` |
name of column in each list component dataframe that includes p-values (or statistics). |

`ntests` |
total number of observed tests, which is usually the same as the length of obs_vec and the number of rows in each perm_list dataframe. However, this may not be the case if results were filtered by a p-value threshold or statistic threshold. If filtering was conducted then lowerbound must be greater (more extreme) than the filtering criterion. |

`lowerbound` |
lowerbound refers to the range of -log10(p-value) over which fdr is computed for a sequence of thresholds |

`upperbound` |
upperbound refers to the range of -log10(p-value) over which fdr is computed for a sequence of thresholds |

`incr` |
value by which to increment the sequence from lowerbound to upperbound on a -log10(p-value) scale. Default is 0.1. |

`cl` |
confidence level (default is .95). |

`c1` |
overdispersion parameter. If this parameter is not specified (default initial value is NA), then the parameter is estimated from the data. If all tests are known to be independent, then this parameter should be set to 1. |

fdrTbl calls fdr_od. Output from fdrTbl() can be used for FDRplot() input.

A dataframe is returned where rows correspond to p-value thresholds in the sequence from lowerbound to upperbound and columns are: c("threshold","fdr","ll","ul","pi0","odp","S","Sp")

`threshold ` |
p-value threshold chosen to define positive tests |

`fdr ` |
estimated FDR at the chosen p-value threshold |

`ll ` |
estimated lower 95% confidence bound for the FDR estimate |

`ul ` |
estimated upper 95% confidence bound for the FDR estimate |

`pi0 ` |
estimated percent of true null hypotheses |

`odp ` |
estimated over-dispersion parameter |

`S ` |
observed number of positive tests |

`Sp ` |
total number of positive tests summed across all permuted result sets |

Joshua Millstein

Millstein J, Volfson D. 2013. Computationally efficient permutation-based confidence interval estimation for tail-area FDR. Frontiers in Genetics | Statistical Genetics and Methodology 4(179):1-11.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 | ```
nrow_=100
ncol_=100
X = as.data.frame(matrix(rnorm(nrow_*ncol_),nrow=nrow_,ncol=ncol_))
Y = as.data.frame(matrix(rnorm(nrow_*ncol_),nrow=nrow_,ncol=ncol_))
nperm = 10
myanalysis = function(X,Y){
ntests = ncol(X)
rslts = as.data.frame(matrix(NA,nrow=ntests,ncol=2))
names(rslts) = c("ID","pvalue")
rslts[,"ID"] = 1:ntests
for(i in 1:ntests){
fit = cor.test(X[,i],Y[,i],na.action="na.exclude",
alternative="two.sided",method="pearson")
rslts[i,"pvalue"] = fit$p.value
}
return(rslts)
} # End myanalysis
## Generate observed results
obs = myanalysis(X,Y)
## Generate permuted results
perml = vector('list',nperm)
for(p_ in 1:nperm){
X1 = X[order(runif(ncol_)),]
perml[[p_]] = myanalysis(X1,Y)
}
## FDR results table
fdrTbl(obs$pvalue,perml,"pvalue",ncol_,1,2)
``` |

Questions? Problems? Suggestions? Tweet to @rdrrHQ or email at ian@mutexlabs.com.

All documentation is copyright its authors; we didn't write any of that.