Description Usage Arguments Value Author(s) References See Also Examples
gstudy
runs a G-study with the given data, assuming a fully crossed design (all systems
evaluated on the same queries). It can be used to estimate variance components, which can further
be used to run a D-study with dstudy
.
1 |
data |
A data frame or matrix with the existing effectiveness scores. Systems are columns and queries are rows. |
drop |
The fraction of worst-performing systems to drop from the data before analysis. Defaults to 0 (include all systems). |
An object of class gstudy
, with the following components:
n.s , n.q | Number of systems and number of queries of the existing data. |
var.s , var.q , var.e | Variance of the system, query, and residual effects. |
em.s , em.q , em.e | Mean squares of the system, query and residual components. |
call | A list with the existing data and the percentage of systems to
drop . |
Julián Urbano
R.L. Brennan (2001). Generalizability Theory. Springer.
J. Urbano, M. Marrero and D. Martín (2013). On the Measurement of Test Collection Reliability. ACM SIGIR, pp. 393-402.
1 2 3 4 |
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.