gstudy runs a G-study with the given data, assuming a fully crossed design (all systems
evaluated on the same queries). It can be used to estimate variance components, which can further
be used to run a D-study with
A data frame or matrix with the existing effectiveness scores. Systems are columns and queries are rows.
The fraction of worst-performing systems to drop from the data before analysis. Defaults to 0 (include all systems).
An object of class
gstudy, with the following components:
||Number of systems and number of queries of the existing data.|
||Variance of the system, query, and residual effects.|
||Mean squares of the system, query and residual components.|
|| A list with the existing
R.L. Brennan (2001). Generalizability Theory. Springer.
J. Urbano, M. Marrero and D. Mart<c3><ad>n (2013). On the Measurement of Test Collection Reliability. ACM SIGIR, pp. 393-402.
1 2 3 4
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.