kequate: Test Equating Using the Kernel Method

View source: R/kernel.R

kequateR Documentation

Test Equating Using the Kernel Method

Description

A function to conduct an equating between two parallel tests using kernel equating. Designs available are equivalent groups (EG), single group (SG), counterbalanced (CB), non-equivalent groups with anchor test using either chain equating (NEAT CE) or post-stratification equating (NEAT PSE) and non-equivalent groups using covariates (NEC).

Usage

kequate(design, ...)

Arguments

design

A character vector indicating which design to use. Possible designs are: EG, SG, CB, NEAT_CE, NEAT_PSE or NEC.

...

Further arguments which partly depend on the design chosen. (See section Details for further information.)

Details

Besides the above argument, additional arguments must be provided for the different equating designs.

EG design


‘x’ A vector of possible score values on the test X to be equated, ordered from the lowest to the highest score.

‘y’ A vector of possible score values on the test Y to be equated, ordered from the lowest to the highest score.

‘r’,‘s’ Numeric vectors containing the estimated or observed score probabilities for tests X and Y respectively. Alternatively objects of class ‘glm’.

‘DMP’, ‘DMQ’ The design matrices from the log-linear models for the estimated score probabilities for X and Y. Not needed if arguments r and s are of class ‘glm’.

‘N’, ‘M’ The sample sizes of the groups taking tests X and Y, respectively. Not needed if arguments r and s are of class ‘glm’.

‘hx’, ‘hy’ Optional arguments to specify the continuization parameters manually. (If linear=TRUE, then these arguments have no effect.)

‘hxlin’, ‘hylin’ Optional arguments to specify the continuization parameters manually in the linear case.

‘KPEN’ The constant used in deciding the optimal continuization parameter. Default is 0.

‘wpen’ An argument denoting at which point the derivatives in the second part of the penalty function should be evaluated. Default is 1/4.

‘linear’ Logical denoting if only a linear equating is to be performed. Default is FALSE.

‘irtx’, ‘irty’ Optional arguments to provide matrices of probabilities to answer correctly to the questions on the parallel tests X and Y, as estimated in an Item Response Theory (IRT) model.

‘smoothed’ A logical argument denoting if the data provided are pre-smoothed or not. Default is TRUE.

‘kernel’ A character vector indicating which kernel to use, either "gaussian", "logistic", "stdgaussian" or "uniform". Default is "gaussian".

‘slog’ The parameter used in defining the logistic kernel. Default is 1.

‘bunif’ The parameter used in defining the uniform kernel. Default is 0.5.

‘altopt’ Logical which sets the bandwidth parameter equal to a variant of Silverman's rule of thumb. Default is FALSE.

‘DS’ Logical which enables bandwidth selection with the double smoothing method.

SG design


‘x’ A vector of possible score values on the test X to be equated, ordered from the lowest to the highest score.

‘y’ A vector of possible score values on the test Y to be equated, ordered from the lowest to the highest score.

‘P’ The estimated or observed probability matrix for scores on tests X and Y, where the columns denote scores on test Y and the rows denote scores on test X. Alternatively a vector of score probabilities or an object of class ‘glm’, where the entries are ordered first by the Y-scores and then by the X-scores.

‘DM’ The design matrix used in the log-linear model. Not needed if the argument P is of class ‘glm’.

‘N’ The sample size. Not needed if the argument P is of class ‘glm’.

‘hx’, ‘hy’ Optional arguments to specify the continuization parameter manually. (If linear=TRUE, then these arguments have no effect.)

‘hxlin’, ‘hylin’ Optional arguments to specify the continuization parameters manually in the linear case.

‘KPEN’ The constant used in deciding the optimal continuization parameter. Default is 0.

‘wpen’ An argument denoting at which point the derivatives in the second part of the penalty function should be evaluated. Default is 1/4.

‘linear’ Logical denoting if only a linear equating is to be performed. Default is FALSE.

‘irtx’, ‘irty’ Optional arguments to provide matrices of probabilities to answer correctly to the questions on the parallel tests X and Y, as estimated in an Item Response Theory (IRT) model.

‘smoothed’ A logical argument denoting if the data provided are pre-smoothed or not. Default is TRUE.

‘kernel’ A character vector indicating which kernel to use, either "gaussian", "logistic", "stdgaussian" or "uniform". Default is "gaussian".

‘slog’ The parameter used in defining the logistic kernel. Default is 1.

‘bunif’ The parameter used in defining the uniform kernel. Default is 0.5.

‘DS’ Logical which enables bandwidth selection with the double smoothing method.

‘CV’ Logical which enables bandwidth selection with the cross-validation method.

CB design


‘x’ A vector of possible score values on the test X to be equated, ordered from the lowest to the highest score.

‘y’ A vector of possible score values on the test Y to be equated, ordered from the lowest to the highest score.

‘P12’, ‘P21’ The estimated or observed probability matrices for scores on first taking test X and then taking test Y, and first taking test Y and then taking test X respectively, where the rows denote scores on tests X and the columns denote scores on test Y. Alternatively numeric vectors or objects of class ‘glm’, where the entries are ordered first by the Y-scores and then by the X-scores.

‘DM12’, ‘DM21’ The design matrices from the log-linear models for the estimated score probabilities for the two test groups. Not needed if arguments P12 and P21 are of class ‘glm’.

‘N’, ‘M’ The sample sizes for the tests X and A and the tests Y and A, respectively. Not needed if arguments P12 and P21 are of class ‘glm’.

‘hx’, ‘hy’ Optional arguments to specify the continuization parameters manually. (If linear=TRUE, then these arguments have no effect)

‘hxlin’, ‘hylin’ Optional arguments to specify the continuization parameters manually in the linear case. (Applies both when linear=FALSE and when linear=TRUE.)

‘wcb’ The weighting of the two groups. Default is 0.5.

‘KPEN’ Optional argument to specify the constant used in deciding the optimal continuization parameter. Default is 0.

‘wpen’ An argument denoting at which point the derivatives in the second part of the penalty function should be evaluated. Default is 1/4.

‘linear’ Optional logical argument denoting if only a linear equating is to be performed. Default is FALSE.

‘irtx’, ‘irty’ Optional arguments to provide matrices of probabilities to answer correctly to the questions on the parallel tests X and Y, as estimated in an Item Response Theory (IRT) model.

‘smoothed’ A logical argument denoting if the data provided are pre-smoothed or not. Default is TRUE.

‘kernel’ A character vector indicating which kernel to use, either "gaussian", "logistic", "stdgaussian" or "uniform". Default is "gaussian".

‘slog’ The parameter used in defining the logistic kernel. Default is 1.

‘bunif’ The parameter used in defining the uniform kernel. Default is 0.5.

‘altopt’ Logical which sets the bandwidth parameter equal to a variant of Silverman's rule of thumb. Default is FALSE.

‘DS’ Logical which enables bandwidth selection with the double smoothing method.

‘CV’ Logical which enables bandwidth selection with the cross-validation method.

NEAT PSE or NEC design


‘x’ A vector of possible score values on the test X to be equated, ordered from the lowest to the highest score.

‘y’ A vector of possible score values on the test Y to be equated, ordered from the lowest to the highest score.

‘P’, ‘Q’ The estimated or observed probability matrices for scores on tests X and A and tests Y and A respectively, where the rows denote scores on tests X or Y and the columns denote scores on test A. Alternatively numeric vectors or objects of class ‘glm’, where the entries are ordered first by the X-scores/Y-scores and then by the A-scores.

‘DMP’, ‘DMQ’ The design matrices from the log-linear models for the estimated score probabilities for X and A and Y and A. Not needed if arguments P and Q are of class ‘glm’.

‘N’, ‘M’ The sample sizes for the tests X and A and the tests Y and A, respectively. Not needed if arguments P and Q are of class ‘glm’.

‘w’ The weighting of the synthetic population. Default is 0.5.

‘hx’, ‘hy’ Optional arguments to specify the continuization parameters manually. (If linear=TRUE, then these arguments have no effect)

‘hxlin’, ‘hylin’ Optional arguments to specify the continuization parameters manually in the linear case. (Applies both when linear=FALSE and when linear=TRUE.)

‘KPEN’ Optional argument to specify the constant used in deciding the optimal continuization parameter. Default is 0.

‘wpen’ An argument denoting at which point the derivatives in the second part of the penalty function should be evaluated. Default is 1/4.

‘linear’ Optional logical argument denoting if only a linear equating is to be performed. Default is FALSE.

‘irtx’, ‘irty’ Optional arguments to provide matrices of probabilities to answer correctly to the questions on the parallel tests X and Y, as estimated in an Item Response Theory (IRT) model.

‘smoothed’ A logical argument denoting if the data provided are pre-smoothed or not. Default is TRUE.

‘kernel’ A character vector indicating which kernel to use, either "gaussian", "logistic", "stdgaussian" or "uniform". Default is "gaussian".

‘slog’ The parameter used in defining the logistic kernel. Default is 1.

‘bunif’ The parameter used in defining the uniform kernel. Default is 0.5.

‘altopt’ Logical which sets the bandwidth parameter equal to a variant of Silverman's rule of thumb. Default is FALSE.

‘DS’ Logical which enables bandwidth selection with the double smoothing method.

‘CV’ Logical which enables bandwidth selection with the cross-validation method.

NEAT CE design


‘x’ A vector of possible score values on the test X to be equated, ordered from the lowest to the highest score.

‘y’ A vector of possible score values on the test Y to be equated, ordered from the lowest to the highest score.

‘a’ A vector containing the possible score values on the anchor test, ordered from the lowest score to the highest.

‘P’, ‘Q’ The estimated or observed probability matrices for scores on tests X and A and tests Y and A respectively, where the rows denote scores on test X or Y and the columns denote scores on test A. Alternatively numeric vectors or objects of class ‘glm’, where the entries are ordered first by the X-scores/Y-scores and then by the A-scores.

‘DMP’, ‘DMQ’ The design matrices from the log-linear models for the estimated score probabilities for X and A and Y and A, respectively. Not needed if arguments P and Q are of class ‘glm’.

‘N’, ‘M’ The sample sizes for the tests X and A and the tests Y and A, respectively. Not needed if arguments P and Q are of class ‘glm’.

‘hxP’, ‘hyQ’, ‘haP’, ‘haQ’ Optional arguments to specify the continuization parameters manually. (If linear=TRUE, then these arguments have no effect.)

‘hxPlin’, ‘hyQlin’, ‘haPlin’, ‘haQlin’ Optional arguments to specify the continuization parameters manually in the linear case. (Applies both when linear=FALSE and when linear=TRUE.)

‘KPEN’ Optional argument to specify the constant used in deciding the optimal continuization parameter. Default is 0.

‘wpen’ An argument denoting at which point the derivatives in the second part of the penalty function should be evaluated. Default is 1/4.

‘linear’ Optional logical argument denoting if only a linear equating is to be performed. Default is FALSE.

‘irtx’, ‘irty’ Optional arguments to provide matrices of probabilities to answer correctly to the questions on the parallel tests X and Y, as estimated in an Item Response Theory (IRT) model.

‘smoothed’ A logical argument denoting if the data provided are pre-smoothed or not. Default is TRUE.

‘kernel’ A character vector indicating which kernel to use, either "gaussian", "logistic", "stdgaussian" or "uniform". Default is "gaussian".

‘slog’ The parameter used in defining the logistic kernel. Default is 1.

‘bunif’ The parameter used in defining the uniform kernel. Default is 0.5.

‘altopt’ Logical which sets the bandwidth parameter equal to a variant of Silverman's rule of thumb. Default is FALSE.

‘DS’ Logical which enables bandwidth selection with the double smoothing method.

‘CV’ Logical which enables bandwidth selection with the cross-validation method.

Value

Kequate returns an S4 object of class 'keout' which includes the following slots (accessed by using the get functions):

Cr

The C-matrix from the log-linear model of test X on population P. (EG design only)

Cs

The C-matrix from the log-linear model of test Y on population Q. (EG design only)

Cp

The C-matrix from the log-linear model of tests X and Y or X and A on population P. (SG/NEAT CE/NEAT PSE/NEC designs only)

Cq

The C-matrix from the log-linear model of tests X and Y or X and A on population Q. (NEAT CE/NEAT PSE/NEC designs only)

SEEvect

An object of class SEEvect consisting of matrices containing the standard error vectors for the equatings. If linear=TRUE, then only the standard error vectors for the linear case are included.

Pest

The estimated probability matrix over population P.

Pobs

The observed probability matrix over population P.

Qest

The estimated probability matrix over population Q.

Qobs

The observed probability matrix over population Q.

scores

A list containing the score vectors for the tests to be equated and, in a NEAT CE design, the score vector of the anchor test. Also included are the estimated score probabilities and the continuized cumulative distribution functions for the respective tests.

linear

A logical vector. TRUE if linear=TRUE was specified, otherwise FALSE.

PRE

A data frame containing the percent relative error in the ten first moments between the equated scores and the reference distribution. (For chain equating, the PRE is calculated for the linking from X to A and the linking from A to Y.)

h

A data frame containing the continuization parameters used in the equating.

kernel

A character vector denoting the kernel used.

type

A character vector describing the design used.

equating

A data frame containing the equated values from X to Y and the associated standard errors (for either an equipercentile or a linear equating), as well as the SEED between the equipercentile and linear equating functions and the equated values and the associated standard errors in the linear case (if an equipercentile equating is conducted).

Author(s)

bjorn.andersson@statistik.uu.se
kenny.branberg@stat.umu.se
marie.wiberg@stat.umu.se

References

Andersson, B., Branberg, K., and Wiberg, M. (2013). Performing the Kernel Method of Test Equating with the Package kequate. Journal of Statistical Software, 55(6), 1–25. <doi:10.18637/jss.v055.i06>

von Davier, A.A., Holland, P.W., Thayer, D.T. (2004). The Kernel Method of Test Equating. Springer-Verlag New York.

See Also

glm,kefreq

Examples

#EG toy example with different kernels
P<-c(5, 20, 35, 25, 15)
Q<-c(10, 30, 30, 20, 10)
x<-0:4
glmx<-glm(P~I(x)+I(x^2), family="poisson", x=TRUE)
glmy<-glm(Q~I(x)+I(x^2), family="poisson", x=TRUE)
keEG<-kequate("EG", 0:4, 0:4, glmx, glmy)
keEGlog<-kequate("EG", 0:4, 0:4, glmx, glmy, kernel="logistic", slog=sqrt(3)/pi)
keEGuni<-kequate("EG", 0:4, 0:4, glmx, glmy, kernel="uniform", bunif=sqrt(3))
plot(keEG)

## Not run: 
#NEAT example using simulated data
data(simeq)
freq1 <- kefreq(simeq$bivar1$X, 0:20, simeq$bivar1$A, 0:10)
freq2 <- kefreq(simeq$bivar2$Y, 0:20, simeq$bivar2$A, 0:10)
glm1<-glm(frequency~I(X)+I(X^2)+I(X^3)+I(X^4)+I(X^5)+I(A)+I(A^2)+I(A^3)+I(A^4)+
I(A):I(X)+I(A):I(X^2)+I(A^2):I(X)+I(A^2):I(X^2), family="poisson", data=freq1, x=TRUE)
glm2<-glm(frequency~I(X)+I(X^2)+I(A)+I(A^2)+I(A^3)+I(A^4)+I(A):I(X)+I(A):I(X^2)+
I(A^2):I(X)+I(A^2):I(X^2), family="poisson", data=freq2, x=TRUE)
keNEATPSE <- kequate("NEAT_PSE", 0:20, 0:20, glm1, glm2)
keNEATCE <- kequate("NEAT_CE", 0:20, 0:20, 0:10, glm1, glm2)
summary(keNEATPSE)
summary(keNEATCE)

#IRT observed-score equating
keNEATCEirt <- kequate("NEAT_CE", 0:20, 0:20, 0:10, glm1, glm2, irtx=simeq$irtNEATx, 
irty=simeq$irtNEATy)
getEquating(keNEATCEirt)

## End(Not run)

kequate documentation built on April 13, 2022, 9:06 a.m.