U3: U3, ZU3 person-fit statistics

In PerFit: Person Fit

Description

van der Flier's U3 and ZU3 person-fit statistics.

Usage

U3(matrix,
   NA.method = "Pairwise", Save.MatImp = FALSE, 
   IP = NULL, IRT.PModel = "2PL", Ability = NULL, Ability.PModel = "ML",
   mu = 0, sigma = 1)

ZU3(matrix,
    NA.method = "Pairwise", Save.MatImp = FALSE, 
    IP = NULL, IRT.PModel = "2PL", Ability = NULL, Ability.PModel = "ML",
    mu = 0, sigma = 1)

Arguments

matrix	Data matrix of dichotomous item scores: Persons as rows, items as columns, item scores are either 0 or 1, missing values allowed.
NA.method	Method to deal with missing values. The default is pairwise elimination ("Pairwise"). Alternatively, simple imputation methods are also available. The options available are "Hotdeck", "NPModel" (default), and "PModel".
Save.MatImp	Logical. Save (imputted) data matrix to file? Default is FALSE.
IP	Matrix with previously estimated item parameters: One row per item, and three columns ([,1] item discrimination; [,2] item difficulty; [,3] lower-asymptote, also referred to as pseudo-guessing parameter). In case no item parameters are available then IP=NULL.
IRT.PModel	Specify the IRT model to use in order to estimate the item parameters (only if IP=NULL). The options available are "1PL", "2PL" (default), and "3PL".
Ability	Vector with previoulsy estimated latent ability parameters, one per respondent, following the order of the row index of matrix. In case no ability parameters are available then Ability=NULL.
Ability.PModel	Specify the method to use in order to estimate the latent ability parameters (only if Ability=NULL). The options available are "ML" (default), "BM", and "WL".
mu	Mean of the apriori distribution. Only used when method="BM". Default is 0.
sigma	Standard deviation of the apriori distribution. Only used when method="BM". Default is 1.

Details

Suppose the items are ordered in decreasing proportion-correct score, p1>p2>...>pI (I = number of items). Given response vector (X1,X2,...,XI) with total score S=sum(Xi; i=1,...,I), van der Flier (1980, 1982) defined the U3 statistic as

[sum(pi; i=1,...,S) - sum(pi; i=1,...,I)] / [sum(pi; i=1,...,S) - sum(pi; i=I-S+1,...,I)].

U3 varies from 0 for perfect Guttman response vectors (i.e., with only the easiest items correct) through 1 for reversed Guttman response vectors (i.e., with only the hardest items correct). Hence, increasingly large U3 values provide stronger indications of answering misfit.

U3 scores are dependent on the number-correct score, hence van der Flier proposed ZU3 as a standardization (formulas to compute E(U3) and Var(U3) can be found in van der Flier, 1982). ZU3 is supposed to be asymptotically approximated by the standard normal distribution, but this approximation is not without problems (see Emons, Meijer, and Sijtsma, 2002).

Missing values in matrix are dealt with by means of pairwise elimination by default. Alternatively, single imputation is also available. Three single imputation methods exist: Hotdeck imputation (NA.method = "Hotdeck"), nonparametric model imputation (NA.method = "NPModel"), and parametric model imputation (NA.method = "PModel"); see Zhang and Walker (2008).

• Hotdeck imputation replaces missing responses of an examinee ('recipient') by item scores from the examinee which is closest to the recipient ('donor'), based on the recipient's nonmissing item scores. The similarity between nonmissing item scores of recipients and donors is based on the sum of absolute differences between the corresponding item scores. The donor's response pattern is deemed to be the most similar to the recipient's response pattern in the group, so item scores of the former are used to replace the corresponding missing values of the latter. When multiple donors are equidistant to a recipient, one donor is randomly drawn from the set of all donors.

• The nonparametric model imputation method is similar to the hotdeck imputation, but item scores are generated from Bernoulli distributions with probabilities defined by donors with similar total score than the recipient (based on all items except the NAs).

• The parametric model imputation method is similar to the hotdeck imputation, but item scores are generated from Bernoulli distributions with probabilities estimated by means of parametric IRT models (IRT.PModel = "1PL", "2PL", or "3PL"). Item parameters (IP) and ability parameters (Ability) may be provided for this purpose (otherwise the algorithm finds estimates for these parameters).

Value

An object of class "PerFit", which is a list with 12 elements:

PFscores	A list of length N (number of respondents) with the values of the person-fit statistic.
PFstatistic	The person-fit statistic used.
PerfVects	A message indicating whether perfect response vectors (all-0s or all-1s) were removed from the analysis.
ID.all0s	Row indices of all-0s response vectors removed from the analysis (if applicable).
ID.all1s	Row indices of all-1s response vectors removed from the analysis (if applicable).
matrix	The data matrix after imputation of missing values was performed (if applicable).
Ncat	The number of response categories (2 in this case).
IRT.PModel	The parametric IRT model used in case NA.method="PModel", otherwise NULL.
IP	The Ix3 matrix of estimated item parameters in case NA.method="PModel", otherwise NULL.
Ability.PModel	The method used to estimate abilities in case NA.method="PModel", otherwise NULL.
Ability	The vector of N estimated ability parameters in case NA.method="PModel", otherwise NULL.
NAs.method	The imputation method used (if applicable).

Author(s)

Jorge N. Tendeiro [e-mail]

References

Emons, W. M., Meijer, R. R., and Sijtsma, K. (2002). Comparing simulated and theoretical sampling distributions of the U3 person-fit statistic. Applied Psychological Measurement, 26(1), 88–108.

Karabatsos, G. (2003) Comparing the Aberrant Response Detection Performance of Thirty-Six Person-Fit Statistics. Applied Measurement In Education, 16(4), 277–298.

Meijer, R. R., and Sijtsma, K. (2001) Methodology review: Evaluating person fit. Applied Psychological Measurement, 25(2), 107–135.

van der Flier, H. (1980) Vergelijkbaarheid van individuele testprestaties [Comparability of individual test performance]. Lisse: The Netherlands.

van der Flier, H. (1982) Deviant response patterns and comparability of test scores. Journal of Cross-Cultural Psychology, 13(3), 267–298.

Zhang, B., and Walker, C. M. (2008) Impact of missing data on person-model fit and person trait estimation. Applied Psychological Measurement, 32(6), 466–479.

See Also

U3poly

Examples

# Load the inadequacy scale data (dichotomous item scores):
data(InadequacyData)

# Compute the U3 scores:
U3.out <- U3(InadequacyData)

# Compute the ZU3 scores:
ZU3.out <- ZU3(InadequacyData)

Example output

Loading required package: ltm
Loading required package: MASS
Loading required package: msm
Loading required package: polycor
Loading required package: mirt
Loading required package: stats4
Loading required package: lattice

Attaching package: 'mirt'

The following object is masked from 'package:ltm':

    Science

Warning message:
no DISPLAY variable so Tk is not available 

PerFit documentation built on Oct. 15, 2021, 9:07 a.m.