Dataset's cleaning

Description

A function to eliminate rows and columns that have a percentage of missing values greater than the allowed tolerance.

Usage

1
clean(w, tol.col = 0.5, tol.row = 0.3, name = "")

Arguments

w

the dataset to be examined and cleaned

tol.col

maximum ratio of missing values allowed in columns. The default value is 0.5. Columns with a larger ratio of missing will be eliminated unless they are known to be relevant attributes.

tol.row

maximum ratio of missing values allowed in rows. The default value is 0.3. Rows with a ratio of missing that is larger that the established tolerance will be eliminated.

name

name of the dataset to be used for the optional report

Details

This function can create an optional report on the cleaning process if the comment symbols are removed from the last lines of code. The report is returned to the workspace, where it can be reexamined as needed. The report object's name begins with: Clean.rep.

Value

w

the original dataset, with missing values that were in relevant variables imputed

Author(s)

Caroline Rodriguez

References

Acuna, E. and Rodriguez, C. (2004). The treatment of missing values and its effect in the classifier accuracy. In D. Banks, L. House, F.R. McMorris, P. Arabie, W. Gaul (Eds). Classification, Clustering and Data Mining Applications. Springer-Verlag Berlin-Heidelberg, 639-648.

See Also

ce.impute

Examples

1
2
3
#-----Dataset cleaning-----
data(hepatitis)
hepa.cl=clean(hepatitis,0.5,0.3,name="hepatitis-clean")

Want to suggest features or report bugs for rdrr.io? Use the GitHub issue tracker.