RSSL: Implementations of Semi-Supervised Learning Approaches for Classification

A collection of implementations of semi-supervised classifiers and methods to evaluate their performance. The package includes implementations of, among others, Implicitly Constrained Learning, Moment Constrained Learning, the Transductive SVM, Manifold regularization, Maximum Contrastive Pessimistic Likelihood estimation, S4VM and WellSVM.

AuthorJesse Krijthe [aut, cre]
Date of publication2016-10-06 19:13:50
MaintainerJesse Krijthe <jkrijthe@gmail.com>
LicenseGPL (>= 2)
Version0.6.1
http://www.github.com/jkrijthe/RSSL

View on CRAN

Man pages

add_missinglabels_mar: Throw out labels at random

adjacency_knn: Calculate knn adjacency matrix

BaseClassifier: Classifier used for enabling shared documenting of parameters

c.CrossValidation: Merge result of cross-validation runs on single datasets into...

clapply: Use mclapply conditional on not being in RStudio

cov_ml: Biased (maximum likelihood) estimate of the covariance matrix

CrossValidationSSL: Cross-validation in semi-supervised setting

decisionvalues-methods: Decision values returned by a classifier for a set of objects

df_to_matrices: Convert data.frame with missing labels to matrices

diabetes: diabetes data for unit testing

EMLeastSquaresClassifier: An Expectation Maximization like approach to Semi-Supervised...

EMLinearDiscriminantClassifier: Semi-Supervised Linear Discriminant Analysis using...

EMNearestMeanClassifier: Semi-Supervised Nearest Mean Classifier using Expectation...

EntropyRegularizedLogisticRegression: Entropy Regularized Logistic Regression

evaluation-measures: Performance measures used in classifier evaluation

find_a_violated_label: Find a violated label

gaussian_kernel: calculated the guassian kernel matrix

generate2ClassGaussian: Generate data from 2 Gaussian distributed classes

generateABA: Generate data from 2 alternating classes

generateCrescentMoon: Generate Crescent Moon dataset

generateFourClusters: Generate Four Clusters dataset

generateParallelPlanes: Generate Parallel planes

generateSlicedCookie: Generate Sliced Cookie dataset

generateSpirals: Generate Intersecting Spirals

generateTwoCircles: Generate data from 2 circles

geom_classifier: Plot RSSL classifier boundary (deprecated)

geom_linearclassifier: Plot linear RSSL classifier boundary

GRFClassifier: Label propagation using Gaussian Random Fields and Harmonic...

harmonic_function: Direct R Translation of Xiaojin Zhu's Matlab code to...

ICLeastSquaresClassifier: Implicitly Constrained Least Squares Classifier

ICLinearDiscriminantClassifier: Implicitly Constrained Semi-supervised Linear Discriminant...

KernelICLeastSquaresClassifier: Kernelized Implicitly Constrained Least Squares...

KernelLeastSquaresClassifier: Kernelized Least Squares Classifier

LaplacianKernelLeastSquaresClassifier: Laplacian Regularized Least Squares Classifier

LaplacianSVM: Laplacian SVM classifier

LearningCurveSSL: Compute Semi-Supervised Learning Curve

LeastSquaresClassifier: Least Squares Classifier

LinearDiscriminantClassifier: Linear Discriminant Classifier

LinearSVM: Linear SVM Classifier

LinearSVM-class: LinearSVM Class

LinearTSVM: Linear CCCP Transductive SVM classifier

line_coefficients-methods: Loss of a classifier or regression function

localDescent: Local descent

LogisticLossClassifier: Logistic Loss Classifier

LogisticLossClassifier-class: LogisticLossClassifier

LogisticRegression: (Regularized) Logistic Regression implementation

LogisticRegressionFast: Logistic Regression implementation that uses R's glm

logsumexp: Numerically more stable way to calculate log sum exp

losslogsum-methods: LogsumLoss of a classifier or regression function

loss-methods: Loss of a classifier or regression function

losspart-methods: Loss of a classifier or regression function evaluated on...

MajorityClassClassifier: Majority Class Classifier

MCLinearDiscriminantClassifier: Moment Constrained Semi-supervised Linear Discriminant...

MCNearestMeanClassifier: Moment Constrained Semi-supervised Nearest Mean Classifier

MCPLDA: Maximum Contrastive Pessimistic Likelihood Estimation for...

minimaxlda: Implements weighted likelihood estimation for LDA

missing_labels: Access the true labels for the objects with missing labels...

NearestMeanClassifier: Nearest Mean Classifier

plot.CrossValidation: Plot CrossValidation object

plot.LearningCurve: Plot LearningCurve object

posterior-methods: Class Posteriors of a classifier

predict-scaleMatrix-method: Predict for matrix scaling inspired by stdize from the PLS...

PreProcessing: Preprocess the input to a classification function

PreProcessingPredict: Preprocess the input for a new set of test objects for...

print.CrossValidation: Print CrossValidation object

print.LearningCurve: Print LearningCurve object

projection_simplex: project an n-dim vector y to the simplex Dn

QuadraticDiscriminantClassifier: Quadratic Discriminant Classifier

responsibilities-methods: Responsilibities assigned to the unlabeled objects

RSSL: R Semi-Supervised Learning Package

rssl-formatting: Show RSSL classifier

rssl-predict: Predict using RSSL classifier

S4VM: Safe Semi-supervised Support Vector Machine (S4VM)

S4VM-class: LinearSVM Class

sample_k_per_level: Sample k indices per levels from a factor

scaleMatrix: Matrix centering and scaling

SelfLearning: Self-Learning approach to Semi-supervised Learning

solve_svm: SVM solve.QP implementation

split_dataset_ssl: Create Train, Test and Unlabeled Set

split_random: Randomly split dataset in multiple parts

SSLDataFrameToMatrices: Convert data.frame to matrices for semi-supervised learners

stat_classifier: Plot RSSL classifier boundaries

stderror: Calculate the standard error of the mean from a vector of...

summary.CrossValidation: Summary of Crossvalidation results

svdinv: Inverse of a matrix using the singular value decomposition

svdinvsqrtm: Taking the inverse of the square root of the matrix using the...

svdsqrtm: Taking the square root of a matrix using the singular value...

SVM: SVM Classifier

svmlin: svmlin implementation by Sindhwani & Keerthi (2006)

svmlin_example: Test data from the svmlin implementation

svmproblem: Train SVM

testdata: Example semi-supervised problem

threshold: Refine the prediction to satisfy the balance constraint

true_labels: Access the true labels when they are stored as an attribute...

TSVM: Transductive SVM classifier using the convex concave...

USMLeastSquaresClassifier: Updated Second Moment Least Squares Classifier

USMLeastSquaresClassifier-class: USMLeastSquaresClassifier

wdbc: wdbc data for unit testing

WellSVM: WellSVM for Semi-superivsed Learning

wellsvm_direct: wellsvm implements the wellsvm algorithm as shown in [1].

WellSVM_SSL: Convex relaxation of S3VM by label generation

WellSVM_supervised: A degenerated version of WellSVM where the labels are...

wlda: Implements weighted likelihood estimation for LDA

wlda_error: Measures the expected error of the LDA model defined by m, p,...

wlda_loglik: Measures the expected log-likelihood of the LDA model defined...

Functions

add_missinglabels_mar Man page
adjacency_knn Man page
BaseClassifier Man page
c.CrossValidation Man page
clapply Man page
cov_ml Man page
CrossValidationSSL Man page
CrossValidationSSL.list Man page
CrossValidationSSL.matrix Man page
decisionvalues Man page
decisionvalues,KernelLeastSquaresClassifier-method Man page
decisionvalues,LeastSquaresClassifier-method Man page
decisionvalues,LinearSVM-method Man page
decisionvalues,svmlinClassifier-method Man page
decisionvalues,SVM-method Man page
decisionvalues,TSVM-method Man page
decisionvalues,WellSVM-method Man page
df_to_matrices Man page
diabetes Man page
EMLeastSquaresClassifier Man page
EMLinearDiscriminantClassifier Man page
EMNearestMeanClassifier Man page
EntropyRegularizedLogisticRegression Man page
find_a_violated_label Man page
gaussian_kernel Man page
generate2ClassGaussian Man page
generateABA Man page
generateCrescentMoon Man page
generateFourClusters Man page
generateParallelPlanes Man page
generateSlicedCookie Man page
generateSpirals Man page
generateTwoCircles Man page
geom_classifier Man page
geom_linearclassifier Man page
GRFClassifier Man page
harmonic_function Man page
ICLeastSquaresClassifier Man page
ICLinearDiscriminantClassifier Man page
KernelICLeastSquaresClassifier Man page
KernelLeastSquaresClassifier Man page
LaplacianKernelLeastSquaresClassifier Man page
LaplacianSVM Man page
LearningCurveSSL Man page
LearningCurveSSL.matrix Man page
LeastSquaresClassifier Man page
LinearDiscriminantClassifier Man page
LinearSVM Man page
LinearSVM-class Man page
LinearTSVM Man page
line_coefficients Man page
line_coefficients,LeastSquaresClassifier-method Man page
line_coefficients,LinearSVM-method Man page
line_coefficients,LogisticLossClassifier-method Man page
line_coefficients,LogisticRegression-method Man page
line_coefficients,NormalBasedClassifier-method Man page
line_coefficients,QuadraticDiscriminantClassifier-method Man page
line_coefficients,SelfLearning-method Man page
localDescent Man page
LogisticLossClassifier Man page
LogisticLossClassifier-class Man page
LogisticRegression Man page
LogisticRegressionFast Man page
logsumexp Man page
loss Man page
loss,KernelLeastSquaresClassifier-method Man page
loss,LeastSquaresClassifier-method Man page
loss,LinearSVM-method Man page
loss,LogisticLossClassifier-method Man page
loss,LogisticRegression-method Man page
losslogsum Man page
losslogsum,NormalBasedClassifier-method Man page
loss,MajorityClassClassifier-method Man page
loss,NormalBasedClassifier-method Man page
losspart Man page
losspart,NormalBasedClassifier-method Man page
loss,SelfLearning-method Man page
loss,svmlinClassifier-method Man page
loss,SVM-method Man page
loss,USMLeastSquaresClassifier-method Man page
MajorityClassClassifier Man page
MCLinearDiscriminantClassifier Man page
MCNearestMeanClassifier Man page
MCPLDA Man page
measure_accuracy Man page
measure_error Man page
measure_losslab Man page
measure_losstest Man page
measure_losstrain Man page
minimaxlda Man page
missing_labels Man page
NearestMeanClassifier Man page
plot.CrossValidation Man page
plot.LearningCurve Man page
posterior Man page
posterior,NormalBasedClassifier-method Man page
predict,GRFClassifier-method Man page
predict,KernelLeastSquaresClassifier-method Man page
predict,LeastSquaresClassifier-method Man page
predict,LinearSVM-method Man page
predict,LogisticLossClassifier-method Man page
predict,LogisticRegression-method Man page
predict,MajorityClassClassifier-method Man page
predict,NormalBasedClassifier-method Man page
predict,scaleMatrix-method Man page
predict,SelfLearning-method Man page
predict,svmlinClassifier-method Man page
predict,SVM-method Man page
predict,USMLeastSquaresClassifier-method Man page
predict,WellSVM-method Man page
PreProcessing Man page
PreProcessingPredict Man page
print.CrossValidation Man page
print.LearningCurve Man page
projection_simplex Man page
QuadraticDiscriminantClassifier Man page
responsibilities Man page
responsibilities,GRFClassifier-method Man page
RSSL Man page
rssl-formatting Man page
RSSL-package Man page
rssl-predict Man page
S4VM Man page
S4VM-class Man page
sample_k_per_level Man page
scaleMatrix Man page
SelfLearning Man page
show,Classifier-method Man page
show,NormalBasedClassifier-method Man page
show,scaleMatrix-method Man page
solve_svm Man page
split_dataset_ssl Man page
split_random Man page
SSLDataFrameToMatrices Man page
stat_classifier Man page
stderror Man page
summary.CrossValidation Man page
svdinv Man page
svdinvsqrtm Man page
svdsqrtm Man page
SVM Man page
svmlin Man page
svmlin_example Man page
svmproblem Man page
testdata Man page
threshold Man page
true_labels Man page
TSVM Man page
USMLeastSquaresClassifier Man page
USMLeastSquaresClassifier-class Man page
wdbc Man page
WellSVM Man page
wellsvm_direct Man page
WellSVM_SSL Man page
WellSVM_supervised Man page
wlda Man page
wlda_error Man page
wlda_loglik Man page

Files

RSSL
RSSL/inst
RSSL/inst/examples
RSSL/inst/examples/example-LaplacianKernelLeastSquaresClassifier.R
RSSL/inst/examples/example-TSVM.R
RSSL/inst/examples/example-GRFClassifier.R
RSSL/inst/examples/example-WellSVM.R
RSSL/inst/examples/example-LaplacianSVM.R
RSSL/inst/examples/example-KernelLeastSquaresClassifier.R
RSSL/inst/examples/example-S4VM.R
RSSL/inst/examples/example-EntropyRegularizedLogisticRegression.R
RSSL/inst/CITATION
RSSL/inst/doc
RSSL/inst/doc/SSL-Classifiers.Rmd
RSSL/inst/doc/SSL-Classifiers.html
RSSL/inst/doc/SSL-Classifiers.R
RSSL/tests
RSSL/tests/testthat.R
RSSL/tests/testthat
RSSL/tests/testthat/test-USMLeastSquaresClassifier.R
RSSL/tests/testthat/test-S4VM.R
RSSL/tests/testthat/test-GRFClassifier.R
RSSL/tests/testthat/test-MCLinearDiscriminantClassifier.R
RSSL/tests/testthat/test-LaplacianSVM.R
RSSL/tests/testthat/test-SVM.R
RSSL/tests/testthat/test-HelperFunctions.R
RSSL/tests/testthat/test-MCPLDA.R
RSSL/tests/testthat/test-ICLinearDiscriminantClassifier.R
RSSL/tests/testthat/test-LeastSquaresClassifier.R
RSSL/tests/testthat/test-LogisticLossClassifier.R
RSSL/tests/testthat/test-EntropyRegularizedLogisticRegression.R
RSSL/tests/testthat/test-QuadraticDiscriminantClassifier.R
RSSL/tests/testthat/test-MCNearestMeanClassifier.R
RSSL/tests/testthat/test-LearningCurves.R
RSSL/tests/testthat/test-SelfLearning.R
RSSL/tests/testthat/test-LaplacianKernelLeastSquaresClassifier.R
RSSL/tests/testthat/test-LogisticRegression.R
RSSL/tests/testthat/test-TSVM.R
RSSL/tests/testthat/test-KernelLeastSquaresClassifier.R
RSSL/tests/testthat/test-EMLeastSquaresClassifier.R
RSSL/tests/testthat/test-EMNearestMeanClassifier.R
RSSL/tests/testthat/test-svmlin.R
RSSL/tests/testthat/test-ICLeastSquaresClassifier.R
RSSL/tests/testthat/test-GenerateSSLData.R
RSSL/tests/testthat/test-NearestMeanClassifier.R
RSSL/tests/testthat/test-LinearDiscriminantClassifier.R
RSSL/tests/testthat/test-KernelICLeastSquaresClassifier.R
RSSL/tests/testthat/test-WellSVM.R
RSSL/tests/testthat/test-CrossValidation.R
RSSL/src
RSSL/src/Makevars
RSSL/src/GRFClassifier.cpp
RSSL/src/svm.h
RSSL/src/utils.cpp
RSSL/src/Rsvm.c
RSSL/src/svm.cpp
RSSL/src/ssl.h
RSSL/src/Makevars.win
RSSL/src/RcppExports.cpp
RSSL/src/ssl.cpp
RSSL/src/svmlin_rcpp.cpp
RSSL/NAMESPACE
RSSL/data
RSSL/data/diabetes.RData
RSSL/data/wdbc.RData
RSSL/data/testdata.RData
RSSL/data/svmlin_example.RData
RSSL/R
RSSL/R/HelperFunctions.R RSSL/R/SVM.R RSSL/R/NormalBasedClassifier.R RSSL/R/SelfLearning.R RSSL/R/LaplacianSVM.R RSSL/R/EntropyRegularizedLogisticRegression.R RSSL/R/MCLinearDiscriminantClassifier.R RSSL/R/MCNearestMeanClassifier.R RSSL/R/GRFClassifier.R RSSL/R/LearningCurve.R RSSL/R/MCPLDA.R RSSL/R/CrossValidation.R RSSL/R/Evaluate.R RSSL/R/LaplacianKernelLeastSquaresClassifier.R RSSL/R/QuadraticDiscriminantClassifier.R RSSL/R/USMLeastSquaresClassifier.R RSSL/R/S4VM.R RSSL/R/WellSVM.R RSSL/R/LogisticRegression.R RSSL/R/svmlin.R RSSL/R/RSSL.R RSSL/R/TSVM.R RSSL/R/scaleMatrix.R RSSL/R/Measures.R RSSL/R/NearestMeanClassifier.R RSSL/R/LeastSquaresClassifier.R RSSL/R/GenerateSSLData.R RSSL/R/RcppExports.R RSSL/R/svmd.R RSSL/R/Plotting.R RSSL/R/LogisticLossClassifier.R RSSL/R/LinearDiscriminantClassifier.R RSSL/R/EMLeastSquaresClassifier.R RSSL/R/Classifier.R RSSL/R/KernelLeastSquaresClassifier.R RSSL/R/KernelICLeastSquaresClassifier.R RSSL/R/EMLinearDiscriminantClassifier.R RSSL/R/ICLinearDiscriminantClassifier.R RSSL/R/ICLeastSquaresClassifier.R RSSL/R/Generics.R RSSL/R/testdata-data.R RSSL/R/LinearSVM.R RSSL/R/MajorityClassClassifier.R RSSL/R/EMNearestMeanClassifier.R
RSSL/README.md
RSSL/MD5
RSSL/DESCRIPTION
RSSL/man
RSSL/man/USMLeastSquaresClassifier.Rd RSSL/man/TSVM.Rd RSSL/man/LinearSVM.Rd RSSL/man/projection_simplex.Rd RSSL/man/EntropyRegularizedLogisticRegression.Rd RSSL/man/wellsvm_direct.Rd RSSL/man/rssl-formatting.Rd RSSL/man/USMLeastSquaresClassifier-class.Rd RSSL/man/sample_k_per_level.Rd RSSL/man/logsumexp.Rd RSSL/man/LogisticRegression.Rd RSSL/man/threshold.Rd RSSL/man/add_missinglabels_mar.Rd RSSL/man/wlda.Rd RSSL/man/generateABA.Rd RSSL/man/gaussian_kernel.Rd RSSL/man/geom_linearclassifier.Rd RSSL/man/CrossValidationSSL.Rd RSSL/man/generateCrescentMoon.Rd RSSL/man/PreProcessing.Rd RSSL/man/LearningCurveSSL.Rd RSSL/man/EMLinearDiscriminantClassifier.Rd RSSL/man/svmlin.Rd RSSL/man/LeastSquaresClassifier.Rd RSSL/man/adjacency_knn.Rd RSSL/man/KernelICLeastSquaresClassifier.Rd RSSL/man/MajorityClassClassifier.Rd RSSL/man/svdinv.Rd RSSL/man/stat_classifier.Rd RSSL/man/generateTwoCircles.Rd RSSL/man/MCLinearDiscriminantClassifier.Rd RSSL/man/missing_labels.Rd RSSL/man/NearestMeanClassifier.Rd RSSL/man/WellSVM_supervised.Rd RSSL/man/LogisticRegressionFast.Rd RSSL/man/wlda_loglik.Rd RSSL/man/harmonic_function.Rd RSSL/man/ICLinearDiscriminantClassifier.Rd RSSL/man/PreProcessingPredict.Rd RSSL/man/KernelLeastSquaresClassifier.Rd RSSL/man/posterior-methods.Rd RSSL/man/S4VM-class.Rd RSSL/man/svdinvsqrtm.Rd RSSL/man/MCNearestMeanClassifier.Rd RSSL/man/wdbc.Rd RSSL/man/predict-scaleMatrix-method.Rd RSSL/man/scaleMatrix.Rd RSSL/man/stderror.Rd RSSL/man/LinearSVM-class.Rd RSSL/man/summary.CrossValidation.Rd RSSL/man/svmproblem.Rd RSSL/man/ICLeastSquaresClassifier.Rd RSSL/man/solve_svm.Rd RSSL/man/minimaxlda.Rd RSSL/man/print.CrossValidation.Rd RSSL/man/true_labels.Rd RSSL/man/S4VM.Rd RSSL/man/print.LearningCurve.Rd RSSL/man/split_dataset_ssl.Rd RSSL/man/LinearDiscriminantClassifier.Rd RSSL/man/df_to_matrices.Rd RSSL/man/rssl-predict.Rd RSSL/man/responsibilities-methods.Rd RSSL/man/evaluation-measures.Rd RSSL/man/find_a_violated_label.Rd RSSL/man/plot.CrossValidation.Rd RSSL/man/losspart-methods.Rd RSSL/man/clapply.Rd RSSL/man/wlda_error.Rd RSSL/man/loss-methods.Rd RSSL/man/SVM.Rd RSSL/man/decisionvalues-methods.Rd RSSL/man/generateSlicedCookie.Rd RSSL/man/LogisticLossClassifier.Rd RSSL/man/EMLeastSquaresClassifier.Rd RSSL/man/geom_classifier.Rd RSSL/man/losslogsum-methods.Rd RSSL/man/QuadraticDiscriminantClassifier.Rd RSSL/man/BaseClassifier.Rd RSSL/man/localDescent.Rd RSSL/man/generate2ClassGaussian.Rd RSSL/man/testdata.Rd RSSL/man/EMNearestMeanClassifier.Rd RSSL/man/generateSpirals.Rd RSSL/man/LinearTSVM.Rd RSSL/man/GRFClassifier.Rd RSSL/man/plot.LearningCurve.Rd RSSL/man/line_coefficients-methods.Rd RSSL/man/svmlin_example.Rd RSSL/man/LaplacianSVM.Rd RSSL/man/LaplacianKernelLeastSquaresClassifier.Rd RSSL/man/RSSL.Rd RSSL/man/LogisticLossClassifier-class.Rd RSSL/man/diabetes.Rd RSSL/man/cov_ml.Rd RSSL/man/generateFourClusters.Rd RSSL/man/c.CrossValidation.Rd RSSL/man/WellSVM.Rd RSSL/man/SelfLearning.Rd RSSL/man/generateParallelPlanes.Rd RSSL/man/WellSVM_SSL.Rd RSSL/man/MCPLDA.Rd RSSL/man/svdsqrtm.Rd RSSL/man/split_random.Rd RSSL/man/SSLDataFrameToMatrices.Rd

Questions? Problems? Suggestions? or email at ian@mutexlabs.com.

Please suggest features or report bugs with the GitHub issue tracker.

All documentation is copyright its authors; we didn't write any of that.