sigmoidUnit: Sigmoid unit function with unit derivatives.

In darch: Package for Deep Architectures and Restricted Boltzmann Machines

Description

The function calculates the activation and returns a list which the first entry is the result through the sigmoid transfer function and the second entry is the derivative of the transfer function.

Usage

sigmoidUnit(input, ...)

Arguments

input	Input for the activation function.
...	Additional parameters, not used.

Value

A list with the activation in the first entry and the derivative of the transfer function in the second entry.

See Also

Other darch unit functions: exponentialLinearUnit, linearUnit, maxoutUnit, rectifiedLinearUnit, softmaxUnit, softplusUnit, tanhUnit

Examples

## Not run: 
data(iris)
model <- darch(Species ~ ., iris, darch.unitFunction = "sigmoidUnit")

## End(Not run)

Example output

INFO [2017-10-28 03:39:43] The current log level is: INFO
INFO [2017-10-28 03:39:43] Start initial caret pre-processing.
INFO [2017-10-28 03:39:43] Converting non-numeric columns in data (if any)...
INFO [2017-10-28 03:39:43] Converting non-numeric columns in targets (if any)...
INFO [2017-10-28 03:39:43] Dependent factor "Species" converted to 3 new variables (1-of-n coding)
INFO [2017-10-28 03:39:43] The current log level is: INFO
INFO [2017-10-28 03:39:43] Using CPU matrix multiplication.
WARN [2017-10-28 03:39:43] No vector given for "layers" parameter, constructing shallow network with one hidden layer of 10 neurons.
INFO [2017-10-28 03:39:43] Creating and configuring new DArch instance
INFO [2017-10-28 03:39:43] Constructing a network with 3 layers (4, 10, 3 neurons).
INFO [2017-10-28 03:39:43] Generating RBMs.
INFO [2017-10-28 03:39:43] Constructing new RBM instance with 4 visible and 10 hidden units.
INFO [2017-10-28 03:39:43] Constructing new RBM instance with 10 visible and 3 hidden units.
INFO [2017-10-28 03:39:43] DArch instance ready for training, here is a summary of its configuration:
INFO [2017-10-28 03:39:43] Global parameters:
INFO [2017-10-28 03:39:43] Layers parameter was 10, resulted in network with 3 layers and 4, 10, 3 neurons
INFO [2017-10-28 03:39:43] The weights for the layers were generated with "generateWeightsGlorotUniform"
INFO [2017-10-28 03:39:43] Additionally, the following parameters were used for weight generation:
INFO [2017-10-28 03:39:43] [weights] Parameter weights.max is 0.1
INFO [2017-10-28 03:39:43] [weights] Parameter weights.min is -0.1
INFO [2017-10-28 03:39:43] [weights] Parameter weights.mean is 0
INFO [2017-10-28 03:39:43] [weights] Parameter weights.sd is 0.01
INFO [2017-10-28 03:39:43] Weight normalization is disabled
INFO [2017-10-28 03:39:43] Bootstrapping is disabled
INFO [2017-10-28 03:39:43] Train data are shuffled before each epoch
INFO [2017-10-28 03:39:43] Autosaving is disabled
INFO [2017-10-28 03:39:43] Using CPU for matrix multiplication
INFO [2017-10-28 03:39:43] Pre-processing parameters:
INFO [2017-10-28 03:39:43] [preProc] Parameter preProc.factorToNumeric is FALSE
INFO [2017-10-28 03:39:43] [preProc] Parameter preProc.factorToNumeric.targets is FALSE
INFO [2017-10-28 03:39:43] [preProc] Parameter preProc.fullRank is TRUE
INFO [2017-10-28 03:39:43] [preProc] Parameter preProc.fullRank.targets is FALSE
INFO [2017-10-28 03:39:43] [preProc] Parameter preProc.orderedToFactor.targets is TRUE
INFO [2017-10-28 03:39:43] [preProc] Parameter preProc.targets is FALSE
INFO [2017-10-28 03:39:43] Caret pre-processing is disabled
INFO [2017-10-28 03:39:43] Pre-training parameters:
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.allData is FALSE
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.batchSize is 1
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.consecutive is TRUE
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.errorFunction is "mseError"
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.finalMomentum is 0.9
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.initialMomentum is 0.5
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.lastLayer is 0
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.learnRate is 1
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.learnRateScale is 1
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.momentumRampLength is 1
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.numCD is 1
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.numEpochs is 0
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.unitFunction is "sigmoidUnitRbm"
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.updateFunction is "rbmUpdate"
INFO [2017-10-28 03:39:43] [preTrain] Parameter rbm.weightDecay is 2e-04
INFO [2017-10-28 03:39:43] The selected RBMs have been trained for 0 epochs
INFO [2017-10-28 03:39:43] Fine-tuning parameters:
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.batchSize is 1
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.dither is FALSE
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.dropout is 0
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.dropout.dropConnect is FALSE
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.dropout.momentMatching is 0
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.dropout.oneMaskPerEpoch is FALSE
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.elu.alpha is 1
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.errorFunction is "crossEntropyError"
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.finalMomentum is 0.9
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.fineTuneFunction is "backpropagation"
INFO [2017-10-28 03:39:43] [backprop] Using backpropagation for fine-tuning
INFO [2017-10-28 03:39:43] [backprop] Parameter bp.learnRate is c(1, 1)
INFO [2017-10-28 03:39:43] [backprop] Parameter bp.learnRateScale is 1
INFO [2017-10-28 03:39:43] [backprop] See ?backpropagation for documentation
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.initialMomentum is 0.5
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.isClass is TRUE
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.maxout.poolSize is 2
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.maxout.unitFunction is "linearUnit"
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.momentumRampLength is 1
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.nesterovMomentum is TRUE
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.numEpochs is 100
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.returnBestModel is TRUE
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.returnBestModel.validationErrorFactor is 0.632120558828558
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.stopClassErr is -Inf
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.stopErr is -Inf
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.stopValidClassErr is -Inf
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.stopValidErr is -Inf
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.trainLayers is c(TRUE, TRUE)
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.unitFunction is "sigmoidUnit"
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.weightDecay is 0
INFO [2017-10-28 03:39:43] [fineTune] Parameter darch.weightUpdateFunction is "weightDecayWeightUpdate"
INFO [2017-10-28 03:39:43] The network has been fine-tuned for 0 epochs
INFO [2017-10-28 03:39:43] Training set consists of 150 samples.
INFO [2017-10-28 03:39:43] Start deep architecture fine-tuning for 100 epochs
INFO [2017-10-28 03:39:43] Number of Batches: 150 (batch size 1)
INFO [2017-10-28 03:39:43] Epoch:   1 of 100
INFO [2017-10-28 03:39:43] Classification error on Train set: 33.33% (50/150)
INFO [2017-10-28 03:39:43] Train set Cross Entropy error: 1.205
INFO [2017-10-28 03:39:43] Finished epoch   1 of 100 after 0.158 secs (963 patterns/sec)
INFO [2017-10-28 03:39:43] Epoch:   2 of 100
INFO [2017-10-28 03:39:43] Classification error on Train set: 17.33% (26/150)
INFO [2017-10-28 03:39:43] Train set Cross Entropy error: 0.974
INFO [2017-10-28 03:39:43] Finished epoch   2 of 100 after 0.0812 secs (1889 patterns/sec)
INFO [2017-10-28 03:39:43] Epoch:   3 of 100
INFO [2017-10-28 03:39:43] Classification error on Train set: 33.33% (50/150)
INFO [2017-10-28 03:39:43] Train set Cross Entropy error: 0.987
INFO [2017-10-28 03:39:43] Finished epoch   3 of 100 after 0.0573 secs (2698 patterns/sec)
INFO [2017-10-28 03:39:43] Epoch:   4 of 100
INFO [2017-10-28 03:39:43] Classification error on Train set: 10.67% (16/150)
INFO [2017-10-28 03:39:43] Train set Cross Entropy error: 0.927
INFO [2017-10-28 03:39:43] Finished epoch   4 of 100 after 0.0603 secs (2561 patterns/sec)
INFO [2017-10-28 03:39:43] Epoch:   5 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.693
INFO [2017-10-28 03:39:44] Finished epoch   5 of 100 after 0.0607 secs (2545 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:   6 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.656
INFO [2017-10-28 03:39:44] Finished epoch   6 of 100 after 0.0616 secs (2508 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:   7 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.573
INFO [2017-10-28 03:39:44] Finished epoch   7 of 100 after 0.0569 secs (2724 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:   8 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 17.33% (26/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.739
INFO [2017-10-28 03:39:44] Finished epoch   8 of 100 after 0.0603 secs (2561 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:   9 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 13.33% (20/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.612
INFO [2017-10-28 03:39:44] Finished epoch   9 of 100 after 0.0604 secs (2553 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:  10 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.399
INFO [2017-10-28 03:39:44] Finished epoch  10 of 100 after 0.057 secs (2716 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:  11 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 33.33% (50/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.835
INFO [2017-10-28 03:39:44] Finished epoch  11 of 100 after 0.233 secs (648 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:  12 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 26% (39/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.847
INFO [2017-10-28 03:39:44] Finished epoch  12 of 100 after 0.0551 secs (2811 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:  13 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.432
INFO [2017-10-28 03:39:44] Finished epoch  13 of 100 after 0.0599 secs (2590 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:  14 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 21.33% (32/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.755
INFO [2017-10-28 03:39:44] Finished epoch  14 of 100 after 0.104 secs (1479 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:  15 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 1.33% (2/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.518
INFO [2017-10-28 03:39:44] Finished epoch  15 of 100 after 0.0945 secs (1618 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:  16 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 11.33% (17/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.558
INFO [2017-10-28 03:39:44] Finished epoch  16 of 100 after 0.0722 secs (2135 patterns/sec)
INFO [2017-10-28 03:39:44] Epoch:  17 of 100
INFO [2017-10-28 03:39:44] Classification error on Train set: 8% (12/150)
INFO [2017-10-28 03:39:44] Train set Cross Entropy error: 0.495
INFO [2017-10-28 03:39:44] Finished epoch  17 of 100 after 0.0621 secs (2487 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  18 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 4.67% (7/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.324
INFO [2017-10-28 03:39:45] Finished epoch  18 of 100 after 0.0609 secs (2535 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  19 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 11.33% (17/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.537
INFO [2017-10-28 03:39:45] Finished epoch  19 of 100 after 0.0554 secs (2791 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  20 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 4.67% (7/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.335
INFO [2017-10-28 03:39:45] Finished epoch  20 of 100 after 0.0564 secs (2747 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  21 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 16% (24/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.765
INFO [2017-10-28 03:39:45] Finished epoch  21 of 100 after 0.0582 secs (2658 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  22 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 4.67% (7/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.312
INFO [2017-10-28 03:39:45] Finished epoch  22 of 100 after 0.0597 secs (2590 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  23 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.245
INFO [2017-10-28 03:39:45] Finished epoch  23 of 100 after 0.0546 secs (2838 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  24 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 8.67% (13/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.445
INFO [2017-10-28 03:39:45] Finished epoch  24 of 100 after 0.0575 secs (2696 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  25 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 6.67% (10/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.375
INFO [2017-10-28 03:39:45] Finished epoch  25 of 100 after 0.0567 secs (2726 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  26 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 4% (6/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.271
INFO [2017-10-28 03:39:45] Finished epoch  26 of 100 after 0.0601 secs (2569 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  27 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 24% (36/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 1.294
INFO [2017-10-28 03:39:45] Finished epoch  27 of 100 after 0.0571 secs (2706 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  28 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 21.33% (32/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 1.031
INFO [2017-10-28 03:39:45] Finished epoch  28 of 100 after 0.0618 secs (2495 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  29 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 6.67% (10/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.355
INFO [2017-10-28 03:39:45] Finished epoch  29 of 100 after 0.0609 secs (2535 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  30 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.219
INFO [2017-10-28 03:39:45] Finished epoch  30 of 100 after 0.0556 secs (2776 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  31 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 31.33% (47/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 1.258
INFO [2017-10-28 03:39:45] Finished epoch  31 of 100 after 0.0571 secs (2712 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  32 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.246
INFO [2017-10-28 03:39:45] Finished epoch  32 of 100 after 0.0571 secs (2708 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  33 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.289
INFO [2017-10-28 03:39:45] Finished epoch  33 of 100 after 0.0599 secs (2574 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  34 of 100
INFO [2017-10-28 03:39:45] Classification error on Train set: 4.67% (7/150)
INFO [2017-10-28 03:39:45] Train set Cross Entropy error: 0.260
INFO [2017-10-28 03:39:45] Finished epoch  34 of 100 after 0.0565 secs (2736 patterns/sec)
INFO [2017-10-28 03:39:45] Epoch:  35 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 9.33% (14/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.473
INFO [2017-10-28 03:39:46] Finished epoch  35 of 100 after 0.0573 secs (2708 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  36 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.173
INFO [2017-10-28 03:39:46] Finished epoch  36 of 100 after 0.0625 secs (2472 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  37 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 1.33% (2/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.183
INFO [2017-10-28 03:39:46] Finished epoch  37 of 100 after 0.0554 secs (2793 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  38 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.216
INFO [2017-10-28 03:39:46] Finished epoch  38 of 100 after 0.0576 secs (2692 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  39 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 1.33% (2/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.179
INFO [2017-10-28 03:39:46] Finished epoch  39 of 100 after 0.0579 secs (2671 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  40 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 6.67% (10/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.279
INFO [2017-10-28 03:39:46] Finished epoch  40 of 100 after 0.0597 secs (2586 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  41 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 6.67% (10/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.344
INFO [2017-10-28 03:39:46] Finished epoch  41 of 100 after 0.0553 secs (2803 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  42 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 6.67% (10/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.402
INFO [2017-10-28 03:39:46] Finished epoch  42 of 100 after 0.0568 secs (2725 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  43 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 6.67% (10/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.307
INFO [2017-10-28 03:39:46] Finished epoch  43 of 100 after 0.0573 secs (2704 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  44 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 1.33% (2/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.187
INFO [2017-10-28 03:39:46] Finished epoch  44 of 100 after 0.0596 secs (2590 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  45 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 33.33% (50/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 2.912
INFO [2017-10-28 03:39:46] Finished epoch  45 of 100 after 0.0574 secs (2753 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  46 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 4.67% (7/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.281
INFO [2017-10-28 03:39:46] Finished epoch  46 of 100 after 0.0566 secs (2740 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  47 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 5.33% (8/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.232
INFO [2017-10-28 03:39:46] Finished epoch  47 of 100 after 0.0631 secs (2570 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  48 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.224
INFO [2017-10-28 03:39:46] Finished epoch  48 of 100 after 0.0554 secs (2800 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  49 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 8% (12/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.406
INFO [2017-10-28 03:39:46] Finished epoch  49 of 100 after 0.058 secs (2668 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  50 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 5.33% (8/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.308
INFO [2017-10-28 03:39:46] Finished epoch  50 of 100 after 0.0577 secs (2676 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  51 of 100
INFO [2017-10-28 03:39:46] Classification error on Train set: 5.33% (8/150)
INFO [2017-10-28 03:39:46] Train set Cross Entropy error: 0.326
INFO [2017-10-28 03:39:46] Finished epoch  51 of 100 after 0.0594 secs (2603 patterns/sec)
INFO [2017-10-28 03:39:46] Epoch:  52 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.200
INFO [2017-10-28 03:39:47] Finished epoch  52 of 100 after 0.0568 secs (2720 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  53 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.185
INFO [2017-10-28 03:39:47] Finished epoch  53 of 100 after 0.0581 secs (2668 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  54 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 4% (6/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.278
INFO [2017-10-28 03:39:47] Finished epoch  54 of 100 after 0.0605 secs (2557 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  55 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.189
INFO [2017-10-28 03:39:47] Finished epoch  55 of 100 after 0.0556 secs (2783 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  56 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.181
INFO [2017-10-28 03:39:47] Finished epoch  56 of 100 after 0.0577 secs (2684 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  57 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 6% (9/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.295
INFO [2017-10-28 03:39:47] Finished epoch  57 of 100 after 0.0586 secs (2649 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  58 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.179
INFO [2017-10-28 03:39:47] Finished epoch  58 of 100 after 0.0602 secs (2564 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  59 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 4.67% (7/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.284
INFO [2017-10-28 03:39:47] Finished epoch  59 of 100 after 0.0556 secs (2786 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  60 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 1.33% (2/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.172
INFO [2017-10-28 03:39:47] Finished epoch  60 of 100 after 0.0587 secs (2637 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  61 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 21.33% (32/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 1.376
INFO [2017-10-28 03:39:47] Finished epoch  61 of 100 after 0.0571 secs (2713 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  62 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 8.67% (13/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.357
INFO [2017-10-28 03:39:47] Finished epoch  62 of 100 after 0.0606 secs (2550 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  63 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 6% (9/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.305
INFO [2017-10-28 03:39:47] Finished epoch  63 of 100 after 0.057 secs (2713 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  64 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.199
INFO [2017-10-28 03:39:47] Finished epoch  64 of 100 after 0.0581 secs (2665 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  65 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.190
INFO [2017-10-28 03:39:47] Finished epoch  65 of 100 after 0.0605 secs (2551 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  66 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 6.67% (10/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.304
INFO [2017-10-28 03:39:47] Finished epoch  66 of 100 after 0.0606 secs (2548 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  67 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.161
INFO [2017-10-28 03:39:47] Finished epoch  67 of 100 after 0.058 secs (2666 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  68 of 100
INFO [2017-10-28 03:39:47] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:47] Train set Cross Entropy error: 0.183
INFO [2017-10-28 03:39:47] Finished epoch  68 of 100 after 0.0576 secs (2685 patterns/sec)
INFO [2017-10-28 03:39:47] Epoch:  69 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.211
INFO [2017-10-28 03:39:48] Finished epoch  69 of 100 after 0.0599 secs (2581 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  70 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.181
INFO [2017-10-28 03:39:48] Finished epoch  70 of 100 after 0.0563 secs (2749 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  71 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.167
INFO [2017-10-28 03:39:48] Finished epoch  71 of 100 after 0.058 secs (2663 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  72 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 1.33% (2/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.177
INFO [2017-10-28 03:39:48] Finished epoch  72 of 100 after 0.061 secs (2535 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  73 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 5.33% (8/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.295
INFO [2017-10-28 03:39:48] Finished epoch  73 of 100 after 0.0554 secs (2796 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  74 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 1.33% (2/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.225
INFO [2017-10-28 03:39:48] Finished epoch  74 of 100 after 0.0572 secs (2711 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  75 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.189
INFO [2017-10-28 03:39:48] Finished epoch  75 of 100 after 0.0585 secs (2642 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  76 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 5.33% (8/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.243
INFO [2017-10-28 03:39:48] Finished epoch  76 of 100 after 0.06 secs (2575 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  77 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.199
INFO [2017-10-28 03:39:48] Finished epoch  77 of 100 after 0.0574 secs (2691 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  78 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.182
INFO [2017-10-28 03:39:48] Finished epoch  78 of 100 after 0.0591 secs (2625 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  79 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 4.67% (7/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.289
INFO [2017-10-28 03:39:48] Finished epoch  79 of 100 after 0.062 secs (2488 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  80 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 6% (9/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.297
INFO [2017-10-28 03:39:48] Finished epoch  80 of 100 after 0.0609 secs (2540 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  81 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.154
INFO [2017-10-28 03:39:48] Finished epoch  81 of 100 after 0.0584 secs (2647 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  82 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 8.67% (13/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.399
INFO [2017-10-28 03:39:48] Finished epoch  82 of 100 after 0.0595 secs (2597 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  83 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 6.67% (10/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.339
INFO [2017-10-28 03:39:48] Finished epoch  83 of 100 after 0.0629 secs (2455 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  84 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 1.33% (2/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.225
INFO [2017-10-28 03:39:48] Finished epoch  84 of 100 after 0.0582 secs (2659 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  85 of 100
INFO [2017-10-28 03:39:48] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:48] Train set Cross Entropy error: 0.185
INFO [2017-10-28 03:39:48] Finished epoch  85 of 100 after 0.0594 secs (2607 patterns/sec)
INFO [2017-10-28 03:39:48] Epoch:  86 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.181
INFO [2017-10-28 03:39:49] Finished epoch  86 of 100 after 0.0595 secs (2603 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  87 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 4.67% (7/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.272
INFO [2017-10-28 03:39:49] Finished epoch  87 of 100 after 0.0622 secs (2486 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  88 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.224
INFO [2017-10-28 03:39:49] Finished epoch  88 of 100 after 0.0583 secs (2655 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  89 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.205
INFO [2017-10-28 03:39:49] Finished epoch  89 of 100 after 0.0598 secs (2590 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  90 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.242
INFO [2017-10-28 03:39:49] Finished epoch  90 of 100 after 0.0633 secs (2436 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  91 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 4% (6/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.238
INFO [2017-10-28 03:39:49] Finished epoch  91 of 100 after 0.0578 secs (2679 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  92 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 1.33% (2/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.173
INFO [2017-10-28 03:39:49] Finished epoch  92 of 100 after 0.059 secs (2628 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  93 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 5.33% (8/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.207
INFO [2017-10-28 03:39:49] Finished epoch  93 of 100 after 0.0594 secs (2603 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  94 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.199
INFO [2017-10-28 03:39:49] Finished epoch  94 of 100 after 0.0625 secs (2469 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  95 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 5.33% (8/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.346
INFO [2017-10-28 03:39:49] Finished epoch  95 of 100 after 0.0587 secs (2634 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  96 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 4% (6/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.254
INFO [2017-10-28 03:39:49] Finished epoch  96 of 100 after 0.0595 secs (2596 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  97 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 2% (3/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.151
INFO [2017-10-28 03:39:49] Finished epoch  97 of 100 after 0.063 secs (2449 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  98 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 5.33% (8/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.232
INFO [2017-10-28 03:39:49] Finished epoch  98 of 100 after 0.0576 secs (2687 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch:  99 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 2.67% (4/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.181
INFO [2017-10-28 03:39:49] Finished epoch  99 of 100 after 0.062 secs (2493 patterns/sec)
INFO [2017-10-28 03:39:49] Epoch: 100 of 100
INFO [2017-10-28 03:39:49] Classification error on Train set: 3.33% (5/150)
INFO [2017-10-28 03:39:49] Train set Cross Entropy error: 0.206
INFO [2017-10-28 03:39:49] Finished epoch 100 of 100 after 0.0587 secs (2641 patterns/sec)
INFO [2017-10-28 03:39:49] Classification error on Train set (best model): 1.33% (2/150)
INFO [2017-10-28 03:39:49] Train set (best model) Cross Entropy error: 0.172
INFO [2017-10-28 03:39:49] Best model was found after epoch 60
INFO [2017-10-28 03:39:49] Fine-tuning finished after 6.295 secs
Warning message:
system call failed: Cannot allocate memory 

darch documentation built on May 29, 2017, 8:14 p.m.