exponentialLinearUnit: Exponential linear unit (ELU) function with unit derivatives.
In darch: Package for Deep Architectures and Restricted Boltzmann Machines

Description Usage Arguments Value References See Also Examples

The function calculates the activation of the units and returns a list, in which the first entry is the exponential linear activation of the units and the second entry is the derivative of the transfer function.

1 2	exponentialLinearUnit(input, alpha = getParameter(".darch.elu.alpha", 1, ...), ...)

`input`	Input for the activation function.
`alpha`	ELU hyperparameter.
`...`	Additional parameters.

A list with the ELU activation in the first entry and the derivative of the activation in the second entry.

Clevert, Djork-Arne, Thomas Unterthiner, and Sepp Hochreiter (2015). "Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)". In: CoRR abs/1511.07289. URL : http://arxiv.org/abs/1511.07289

Other darch unit functions: linearUnit, maxoutUnit, rectifiedLinearUnit, sigmoidUnit, softmaxUnit, softplusUnit, tanhUnit

## Not run: 
data(iris)
model <- darch(Species ~ ., iris, darch.unitFunction = "exponentialLinearUnit",
 darch.elu.alpha = 2)

## End(Not run)

INFO [2017-10-20 17:18:28] The current log level is: INFO
INFO [2017-10-20 17:18:28] Start initial caret pre-processing.
INFO [2017-10-20 17:18:28] Converting non-numeric columns in data (if any)...
INFO [2017-10-20 17:18:29] Converting non-numeric columns in targets (if any)...
INFO [2017-10-20 17:18:29] Dependent factor "Species" converted to 3 new variables (1-of-n coding)
INFO [2017-10-20 17:18:29] The current log level is: INFO
INFO [2017-10-20 17:18:29] Using CPU matrix multiplication.
WARN [2017-10-20 17:18:29] No vector given for "layers" parameter, constructing shallow network with one hidden layer of 10 neurons.
INFO [2017-10-20 17:18:29] Creating and configuring new DArch instance
INFO [2017-10-20 17:18:29] Constructing a network with 3 layers (4, 10, 3 neurons).
INFO [2017-10-20 17:18:29] Generating RBMs.
INFO [2017-10-20 17:18:29] Constructing new RBM instance with 4 visible and 10 hidden units.
INFO [2017-10-20 17:18:29] Constructing new RBM instance with 10 visible and 3 hidden units.
INFO [2017-10-20 17:18:29] DArch instance ready for training, here is a summary of its configuration:
INFO [2017-10-20 17:18:29] Global parameters:
INFO [2017-10-20 17:18:29] Layers parameter was 10, resulted in network with 3 layers and 4, 10, 3 neurons
INFO [2017-10-20 17:18:29] The weights for the layers were generated with "generateWeightsGlorotUniform"
INFO [2017-10-20 17:18:29] Additionally, the following parameters were used for weight generation:
INFO [2017-10-20 17:18:29] [weights] Parameter weights.max is 0.1
INFO [2017-10-20 17:18:29] [weights] Parameter weights.min is -0.1
INFO [2017-10-20 17:18:29] [weights] Parameter weights.mean is 0
INFO [2017-10-20 17:18:29] [weights] Parameter weights.sd is 0.01
INFO [2017-10-20 17:18:29] Weight normalization is disabled
INFO [2017-10-20 17:18:29] Bootstrapping is disabled
INFO [2017-10-20 17:18:29] Train data are shuffled before each epoch
INFO [2017-10-20 17:18:29] Autosaving is disabled
INFO [2017-10-20 17:18:29] Using CPU for matrix multiplication
INFO [2017-10-20 17:18:29] Pre-processing parameters:
INFO [2017-10-20 17:18:29] [preProc] Parameter preProc.factorToNumeric is FALSE
INFO [2017-10-20 17:18:29] [preProc] Parameter preProc.factorToNumeric.targets is FALSE
INFO [2017-10-20 17:18:29] [preProc] Parameter preProc.fullRank is TRUE
INFO [2017-10-20 17:18:29] [preProc] Parameter preProc.fullRank.targets is FALSE
INFO [2017-10-20 17:18:29] [preProc] Parameter preProc.orderedToFactor.targets is TRUE
INFO [2017-10-20 17:18:29] [preProc] Parameter preProc.targets is FALSE
INFO [2017-10-20 17:18:29] Caret pre-processing is disabled
INFO [2017-10-20 17:18:29] Pre-training parameters:
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.allData is FALSE
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.batchSize is 1
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.consecutive is TRUE
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.errorFunction is "mseError"
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.finalMomentum is 0.9
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.initialMomentum is 0.5
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.lastLayer is 0
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.learnRate is 1
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.learnRateScale is 1
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.momentumRampLength is 1
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.numCD is 1
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.numEpochs is 0
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.unitFunction is "sigmoidUnitRbm"
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.updateFunction is "rbmUpdate"
INFO [2017-10-20 17:18:29] [preTrain] Parameter rbm.weightDecay is 2e-04
INFO [2017-10-20 17:18:29] The selected RBMs have been trained for 0 epochs
INFO [2017-10-20 17:18:29] Fine-tuning parameters:
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.batchSize is 1
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.dither is FALSE
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.dropout is 0
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.dropout.dropConnect is FALSE
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.dropout.momentMatching is 0
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.dropout.oneMaskPerEpoch is FALSE
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.elu.alpha is 2
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.errorFunction is "crossEntropyError"
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.finalMomentum is 0.9
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.fineTuneFunction is "backpropagation"
INFO [2017-10-20 17:18:29] [backprop] Using backpropagation for fine-tuning
INFO [2017-10-20 17:18:29] [backprop] Parameter bp.learnRate is c(1, 1)
INFO [2017-10-20 17:18:29] [backprop] Parameter bp.learnRateScale is 1
INFO [2017-10-20 17:18:29] [backprop] See ?backpropagation for documentation
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.initialMomentum is 0.5
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.isClass is TRUE
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.maxout.poolSize is 2
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.maxout.unitFunction is "linearUnit"
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.momentumRampLength is 1
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.nesterovMomentum is TRUE
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.numEpochs is 100
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.returnBestModel is TRUE
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.returnBestModel.validationErrorFactor is 0.632120558828558
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.stopClassErr is -Inf
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.stopErr is -Inf
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.stopValidClassErr is -Inf
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.stopValidErr is -Inf
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.trainLayers is c(TRUE, TRUE)
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.unitFunction is "exponentialLinearUnit"
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.weightDecay is 0
INFO [2017-10-20 17:18:29] [fineTune] Parameter darch.weightUpdateFunction is "weightDecayWeightUpdate"
INFO [2017-10-20 17:18:29] The network has been fine-tuned for 0 epochs
INFO [2017-10-20 17:18:29] Training set consists of 150 samples.
INFO [2017-10-20 17:18:29] Start deep architecture fine-tuning for 100 epochs
INFO [2017-10-20 17:18:29] Number of Batches: 150 (batch size 1)
INFO [2017-10-20 17:18:29] Epoch:   1 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch   1 of 100 after 0.155 secs (981 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:   2 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch   2 of 100 after 0.0827 secs (1854 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:   3 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch   3 of 100 after 0.0584 secs (2647 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:   4 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch   4 of 100 after 0.0612 secs (2528 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:   5 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch   5 of 100 after 0.0586 secs (2639 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:   6 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch   6 of 100 after 0.0614 secs (2518 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:   7 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch   7 of 100 after 0.0616 secs (2507 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:   8 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch   8 of 100 after 0.0597 secs (2591 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:   9 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch   9 of 100 after 0.0623 secs (2477 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:  10 of 100
INFO [2017-10-20 17:18:29] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:29] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:29] Finished epoch  10 of 100 after 0.0613 secs (2519 patterns/sec)
INFO [2017-10-20 17:18:29] Epoch:  11 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  11 of 100 after 0.234 secs (645 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  12 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  12 of 100 after 0.0576 secs (2688 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  13 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  13 of 100 after 0.0672 secs (2309 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  14 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  14 of 100 after 0.0723 secs (2137 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  15 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  15 of 100 after 0.0621 secs (2486 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  16 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  16 of 100 after 0.0592 secs (2611 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  17 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  17 of 100 after 0.059 secs (2624 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  18 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  18 of 100 after 0.0625 secs (2465 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  19 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  19 of 100 after 0.0618 secs (2494 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  20 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  20 of 100 after 0.0596 secs (2599 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  21 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  21 of 100 after 0.0592 secs (2611 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  22 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  22 of 100 after 0.061 secs (2530 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  23 of 100
INFO [2017-10-20 17:18:30] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:30] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:30] Finished epoch  23 of 100 after 0.0586 secs (2638 patterns/sec)
INFO [2017-10-20 17:18:30] Epoch:  24 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  24 of 100 after 0.0601 secs (2569 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  25 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  25 of 100 after 0.0618 secs (2494 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  26 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  26 of 100 after 0.0584 secs (2657 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  27 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  27 of 100 after 0.0593 secs (2611 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  28 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  28 of 100 after 0.059 secs (2630 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  29 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  29 of 100 after 0.0612 secs (2524 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  30 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  30 of 100 after 0.0597 secs (2596 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  31 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  31 of 100 after 0.0595 secs (2601 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  32 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  32 of 100 after 0.0671 secs (2297 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  33 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  33 of 100 after 0.0592 secs (2613 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  34 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  34 of 100 after 0.0597 secs (2591 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  35 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  35 of 100 after 0.0597 secs (2595 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  36 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  36 of 100 after 0.0624 secs (2473 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  37 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  37 of 100 after 0.06 secs (2585 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  38 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  38 of 100 after 0.0612 secs (2527 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  39 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  39 of 100 after 0.0643 secs (2395 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  40 of 100
INFO [2017-10-20 17:18:31] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:31] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:31] Finished epoch  40 of 100 after 0.0602 secs (2570 patterns/sec)
INFO [2017-10-20 17:18:31] Epoch:  41 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  41 of 100 after 0.0607 secs (2545 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  42 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  42 of 100 after 0.0614 secs (2522 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  43 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  43 of 100 after 0.0634 secs (2435 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  44 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  44 of 100 after 0.0639 secs (2417 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  45 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  45 of 100 after 0.0615 secs (2512 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  46 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  46 of 100 after 0.0641 secs (2404 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  47 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  47 of 100 after 0.0587 secs (2640 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  48 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  48 of 100 after 0.0605 secs (2557 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  49 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  49 of 100 after 0.0605 secs (2557 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  50 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  50 of 100 after 0.0621 secs (2486 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  51 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  51 of 100 after 0.0595 secs (2597 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  52 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  52 of 100 after 0.06 secs (2576 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  53 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  53 of 100 after 0.0641 secs (2407 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  54 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  54 of 100 after 0.0588 secs (2640 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  55 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  55 of 100 after 0.0605 secs (2557 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  56 of 100
INFO [2017-10-20 17:18:32] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:32] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:32] Finished epoch  56 of 100 after 0.0602 secs (2569 patterns/sec)
INFO [2017-10-20 17:18:32] Epoch:  57 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  57 of 100 after 0.0623 secs (2478 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  58 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  58 of 100 after 0.0625 secs (2473 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  59 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  59 of 100 after 0.0603 secs (2569 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  60 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  60 of 100 after 0.0633 secs (2437 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  61 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  61 of 100 after 0.0587 secs (2640 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  62 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  62 of 100 after 0.0599 secs (2586 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  63 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  63 of 100 after 0.0605 secs (2557 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  64 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  64 of 100 after 0.0627 secs (2459 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  65 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  65 of 100 after 0.0594 secs (2602 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  66 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  66 of 100 after 0.0605 secs (2559 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  67 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  67 of 100 after 0.0638 secs (2418 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  68 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  68 of 100 after 0.0586 secs (2639 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  69 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  69 of 100 after 0.0598 secs (2587 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  70 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  70 of 100 after 0.0638 secs (2419 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  71 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  71 of 100 after 0.0625 secs (2472 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  72 of 100
INFO [2017-10-20 17:18:33] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:33] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:33] Finished epoch  72 of 100 after 0.0592 secs (2612 patterns/sec)
INFO [2017-10-20 17:18:33] Epoch:  73 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  73 of 100 after 0.0609 secs (2538 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  74 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  74 of 100 after 0.0633 secs (2442 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  75 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  75 of 100 after 0.0588 secs (2630 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  76 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  76 of 100 after 0.0601 secs (2572 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  77 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  77 of 100 after 0.0605 secs (2561 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  78 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  78 of 100 after 0.0633 secs (2438 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  79 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  79 of 100 after 0.0591 secs (2618 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  80 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  80 of 100 after 0.0603 secs (2564 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  81 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  81 of 100 after 0.0633 secs (2436 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  82 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  82 of 100 after 0.0586 secs (2643 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  83 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  83 of 100 after 0.0631 secs (2449 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  84 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  84 of 100 after 0.0602 secs (2568 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  85 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  85 of 100 after 0.0623 secs (2478 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  86 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  86 of 100 after 0.0598 secs (2587 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  87 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  87 of 100 after 0.0602 secs (2570 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  88 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:34] Finished epoch  88 of 100 after 0.0635 secs (2431 patterns/sec)
INFO [2017-10-20 17:18:34] Epoch:  89 of 100
INFO [2017-10-20 17:18:34] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:34] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  89 of 100 after 0.0589 secs (2626 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  90 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  90 of 100 after 0.0597 secs (2591 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  91 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  91 of 100 after 0.06 secs (2578 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  92 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  92 of 100 after 0.0624 secs (2474 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  93 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  93 of 100 after 0.0589 secs (2626 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  94 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  94 of 100 after 0.0603 secs (2571 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  95 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  95 of 100 after 0.0666 secs (2314 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  96 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  96 of 100 after 0.0583 secs (2655 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  97 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  97 of 100 after 0.0601 secs (2575 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  98 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  98 of 100 after 0.0616 secs (2513 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch:  99 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch  99 of 100 after 0.0623 secs (2481 patterns/sec)
INFO [2017-10-20 17:18:35] Epoch: 100 of 100
INFO [2017-10-20 17:18:35] Classification error on Train set: 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Finished epoch 100 of 100 after 0.0577 secs (2682 patterns/sec)
INFO [2017-10-20 17:18:35] Classification error on Train set (best model): 66.67% (100/150)
INFO [2017-10-20 17:18:35] Train set (best model) Cross Entropy error: 33.846
INFO [2017-10-20 17:18:35] Best model was found after epoch 100
INFO [2017-10-20 17:18:35] Fine-tuning finished after 6.422 secs
Warning message:
system call failed: Cannot allocate memory