fcDerivative5: Products of first derivatives multiplied to products of first...
In mgoulet847/tagi: Tractable Approximate Gaussian Inference in Neural Networks

This function calculates mean of product of derivatives, when new product term involves product of two first derivatives (wdwd) from the same layer multiplied to product of two first derivatives (wdwd) from next and second next layers.

fcDerivative5(
  mw,
  Sw,
  mwo,
  mao,
  mai,
  mdao,
  mdai,
  Sdai,
  mpdo,
  mpdi,
  mdgo,
  mdgo2,
  Cdowdi,
  acto,
  acti,
  ni,
  no,
  no2,
  B,
  dlayer
)

`mw`	Mean vector of weights for the current layer
`Sw`	Covariance of weights for the current layer
`mwo`	Mean vector of weights for the next layer
`mao`	Mean vector of activation units from next layer
`mai`	Mean vector of activation units from current layer
`mdao`	Mean vector of activation units' first derivative from next layer
`mdai`	Mean vector of activation units' first derivative from current layer
`Sdai`	Covariance of activation units' first derivative from current layer
`mpdo`	Mean vector of first derivative product wd of next layer
`mpdi`	Mean vector of first derivative product wd of current layer
`mdgo`	Mean vector of product of derivatives in next layer
`mdgo2`	Mean vector of product of derivatives in second next layer
`Cdowdi`	Covariance between derivatives from next layer and weights times derivatives from current layer
`acto`	Activation function index for next layer defined by `activationFunIndex`
`acti`	Activation function index for current layer defined by `activationFunIndex`
`ni`	Number of units in current layer
`no`	Number of units in next layer
`no2`	Number of units in second next layer
`B`	Batch size
`dlayer`	TRUE if derivatives will be in respect to current layer