RegressionFactory: Expander Functions for Generating Full Gradient and Hessian from Single-Slot and Multi-Slot Base Distributions

The expander functions rely on the mathematics developed for the Hessian-definiteness invariance theorem for linear projection transformations of variables, described in authors' paper, to generate the full, high-dimensional gradient and Hessian from the lower-dimensional derivative objects. This greatly relieves the computational burden of generating the regression-function derivatives, which in turn can be fed into any optimization routine that utilizes such derivatives. The theorem guarantees that Hessian definiteness is preserved, meaning that reasoning about this property can be performed in the low-dimensional space of the base distribution. This is often a much easier task than its equivalent in the full, high-dimensional space. Definiteness of Hessian can be useful in selecting optimization/sampling algorithms such as Newton-Raphson optimization or its sampling equivalent, the Stochastic Newton Sampler. Finally, in addition to being a computational tool, the regression expansion framework is of conceptual value by offering new opportunities to generate novel regression problems.

AuthorAlireza S. Mahani, Mansour T.A. Sharabiani
Date of publication2016-09-08 07:33:43
MaintainerAlireza S. Mahani <alireza.s.mahani@gmail.com>
LicenseGPL (>= 2)
Version0.7.2

View on CRAN

Files in this package

RegressionFactory
RegressionFactory/inst
RegressionFactory/inst/doc
RegressionFactory/inst/doc/RegressionFactory.R
RegressionFactory/inst/doc/RegressionFactory.pdf
RegressionFactory/inst/doc/RegressionFactory.Rnw
RegressionFactory/NAMESPACE
RegressionFactory/R
RegressionFactory/R/utils.R RegressionFactory/R/aaa.R RegressionFactory/R/fbase.1par.R RegressionFactory/R/fbase.2par.R RegressionFactory/R/expanders.R
RegressionFactory/vignettes
RegressionFactory/vignettes/regfac_flow_diagram.pdf
RegressionFactory/vignettes/RegressionFactory.bib
RegressionFactory/vignettes/RegressionFactory.Rnw
RegressionFactory/MD5
RegressionFactory/build
RegressionFactory/build/vignette.rds
RegressionFactory/DESCRIPTION
RegressionFactory/ChangeLog
RegressionFactory/man
RegressionFactory/man/regfac.merge.Rd RegressionFactory/man/fbase2.inverse.gaussian.log.log.Rd RegressionFactory/man/fbase1.binomial.Rd RegressionFactory/man/regfac.expand.1par.Rd RegressionFactory/man/fbase1.exponential.Rd RegressionFactory/man/regfac.expand.2par.Rd RegressionFactory/man/fbase2.gaussian.identity.log.Rd RegressionFactory/man/fbase2.gamma.log.log.Rd RegressionFactory/man/fbase1.geometric.Rd RegressionFactory/man/fbase1.poisson.Rd

Questions? Problems? Suggestions? or email at ian@mutexlabs.com.

All documentation is copyright its authors; we didn't write any of that.