sumt: Sequential Unconstrained Minimization Technique

View source: R/sumt.R

sumtR Documentation

Sequential Unconstrained Minimization Technique


Solve constrained optimization problems via the Sequential Unconstrained Minimization Technique (SUMT).


sumt(x0, L, P, grad_L = NULL, grad_P = NULL, method = NULL,
     eps = NULL, q = NULL, verbose = NULL, control = list())



a list of starting values, or a single starting value.


a function to minimize.


a non-negative penalty function such that P(x) is zero iff the constraints are satisfied.


a function giving the gradient of L, or NULL (default).


a function giving the gradient of P, or NULL (default).


a character string, or NULL. If not given, "CG" is used. If equal to "nlm", minimization is carried out using nlm. Otherwise, optim is used with method as the given method.


the absolute convergence tolerance. The algorithm stops if the (maximum) distance between successive x values is less than eps.

Defaults to sqrt(.Machine$double.eps).


a double greater than one controlling the growth of the ρ_k as described in Details.

Defaults to 10.


a logical indicating whether to provide some output on minimization progress.

Defaults to getOption("verbose").


a list of control parameters to be passed to the minimization routine in case optim is used.


The Sequential Unconstrained Minimization Technique is a heuristic for constrained optimization. To minimize a function L subject to constraints, one employs a non-negative function P penalizing violations of the constraints, such that P(x) is zero iff x satisfies the constraints. One iteratively minimizes L(x) + ρ_k P(x), where the ρ values are increased according to the rule ρ_{k+1} = q ρ_k for some constant q > 1, until convergence is obtained in the sense that the Euclidean distance between successive solutions x_k and x_{k+1} is small enough. Note that the “solution” x obtained does not necessarily satisfy the constraints, i.e., has zero P(x). Note also that there is no guarantee that global (approximately) constrained optima are found. Standard practice would recommend to use the best solution found in “sufficiently many” replications of the algorithm.

The unconstrained minimizations are carried out by either optim or nlm, using analytic gradients if both grad_L and grad_P are given, and numeric ones otherwise.

If more than one starting value is given, the solution with the minimal augmented criterion function value is returned.


A list inheriting from class "sumt", with components x, L, P, and rho giving the solution obtained, the value of the criterion and penalty function at x, and the final ρ value used in the augmented criterion function.


A. V. Fiacco and G. P. McCormick (1968). Nonlinear programming: Sequential unconstrained minimization techniques. New York: John Wiley & Sons.

clue documentation built on Nov. 19, 2022, 5:05 p.m.