Class AbstractLeastSquaresOptimizer
- java.lang.Object
-
- org.apache.commons.math.optimization.general.AbstractLeastSquaresOptimizer
-
- All Implemented Interfaces:
DifferentiableMultivariateVectorialOptimizer
- Direct Known Subclasses:
GaussNewtonOptimizer,LevenbergMarquardtOptimizer
public abstract class AbstractLeastSquaresOptimizer extends java.lang.Object implements DifferentiableMultivariateVectorialOptimizer
Base class for implementing least squares optimizers.This base class handles the boilerplate methods associated to thresholds settings, jacobian and error estimation.
- Since:
- 1.2
- Version:
- $Revision: 1073158 $ $Date: 2011-02-21 22:46:52 +0100 (lun. 21 févr. 2011) $
-
-
Field Summary
Fields Modifier and Type Field Description protected VectorialConvergenceCheckercheckerConvergence checker.protected intcolsNumber of columns of the jacobian matrix.protected doublecostCost value (square root of the sum of the residuals).static intDEFAULT_MAX_ITERATIONSDefault maximal number of iterations allowed.protected double[][]jacobianJacobian matrix.protected double[]objectiveCurrent objective function value.protected double[]pointCurrent point.protected double[]residualsCurrent residuals.protected double[]residualsWeightsWeight for the least squares cost computation.protected introwsNumber of rows of the jacobian matrix.protected double[]targetValuesTarget value for the objective functions at optimum.protected double[][]wjacobianWeighted Jacobianprotected double[]wresidualsWeighted residuals
-
Constructor Summary
Constructors Modifier Constructor Description protectedAbstractLeastSquaresOptimizer()Simple constructor with default settings.
-
Method Summary
All Methods Instance Methods Abstract Methods Concrete Methods Modifier and Type Method Description protected abstract VectorialPointValuePairdoOptimize()Perform the bulk of optimization algorithm.doublegetChiSquare()Get a Chi-Square-like value assuming the N residuals follow N distinct normal distributions centered on 0 and whose variances are the reciprocal of the weights.VectorialConvergenceCheckergetConvergenceChecker()Get the convergence checker.double[][]getCovariances()Get the covariance matrix of optimized parameters.intgetEvaluations()Get the number of evaluations of the objective function.intgetIterations()Get the number of iterations realized by the algorithm.intgetJacobianEvaluations()Get the number of evaluations of the objective function jacobian .intgetMaxEvaluations()Get the maximal number of functions evaluations.intgetMaxIterations()Get the maximal number of iterations of the algorithm.doublegetRMS()Get the Root Mean Square value.double[]guessParametersErrors()Guess the errors in optimized parameters.protected voidincrementIterationsCounter()Increment the iterations counter by 1.VectorialPointValuePairoptimize(DifferentiableMultivariateVectorialFunction f, double[] target, double[] weights, double[] startPoint)Optimizes an objective function.voidsetConvergenceChecker(VectorialConvergenceChecker convergenceChecker)Set the convergence checker.voidsetMaxEvaluations(int maxEvaluations)Set the maximal number of functions evaluations.voidsetMaxIterations(int maxIterations)Set the maximal number of iterations of the algorithm.protected voidupdateJacobian()Update the jacobian matrix.protected voidupdateResidualsAndCost()Update the residuals array and cost function value.
-
-
-
Field Detail
-
DEFAULT_MAX_ITERATIONS
public static final int DEFAULT_MAX_ITERATIONS
Default maximal number of iterations allowed.- See Also:
- Constant Field Values
-
checker
protected VectorialConvergenceChecker checker
Convergence checker.
-
jacobian
protected double[][] jacobian
Jacobian matrix.This matrix is in canonical form just after the calls to
updateJacobian(), but may be modified by the solver in the derived class (theLevenberg-Marquardt optimizerdoes this).
-
cols
protected int cols
Number of columns of the jacobian matrix.
-
rows
protected int rows
Number of rows of the jacobian matrix.
-
targetValues
protected double[] targetValues
Target value for the objective functions at optimum.- Since:
- 2.1
-
residualsWeights
protected double[] residualsWeights
Weight for the least squares cost computation.- Since:
- 2.1
-
point
protected double[] point
Current point.
-
objective
protected double[] objective
Current objective function value.
-
residuals
protected double[] residuals
Current residuals.
-
wjacobian
protected double[][] wjacobian
Weighted Jacobian
-
wresiduals
protected double[] wresiduals
Weighted residuals
-
cost
protected double cost
Cost value (square root of the sum of the residuals).
-
-
Constructor Detail
-
AbstractLeastSquaresOptimizer
protected AbstractLeastSquaresOptimizer()
Simple constructor with default settings.The convergence check is set to a
SimpleVectorialValueCheckerand the maximal number of evaluation is set to its default value.
-
-
Method Detail
-
setMaxIterations
public void setMaxIterations(int maxIterations)
Set the maximal number of iterations of the algorithm.- Specified by:
setMaxIterationsin interfaceDifferentiableMultivariateVectorialOptimizer- Parameters:
maxIterations- maximal number of function calls .
-
getMaxIterations
public int getMaxIterations()
Get the maximal number of iterations of the algorithm.- Specified by:
getMaxIterationsin interfaceDifferentiableMultivariateVectorialOptimizer- Returns:
- maximal number of iterations
-
getIterations
public int getIterations()
Get the number of iterations realized by the algorithm.- Specified by:
getIterationsin interfaceDifferentiableMultivariateVectorialOptimizer- Returns:
- number of iterations
-
setMaxEvaluations
public void setMaxEvaluations(int maxEvaluations)
Set the maximal number of functions evaluations.- Specified by:
setMaxEvaluationsin interfaceDifferentiableMultivariateVectorialOptimizer- Parameters:
maxEvaluations- maximal number of function evaluations
-
getMaxEvaluations
public int getMaxEvaluations()
Get the maximal number of functions evaluations.- Specified by:
getMaxEvaluationsin interfaceDifferentiableMultivariateVectorialOptimizer- Returns:
- maximal number of functions evaluations
-
getEvaluations
public int getEvaluations()
Get the number of evaluations of the objective function.The number of evaluation correspond to the last call to the
optimizemethod. It is 0 if the method has not been called yet.- Specified by:
getEvaluationsin interfaceDifferentiableMultivariateVectorialOptimizer- Returns:
- number of evaluations of the objective function
-
getJacobianEvaluations
public int getJacobianEvaluations()
Get the number of evaluations of the objective function jacobian .The number of evaluation correspond to the last call to the
optimizemethod. It is 0 if the method has not been called yet.- Specified by:
getJacobianEvaluationsin interfaceDifferentiableMultivariateVectorialOptimizer- Returns:
- number of evaluations of the objective function jacobian
-
setConvergenceChecker
public void setConvergenceChecker(VectorialConvergenceChecker convergenceChecker)
Set the convergence checker.- Specified by:
setConvergenceCheckerin interfaceDifferentiableMultivariateVectorialOptimizer- Parameters:
convergenceChecker- object to use to check for convergence
-
getConvergenceChecker
public VectorialConvergenceChecker getConvergenceChecker()
Get the convergence checker.- Specified by:
getConvergenceCheckerin interfaceDifferentiableMultivariateVectorialOptimizer- Returns:
- object used to check for convergence
-
incrementIterationsCounter
protected void incrementIterationsCounter() throws OptimizationExceptionIncrement the iterations counter by 1.- Throws:
OptimizationException- if the maximal number of iterations is exceeded
-
updateJacobian
protected void updateJacobian() throws FunctionEvaluationExceptionUpdate the jacobian matrix.- Throws:
FunctionEvaluationException- if the function jacobian cannot be evaluated or its dimension doesn't match problem dimension
-
updateResidualsAndCost
protected void updateResidualsAndCost() throws FunctionEvaluationExceptionUpdate the residuals array and cost function value.- Throws:
FunctionEvaluationException- if the function cannot be evaluated or its dimension doesn't match problem dimension or maximal number of of evaluations is exceeded
-
getRMS
public double getRMS()
Get the Root Mean Square value. Get the Root Mean Square value, i.e. the root of the arithmetic mean of the square of all weighted residuals. This is related to the criterion that is minimized by the optimizer as follows: if c if the criterion, and n is the number of measurements, then the RMS is sqrt (c/n).- Returns:
- RMS value
-
getChiSquare
public double getChiSquare()
Get a Chi-Square-like value assuming the N residuals follow N distinct normal distributions centered on 0 and whose variances are the reciprocal of the weights.- Returns:
- chi-square value
-
getCovariances
public double[][] getCovariances() throws FunctionEvaluationException, OptimizationExceptionGet the covariance matrix of optimized parameters.- Returns:
- covariance matrix
- Throws:
FunctionEvaluationException- if the function jacobian cannot be evaluatedOptimizationException- if the covariance matrix cannot be computed (singular problem)
-
guessParametersErrors
public double[] guessParametersErrors() throws FunctionEvaluationException, OptimizationExceptionGuess the errors in optimized parameters.Guessing is covariance-based, it only gives rough order of magnitude.
- Returns:
- errors in optimized parameters
- Throws:
FunctionEvaluationException- if the function jacobian cannot b evaluatedOptimizationException- if the covariances matrix cannot be computed or the number of degrees of freedom is not positive (number of measurements lesser or equal to number of parameters)
-
optimize
public VectorialPointValuePair optimize(DifferentiableMultivariateVectorialFunction f, double[] target, double[] weights, double[] startPoint) throws FunctionEvaluationException, OptimizationException, java.lang.IllegalArgumentException
Optimizes an objective function.Optimization is considered to be a weighted least-squares minimization. The cost function to be minimized is ∑weighti(objectivei-targeti)2
- Specified by:
optimizein interfaceDifferentiableMultivariateVectorialOptimizer- Parameters:
f- objective functiontarget- target value for the objective functions at optimumweights- weight for the least squares cost computationstartPoint- the start point for optimization- Returns:
- the point/value pair giving the optimal value for objective function
- Throws:
FunctionEvaluationException- if the objective function throws one during the searchOptimizationException- if the algorithm failed to convergejava.lang.IllegalArgumentException- if the start point dimension is wrong
-
doOptimize
protected abstract VectorialPointValuePair doOptimize() throws FunctionEvaluationException, OptimizationException, java.lang.IllegalArgumentException
Perform the bulk of optimization algorithm.- Returns:
- the point/value pair giving the optimal value for objective function
- Throws:
FunctionEvaluationException- if the objective function throws one during the searchOptimizationException- if the algorithm failed to convergejava.lang.IllegalArgumentException- if the start point dimension is wrong
-
-