The lmfit Python library supports provides tools for non-linear least-squares minimization and curve fitting. The goal is to make these optimization algorithms more flexible, more comprehensible, and easier to use well, with the key feature of casting variables in minimization and fitting routines as named parameters that can have many attributes beside just a current value.
LMfit is a pure Python package, built on top of Scipy and Numpy, and so easy to
install with pip install lmfit.
For questions, comments, and suggestions, please use the LMfit google mailing list or Github discussions. For software issues and bugs, use Github Issues, but please read Contributing.md before creating an Issue.
LMfit provides optimization routines similar to (and based on) those from
scipy.optimize, but with a simple, flexible approach to parameterizing a
model for fitting to data using named parameters. These named Parameters can be
held fixed or freely adjusted in the fit, or held between lower and upper
bounds. Parameters can also be constrained as a simple mathematical expression
of other Parameters.
A Parameters object (which acts like a Python dictionary) contains named parameters, and can be built as with:
import lmfit fit_params = lmfit.Parameters() fit_params['amp'] = lmfit.Parameter(value=1.2) fit_params['cen'] = lmfit.Parameter(value=40.0, vary=False) fit_params['wid'] = lmfit.Parameter(value=4, min=0) fit_params['fwhm'] = lmfit.Parameter(expr='wid*2.355')
or using the equivalent:
fit_params = lmfit.create_params(amp=1.2,
cen={'value':40, 'vary':False},
wid={'value': 4, 'min':0},
fwhm={'expr': 'wid*2.355'})
In the general minimization case (see below for Curve-fitting), the user will also write an objective function to be minimized (in the least-squares sense) with its first argument being this Parameters object, and additional positional and keyword arguments as desired:
def myfunc(params, x, data, someflag=True):
amp = params['amp'].value
cen = params['cen'].value
wid = params['wid'].value
...
return residual_array
For each call of this function, the values for the params may have changed,
subject to the bounds and constraint settings for each Parameter. The function
should return the residual (i.e., data-model) array to be minimized.
The advantage here is that the function to be minimized does not have to be changed if different bounds or constraints are placed on the fitting Parameters. The fitting model (as described in myfunc) is instead written in terms of physical parameters of the system, and remains remains independent of what is actually varied in the fit. In addition, which parameters are adjusted and which are fixed happens at run-time, so that changing what is varied and what constraints are placed on the parameters can easily be modified by the user in real-time data analysis.
To perform the fit, the user calls:
result = lmfit.minimize(myfunc, fit_params, args=(x, data), kws={'someflag':True}, ....)
After the fit, a MinimizerResult class is returned that holds the results
the fit (e.g., fitting statistics and optimized parameters). The dictionary
result.params contains the best-fit values, estimated standard deviations,
and correlations with other variables in the fit.
By default, the underlying fit algorithm is the Levenberg-Marquardt algorithm
with numerically-calculated derivatives from MINPACK's lmdif function, as used
by scipy.optimize.leastsq. Most other solvers that are present in scipy
(e.g., Nelder-Mead, differential_evolution, basin-hopping, and more) are also
supported.
One of the most common use of least-squares minimization is for curve fitting,
where minimization of data-model, or (data-model)*weights. Using
lmfit.minimize as above, the objective function would take data and
weights and effectively calculated the model and then return the value of
(data-model)*weights.
To simplify this, and make curve-fitting more flexible, lmfit provides a Model class that wraps a model function that represents the model (without the data or weights). Parameters are then automatically found from the named arguments of the model function. In addition, simple model functions can be readily combined and reused, and several common model functions are included in lmfit.
Lmfit tries to always estimate uncertainties in fitting parameters and
correlations between them. It does this even for those methods where the
corresponding scipy.optimize routines do not estimate uncertainties. Lmfit
also provides methods to explicitly explore and evaluate the confidence
intervals in fit results.
