Mlpack

_2024-09-17_

* Distribute STB headers as part of R package (3724, 3726).

* Added OpenMP parallelization to Hamerly, Naive, and Elkan k-means (3761, 3762, 3764).

* Added OpenMP support for fast approximation (3685).

* Implemented the Find and Fill algorithm into the Dropout Layer and added OpenMP support (3684).

* Update Python bindings to support NumPy 2.x (3752).

* Bump minimum Armadillo version to 10.8 (3760).

* Adapt `NearestInterpolation` ANN layer to new Layer Inteface (3768).

* Add support for arbitrary matrix types to `Radical` and deprecate
`Radical::DoRadical()` in favor of `Radical::Apply()` (3787).

_2024-05-26_

* Add `print_training_accuracy` option to LogisticRegression bindings (3552).

* Fix `preprocess_split()` call in documentation for `LinearRegression` and
`AdaBoost` Python classes (3563).

* Added `Repeat` ANN layer type (3565).

* Remove `round()` implementation for old MSVC compilers (3570).

* (R) Added inline plugin to the R bindings to allow for other R packages to
link to headers (3626, h/t cgiachalis).

* (R) Removed extra gcc-specific options from `Makevars.win` (3627, h/t
kalibera).

* (R) Changed roxygen package-level documentation from using
`docType package` to `"_PACKAGE"`. (3636)

* Fix floating-point accuracy issue for decision trees that sometimes caused
crashes (3595).

* Use templates metaprog to distinguish between a matrix and a cube type
(3602), (3585).

* Use `MatType` instead of `arma::Mat<eT>`, (3567), (3607), (3608),
(3609), (3568).

* Generalize matrix operations for armadillo and bandicoot, (3619), (3617),
(3610), (3643), (3600), (3605), (3629).

* Change `arma::conv_to` to `ConvTo` using a local shim for bandicoot support
(3614).

* Fix a bug for the stddev and mean in `RandNormal()` (3651).

* Allow PCA to take different matrix types (3677).

* Fix usage of precompiled headers; remove cotire (3635).

* Fix non-working `verbose` option for R bindings (3691), and add global
`mlpack.verbose` option (3706).

* Fix divide-by-zero edge case for LARS (3701).

* Templatize `SparseCoding` and `LocalCoordinateCoding` to allow different
matrix types (3709, 3711).

* Fix handling of unused atoms in `LocalCoordinateCoding` (3711).

* Move minimum required C++ version from C++14 to C++17 (3704).

_2023-11-27_

* Fix include ordering issue for `LinearRegression` (3541).

* Fix L1 regularization in case where weight is zero (3545).

* Use HTTPS for all auto-downloaded dependencies (3550).

* More robust detection of C++17 mode in the MSVC "compiler" (3555, 3557).

* Fix setting number of classes correctly in `SoftmaxRegression::Train()`
(3553).

* Adapt `MultiheadAttention` and `LayerNorm` ANN layers to new Layer interface
(3547).

* Fix inconsistent use of the "input" parameter to the Backward method in ANNs
(3551).

* Allow passing weak learner hyperparameters directly to AdaBoost (3560).

_2023-09-05_

* Reinforcement Learning: Gaussian noise (3515).

* Reinforcement Learning: Twin Delayed Deep Deterministic Policy Gradient
(3512).

* Reinforcement Learning: Ornstein-Uhlenbeck noise (3499).

* Reinforcement Learning: Deep Deterministic Policy Gradient (3494).

* Add `ClassProbabilities()` member to `DecisionTree` so that the internal
details of trees can be more easily inspected (3511).

* Bipolar sigmoid activation function added and invertible functions
fixed (3506).

* Add auto-configured `mlpack/config.hpp` to contain configuration details of
mlpack that are required at compile time. STB detection is now done in this
file with the `MLPACK_HAS_STB` macro (3519).

* Fix CRAN package alias for R bindings (3543).

_2023-06-14_

* Adapt `C_ReLU`, `ReLU6`, `FlexibleReLU` layers for the new neural network
API (3445).

* Fix PReLU, add integration test to it (3473).

* Fix bug in LogSoftMax derivative (3469).

* Add `serialize` method to `GaussianInitialization`,
`LecunNormalInitialization`,
`KathirvalavakumarSubavathiInitialization`, `NguyenWidrowInitialization`,
and `OrthogonalInitialization` (3483).

* Allow categorical features to `preprocess_one_hot_encode` (3487).

* Install mlpack and cereal headers as part of R package (3488).

* Add intercept and normalization support to LARS (3493).

* Allow adding two features simultaneously to LARS models (3493).

* Adapt FTSwish activation function (3485).

* Adapt Hyper-Sinh activation function (3491).

_2023-04-26_

* Adapt HardTanH layer (3454).

* Adapt Softmin layer for new neural network API (3437).

* Adapt PReLU layer for new neural network API (3420).

* Add CF decomposition methods: `QUIC_SVDPolicy` and `BlockKrylovSVDPolicy`
(3413, 3404).

* Update outdated code in tutorials (3398, 3401).

* Bugfix for non-square convolution kernels (3376).

* Fix a few missing includes in `<mlpack.hpp>` (3374).

* Fix DBSCAN handling of non-core points (3346).

* Avoid deprecation warnings in Armadillo 11.4.4+ (3405).

* Issue runtime error when serialization of neural networks is attempted but
`MLPACK_ENABLE_ANN_SERIALIZATION` is not defined (3451).