Cupy

This is the release note of v5.3.0. See [here](https://github.com/cupy/cupy/milestone/46?closed=1) for the complete list of solved issues and merged PRs.

New Features
- Add NCCL 2.4 functions (2052)

Enhancements
- Use version interface in NCCL 2.3.4 (2006)
- Fix vector handling (2013)
- Avoid `import numpy` (2054)
- Support Python scalars in `iscomplexobj` (1993)

Performance Improvements
- Improve dictionary operation (2039)

Bug Fixes
- Fix `cupy.random.randint` fail with size zero (1981)
- Call `free_all_blocks` to free CUDA memory (1987)
- Define `__dealloc__` instead of `__del__` for cdef-classes to fix memory leak (2000)
- Fix NCCL version assignment for NCCL < 2.3.4 (2012)
- Fix random generator seed type (2041)

Code Fixes
- Remove duplicate declaration of `cudaMalloc` (2037)

Documentation
- Add `cupy-cuda100` to README (1980)
- Fix README image to use URL (1982)
- Document NumPy 1.16 support (1996)

Tests
- Fix test to support SciPy 1.12 (1971)
- Fix test of `assert_array_list_equal` (2003)
- Fix test with NumPy 1.16.1 (2004)

This is the release note of v5.2.0. See [here](https://github.com/cupy/cupy/milestone/44?closed=1) for the complete list of solved issues and merged PRs.

Highlights

- CuPy now runs without CUDA development headers if you are using CUDA 9.2 or 10.0.
- Improved compatibility with NumPy 1.16.

New Features

- Add `cupyx.scipy.sparse.diags` (1865, thanks grlee77!)
- Support New APIs in cuDNN v7.4.1 (1893)

Enhancements

- Bundle CUDA fp16 headers (1858)
- Support for documenting NCCL interfaces (1868)
- Verbose broadcast failure message (1875)
- Support NumPy arrays as seeds in RandomState (1882, thanks mrocklin!)
- Use item instead of asscalar to support NumPy 1.16 (1895)
- Use LF instead of CR+LF (1920)
- Support NumPy 1.16 (1923)

Performance Improvements

- Fix ufunc performance degradation (1929)

Bug Fixes

- Fix backward of batch normalization (1860)
- Check if cx is None (1863)
- Fix RecursionError bug in conj method of sparse matrix classes (1922, thanks grlee77!)
- Fix ndarray initialization bug (1927)
- Fix `ndim` not using `cdef` (1939)
- Ensure the input to the CUFFT Plan1D class is C contiguous (1964, thanks grlee77!)

Code Fixes

- Clean up `internal.pyx` (`prod`) (1960)

Documentation

- Update docs for newly supported libraries (1855)
- Fix stylecheck installation in contribution guide. (1876, thanks crcrpar!)
- Add memory management documentation (1877)
- Align with the latest numpy docs (1878)
- Rename Code of Conduct filename (1963)

Tests

- Add tests for complex min and max (1859)
- Fix `randint` high value in test for Windows (1902)

Others

- Ignore W503 and W504 (1957)

This is the release note of v5.1.0. See [here](https://github.com/cupy/cupy/milestone/42?closed=1) for the complete list of solved issues and merged PRs.

New Features
- Support comparison operators for complex numbers (1820, thanks themightyoarfish!)
- Add cuDNN RNN high-level API (1821)
- Add cuDNN softmax and pooling interface (1752, 1753)
- Add cuDNN batch normalization interface (1784)


Enhancements
- Add float16 and float64 support for `scatter_add` (1756, thanks uchida!, 1763)
- Code enhancements
- Rename `_make_rnn_workspace` function (1841)
- Make a helper function to get the number of layers in RNN (1844)
- Remove code for CUDA 7.0 / 7.5 and cuDNN v4 (1778)
- Remove unnecessary intermediate data in FP16 `atomicAdd` (1777)
- Fix DropoutStates interface to avoid using cuDNN handle (1796)
- Assume CUDA v8 in cuSPARSE/cuSOLVER check (1782)

Bug Fixes
- Fix error in typecast from fp16 to complex dtype in `cupy.fuse` (1801)
- Fix invalid memory access during reduction whose output is large to exceed 32-bit (1810)
- Fix incorrect cast in element-wise op for float array and complex scalar (1803)

Test
- Workaround for test failure with Python 3.4 + SciPy 0.x + NumPy 0.15 (1738)
- Fix userspace kernel test failure in Windows (1761)
- Fix `PendingDeprecationWarning` when running test against NumPy 1.15 (1762)
- Support skipping tests decorated by condition or parametize (1767)
- Fix test failure of binomial distribution in Windows (1851)

Documentation
- Add code of conduct (1831)
- Improve comparison table (1750)
- Add requirements to build documentation on RTD (1768)
- Add policy on compatibility of random sampling (1771)
- Fix description of `CUDA_PATH` environment variable (1783)
- Indicate alias in comparison table (1794)
- Fix English in `ndarray.nbytes` documentation (1798)
- Add note about `cupy.random.{get_set}_state` (1814)
- Enable intersphinx to cupyx module (1816, thanks grafi-tt!)
- Add 10.0 to supported CUDA versions (1826)
- Add docs about conversion from/to cupy ndarray and sparse (1830)
- Add v7.3 and v7.4 to supported cuDNN versions (1825)

Full support for ROCm 5.0 has been added as of this release. Binary packages are available in PyPI and can be installed with the following command: `pip install cupy-rocm-5-0`

Changes

Enhancements

- Support ROCm 5.0 (6496)
- Support cuSPARSELt 0.2.0 (repost) (6507)
- Update `cupy.array_api` (6550)
- Fix `cupy.copyto` to take NumPy array scalars (6593)
- Fix for supporting ROCm 5.0 (6599)
- Make einsum accept subscripts in numpy int (6516)

Bug Fixes

- Fix error message in `vectorize` (6515)
- Fix `cupy.cumsum` on ROCm 5.0 (6525)
- Fix coo_matrix.diagonal (6533)
- Fix `out` args parser of ufunc (6547)
- Fix `cupy.fill` to properly take zero-dim `cupy.ndarray` (6548)
- Fix cuSPARSELt 0.1.0 support in v10 (6563)
- Fix `may_share_memory` algorithm (6565)
- Avoid using the same kernel from different devices in JIT (6581)
- Fix array creation shape (6592)
- Fix cupy.full and cupy.full_like to make unsafe casting (6595)
- Fix device context management in `MemoryAsyncPool` (6596)

Code Fixes

- mypy: array_api (6552)

Documentation

- Remove description about issues from contribution guide (6542)
- Fix documents for CUDA 11.6 (6543)

Installation

- Remove `CUPY_SETUP_ENABLE_THRUST=0` environment variable (6488)
- Skip appending `--compiler-bindir` if `cl.exe` is already on `PATH` (6514)
- Bump version to v10.3.0 (6602)

Tests

- Ignore warnings from Optuna 3.0 pre-releases (6490)
- Disable CentOS 8 test (6519)
- Add FlexCI projects for Windows (6540)
- Skip `async_malloc` tests on unsupported device (6544)
- CI: Trigger `push` event of FlexCI via GitHub Actions (6554)
- CI: regenerate matrix (6557)
- CI: Fix rule name in dispatcher (6558)
- CI: Fix event name in dispatcher (6559)
- Fix flaky test_inverse_indices_shape (6573)
- Trigger CUDA 11.6 Windows CI when push/pull-request (6578)

Contributors

The CuPy Team would like to thank all those who contributed to this release!

anaruse asi1024 kmaehashi leofang Onkar627 takagi toslunar tushxr16

This is the release note of v5.0.0. See [here](https://github.com/cupy/cupy/milestone/37?closed=1) for the complete list of solved issues and merged PRs.

This release note only covers the difference from v5.0.0rc1; for all highlights and changes, please refer to the release notes of the pre-releases:

These are the release notes for v5.0.0rc1. See [here](https://github.com/cupy/cupy/milestone/35?closed=1) for the complete list of solved issues and merged PRs.

Highlights

- Many routines, esp. for sampling from various distributions, are added.
- We now support SciPy 1.0+.

New Features

- New sampling routines for various distributions
- Multivariate normal distribution (1320)
- Chi-square distribution (1414)
- Gamma distribution (1416, 1616)
- Student’s t distribution (1417)
- Poisson distribution (1418)
- Cauchy distribution (1419)
- Exponential distribution (1420, 1624)
- F distribution (1421)
- Geometric distribution (1422)
- Pareto distribution (1423)
- von Mises distribution (1623)
- Zipf distribution (1634)
- New routines
- Add sparse cholesky decomposition (1075, thanks chengts95!)
- Implement round function (1499)
- Add `cbrt` (1559)
- Add `nan_to_num` (1562)
- Add `erf`, `erfc`, and `erfcx` to `cupyx` (1570)
- Add `ndtr` (1571)
- Add `erfinv` and `erfcinv` (1590)
- Add new APIs for RNN (1572)
- Support complex in `eigh` and `svd` (1518, thanks infrub!)
- Add `cupy.cublas.dgetrfBatched` (1608)
- General support for external memory pointer (1610)
- Add `cupy.cublas.dgetriBatched` (1617)

Enhancements

- Improve exception handling performance in Cython (919)
- Improve `cudnn.pyx` to up speed (1378)
- Improve `take` function (1505)
- Improve view method performance (1543)
- Split `core.pyx` to improve maintainability (1550)
- Improve memory pool performance (1544)
- Make `ElementwiseKernel` emit immutable `in_params` (1554)
- Use bit operation when the divisor is a power of 2 on GPU (1555)
- Use cuBLAS 9.1+ algorithm names (1561)
- Improve error messages for complex arguments of bessel functions (1569)
- Support SciPy 1.0+ (1573)
- Fix result dtypes of special functions (1577)
- Improve usability of special functions (1578)
- Improve readability of reduction kernel (only python) (1580)
- Fallback to synchronous transfer if pinned memory could not be allocated (1593)
- Unify fusion (1599)
- Add `strides` option in `cupy.ndarray` (1611)
- Fix laplace distribution (1645)

Bug Fixes

- Fix invalid exception propagation in `getDropoutReserveSpaceSize` (919, 1344)
- Fix CuPy not working in thread other than one imported CuPy (1581)
- Reset cuda runtime error (1592)
- Fix `cupy.random.standard_exponential` bug (1642)
- Support non-tuple size in random distribution generators (1648)
- Fix `random.exponential` (1649)

Documentation

- Add documentation to sqrt (1560)
- Add interoperability docs (1565)
- Fix docstring of modified bessel function (1567)
- Add comparison table generator (1582)
- Support cuDNN v7.2 (1584)
- Update contribution guide to align with Chainer's one (1604)
- Rename `my_sum` to `my_add` in docs (1612)

Tests

- Import `scipy.special` to use it in test (1568)
- Use `assertIsNone` in `test_interpolation.py` (1587)
- Add test for thread use case of fusion (1589)
- Test reproducibility for any seed (1613)
- Fix invalid escape sequence warnings in Python 3.6 (1619)
- Improve boundary tests of `erfinv` (1646)

Others

- Fix around style checking (1605)