Cupy

This is the release note of v4.5.0. See [here](https://github.com/cupy/cupy/milestone/36?closed=1) for the complete list of solved issues and merged PRs.

Highlights

This stable update adds scipy 1.0+ support.

Enhancements

- Support SciPy 1.0+ (1588)
- Improve exception handling performance in Cython (1598)
- Fallback to synchronous transfer if pinned memory could not be allocated (1603)
- Improve cudnn.pyx to up speed (1652)

Bug Fixes

- Fix cupy not working in thread other than one imported cupy (1585)
- Reset cuda runtime error (1597)
- Improve exception handling performance in Cython (1598)

Tests

- Add test for thread use case of fusion (1595)
- Fix invalid escape sequence warnings in Python 3.6 (1627)

This is the release note of v4.4.1. See [here](https://github.com/cupy/cupy/milestone/38?closed=1) for the complete list of solved issues and merged PRs.

This is a hot-fix release for v4.4.0 to address the issue reported in 1579 (thanks BobLiu20 for reporting this!). Users calling CuPy functions on non-main threads may have been affected by this issue.

Bug Fixes

- Fix cupy not working in thread other than one imported cupy (1591)

Tests

- Add test for thread use case of fusion (1596)

This is the release note of v4.4.0. See [here](https://github.com/cupy/cupy/milestone/34?closed=1) for the complete list of solved issues and merged PRs.

New Features

- Add `divmod` function to `cupy` namespace (1480)
- Allow more natural fusion notation (1481)

Enhancements

- Avoid `collections.sequence` (1472)
- Support negative indices in `array_split` (1475)
- Avoid variable name `l` to follow pep8 (1479)
- Reduce Python function call in `ElementwiseKernel` (1482)
- Speed up `ElementwiseKernel` launch (1488)
- Improve memory allocation performance (1490)
- Fix type of return value of fused function (1491)
- Support composition of fused functions (1494)
- Add compilation methods in Fusion class (1497)
- Allow `cupy.get_array_module` take fusion parameters (1498)
- Use CScalar in elementwise and reduction (1508)
- Use `collections.abc` to avoid DeprecationWarning in Python 3.7 (1517)
- Fix unit test errors in NumPy 1.15 (1549)

Bug Fixes

- Use `cython.no_gc` to avoid memory leak (1474)
- Fix errors on 0-sized inputs (1485)
- Fix type of reduction (1502)
- Avoid compile error in old GCC (CentOS6) (1516)
- Fix thrust memory allocation problem (1525)
- Fix dtype order of `create_comparison` (1553)
- Raise error when trying to broadcast `out_params` in `ElementwiseKernel` (1556)

Documentation

- Add upgrade guide for `cupyx` namespaces (1496)
- Update agnostic code tutorial (1528, thanks w-m!)

Tests

- Add `.pytest_cache/` to `.gitignore` (1530)
- Avoid hacking: Use the same test settings as Chainer (1536)

Support for ROCm 4.3 has been added in the latest release and binary wheels are provided as well. Note that there is currently an issue with ROCm 4.3 that prevents it from running in several environments. The current workaround is to set the `LLVM_PATH` variable to the llvm folder included in ROCm 4.3 installation (e.g., `export LLVM_PATH=/opt/rocm-4.3/llvm`).

Changes

Enhancements

- Compile with SASS for CUDA versions >= 11.1 (5611)
- Allow to compile using PTX with an envvar (5634)
- Add `ncclAvg` and `ncclBfloat16` for NCCL (5656)
- Fix version check for new ROCm version definition (5661)
- Rest of version check fix for new ROCm version definition (5670)

Bug Fixes

- Fix FFT convolve for shapes containing 1 (5613)
- Fix the RTC call path for HIP (5620)
- Fix compute capability check (5646)
- Fix squareness checks (5652)
- Fix `unique` for empty array (5658)

Code Fixes

- Fix kernel names to be consistent (5625)
- Remove unnecessary comments (5635)

Documentation

- Update Sphinx to 4.1.2 (5616)
- `__array_function__` feature by default (5653)
- Support ROCm v4.3 in document (5674)

Tests

- Increase test timeout (5615)
- Increase timeout for CUDA 11.4 tests (5617)
- Add CI for ROCm 4.3 (5632)
- Reload GPG key for ROCm 4.2 test (5637)
- Fix cubic `for_all_dtypes_combination` tests (5639)
- Add a workaround for ROCm 4.3.0 for testing (5663)
- Fix `skipTest` in `test_decomp_lu` (5672)

Others

- Bump version to v9.4.0 (5680)

Contributors

The CuPy Team would like to thank all those who contributed to this release!

grlee77 leofang yashasvimisra2798

This is the release note of v4.3.0. See [here](https://github.com/cupy/cupy/milestone/31?closed=1) for the complete list of solved issues and merged PRs.

Enhancements

- Improve `reduce_dims` for speed up (1424)
- Remove overhead in `creation/basic.py` (1425)
- Improve performance of host to device memory copy (1426)

Bug Fixes

- Fix to accept longer order names (1395)
- Fix `Module` and `LinkState` not freed (1441)
- Fix error in `PooledMemory` in Python 3.7 (1462)

Documentation

- Fix documentation of the `option` arg of `ElementwiseKernel` (1438)

Installation

- Support bundling dependent DLLs for Windows wheel support (1410)
- Change required Cython version to 0.28 or later (1412)

Tests

- Refactor `TestOrder` (1408)

This is the release note of v4.2.0. See [here](https://github.com/cupy/cupy/milestone/29?closed=1) for the complete list of solved issues and merged PRs.

Highlights

- Allocation strategy of pinned memory has been improved to reduce host memory usage.
- Fixed bugs in multiple functions with arrays with complex dtypes.

Enhancements

- Use cuDNN v7 APIs to get conv algos for TensorCore (1134)
- Fix `cupy.diag` failures for array-likes objects other than CuPy arrays (1235, thanks hyabe!)
- Remove memory copy in the `cupy.diag` function (1337)
- Support weak reference to CuPy array (1359)
- Fix to preserve dtype of an input array in `cupy.linalg.norm` (1376)
- Improve performance of ndarray initialization (1377)
- Round-up pooled memory allocation size with clp2 (1386)
- Reduce GPU memory usage in (de)convotion (1387)
- Support `'f'` and `'c'` in the `order` option of ndarray (1390)

Bug Fixes

- Fix `cupy.matmul` when inputs contain zero-sized array(s) (1238)
- Fix default dtype of `cupy.full` (1257)
- Fix dtype option of `cupy.sum` and `cupy.prod` (1259)
- `sort`, `lexsort`, and `argsort` catch C++ exceptions from Thrust (1290)
- Fix `view` of zero-dim ndarray (1291)
- Fix `real` and `imag` of zero-dim ndarray (1292)
- Support `cupy.expm1`, `cupy.log1p`, `cupy.log2` for complex type (1293)
- Fix unary functions in `cupy.math.misc` to support complex types (1297)
- Fix binary functions in `cupy.math.misc` to support complex types (1298)
- Fix `OutOfMemoryError` raised even when there are sufficient large freeable chunks (1301, thanks hyabe!)
- Fix `astype` for complex dtypes (1302)
- Fix `real`, `imag` of non-contiguous complex ndarray (1306)
- Rounding functions support complex ndarrays (1308)

Documentation

- Update README to encourage use of wheels (1296)
- Add NumPy 1.14 to supported versions (1305)
- Fix typo in sparse matrix docs (1310)
- Force displaying known methods which are mis-recognized as attributes by Sphinx (1314)
- Expand reference on differences in zero-dimensional arrays (1315)
- Split LICENSE file (1326)
- Fix typo in profiler docs (1328)
- Reorganize license files (1335)
- Fix typos in `cupy.zeros` and `cupy.zeros_like` (1360)
- Update requirements for v5.0.0b2 / v4.2 release (1373)

Installation

- Remove deprecated `imp.load_source` in setup.py (1332, thanks vilyaair!)
- Add a license file to wheel (1348)

Tests

- Fix .coveragerc (1212)
- Remove `_multiprocess_can_split_` (1267)