Secretflow

- [Feature] Add Silent Vole (malicious version)
- [Bugifx] Multiple bugfixes

**2024-01-09**
- [YACL] v0.4.2
- [Dependency] Bump: Openssl 3.0.12 (experimental)
- [Feature] Add Softspoken OTe (malicious version)
- [API] Refactor entropy source, drbg, and rand; Refine traditional crypto APIs
- [Bugifx] Multiple bugfixes

**2023-11-16**
- [YACL] v0.4.1.1
- [Feature] Init Global Security Parameters for Yacl [WIP: apply security parameter to all algorithms]
- [Feature] Add Softspoken OTe (semi-honest version)
- [Feature] Add Silent Vole [WIP: optimize MpVole and DualEncode]

**2023-10-20**
- [YACL] v0.4.1
- [Feature] Add Sigma-type ZKP Protocols (An unified implementation)
- [Feature] Add ECC Pairing SPI and support to libmcl(ecc, pairing)
- [Feature] Add Multiplication for GF(2^64) and GF(2^128)
- [Bugfix] fix KOS OTe security flaws
- [Feature] Add AVX2 Matrix Transpose

**2023-05-25**
- [YACL] v0.3.3
- [Feature] Add Ferret OTe
- [Feature] Add Gywz OTe (Correlated GGM Tree)
- [Feature] Add KOS OTe (warning: KOS still has potential security flaws)

**2023-02-02**
- [YACL] v0.3.1
- [Feature] Add `dynamic_bitset` for manipulating bit vectors
- [API] RO now can accept multiple inputs
- [API] Add iknp cot api, improve iknp performance
- [Bugfix] Fix Several m1 related bugs

**2022-12-08**
- [YACL] v0.3.0
- [Feature] Add random permutation and correlation-robust hash function
- [Feature] Add OT/OTe benchmark
- [API] Fix randomness implementation
- [API] Re-organize repo layout
- [Bugfix] Fix Random Oralce Usage

**2022-12-01**
- [YACL] v0.2.0
- [API] Rename YASL to YACL
- [API] Re-organize repo layout


CHANGELOGS

> Instrument:
>
> - Add `[Feature]` prefix for new features
> - Add `[Bugfix]` prefix for bug fixes
> - Add `[API]` prefix for API changes

staging
>
> please add your unreleased change here.

20241219

- [SPU] 0.9.3b0 release
- [Improvement] Optimize exponential computation for semi2k (**experimental**)
- [Feature] Add more send/recv actions profiling

20240716

- [SPU] 0.9.2b0 release
- [Feature] Support jax.numpy.bitwise_count
- [Bugfix] Fix jax.numpy.signbit wrong answer with very large input

20240621

- [SPU] 0.9.1b0 release
- [Feature] Add ORAM based dynamic_slice for ABY3
- [Feature] Add Atan2Op support
- [API] Add beaver cache support for semi2k (**experimental**)

20240415

- [Feature] Add minimax approximation for log
- [Feature] Support jax.lax.top_k
- [Feature] Support round to nearest even
- [Improvement] Default log approximation to minmax
- [Improvement] Improve median performance

20240306

- [Feature] Support more generic Torch model inference
- [Improvement] Optimize one-time setup for yacl ot
- [Improvement] Optimize sort performance
- [Infra] Python 3.8 is no longer suppoted
- [Infra] Bump jax minimum version to 0.4.16

20240105

- [Feature] Add Odd-Even Merge Sort to replace the bitonic sort
- [Feature] Add radix sort support for ABY3
- [Feature] Integrate with secretflow/psi
- [Feature] Add Linux aarch64 support
- [Feature] Add equal support for SEMI2K and ABY3
- [Improvement] Optimize sort memory usage
- [Improvement] Improve compatibility with latest Jax
- [Bugfix] Fix compilation cache collision under certain cases
- [Deprecated] macOS 11.x is no longer supported

20231108

- [Bugfix] Fix compatibility with latest Jax
- [Feature] Improve memory efficiency during encode/decode data
- [Feature] Add radix sort support for SEMI2K
- [Feature] Experimental: ABY3 matmul CUDA support
- [Feature] Experimental: Private support under colocated mode
- [Feature] Add yacl ot support for Cheetah

20230906

- [SPU] 0.5.0 release
- [API] Update IO interface to support splitting large data into chunks
- [API] Add intrinsic function support
- [Feature] Add half type support
- [Feature] Add PSI progress report
- [Feature] Add SineOp/CosineOp support
- [Feature] Add complex support

20230705

- [SPU] 0.4.1 release
- [Improvement] Improve tanh performance

20230614

- [SPU] 0.4.0 release
- [Feature] Improve secret dynamic slicing performance
- [Feature] Improve accuracy of tanh approximation
- [Example] Add flax GPT2
- [Example] Add ResNet
- [Bugfix] Fix gen cache in unbalanced psi
- [Bugfix] Fix possible compilation cache collision
- [Improvement] Improve accuracy of mean with large size input
- [Improvement] Improve support of Jax 64bit mode
- [API] Add compiler options

20230406

- [SPU] 0.3.2 release
- [Feature] Add TrustedThirdParty beaver provider for semi2k
- [Feature] Expose ssl/tls options
- [Feature] Add EpsilonOp
- [Feature] Support CaseOp
- [Feature] Improve sort performance
- [Feature] Improve shift performance
- [Feature] Support shift by secret number of bits
- [Feature] Support secret indexing
- [Feature] Add PIR python binding
- [bugfix] Fix boolean ConstantOp
- [bugfix] Fix jnp.median
- [bugfix] Fix jnp.sort on floating point inputs
- [bugfix] Fix secret sort with public payloads
- [3p] Relax TensorFlow version in requirements.txt
- [3p] Move to OpenXLA
- [API] Move C++ API from spu to libspu
- [PSI] Add ecdh-oprf 2-party two stage mode.

20230104

- [SPU] 0.3.1 release
- [API] Add get_var_meta
- [API] Change ValueProto to bytes in Runtime/IO binding API
- [Feature] Add SPU logging
- [Feature] ECDH-PSI supports white box interconnection mode
- [Feature] Various performance improvements
- [Feature] Lift IfOp condition limit
- [bugfix] Fix various crashes
- [3p] Build with Tensorflow 2.11.0
- [3p] Update JAX to 0.4.1

20221116

- [SPU] 0.3.0 release
- [API] Add IR type for frontend compilation
- [Feature] Support SignOp, Expm1Op, DotGeneralOp
- [Feature] Improve convolution performance
- [Feature] Link Send/Recv python binding
- [bugfix] Relax iota type constraint
- [bugfix] Fix type inference for whileOp/dynamicUpdateSliceOp
- [bugfix] Relax clamp type constraint
- [bugfix] Fix NotOp with non-pred integer types

20220905

- [SPU] 0.2.4 release
- [bugfix] Fix Tensorflow example
- [miscs] Performance improvements

20220822

- [SPU] 0.2.1 release
- [Feature] Add compiler cache
- [Feature] Support bc22-pcg psi
- [API] Refactor psi api
- [miscs] Various performance improvements

20220727

- [SPU] 0.1.1 release
- [API] Added rsqrt support
- [bugfix] Fixed some crashes and wrong answers

20220527

- [SPU] 0.1.0 release
- [API] Add exp/log approximation configurations.
- [API] Change SigmoidMode enum value.

20220513

- [SPU] 0.0.10
- [Infra] Set minimum macOS requirements to 11.0
- [Feature] Performance improvements
- [Feature] Support SelectAndScatter.

20220511

- [SPU] 0.0.9 release
- [Feature] Add spu.binding.distributed.
- [API] Expose visibility to ValueProto.
- [bugfix] Fixed several vtype and dtype mismatches.
- [bugfix] Improve multiply accuracy under certain scenarios.
- [bugfix] Ensure dynamic-slice & dynamic-update-slice OOB behavior is aligned with XLA semantics.

20220427

- [SPU] 0.0.8.1 release
- [bugfix] Fix iota type mismatch.

20220425

- [SPU] 0.0.8 release
- [Feature] Add tanh support.
- [bugfix] Fix secret shift wrong answer.

20220424

- [SPU] 0.0.7.1 release
- [bugfix] Fix secret shift.

20220422

- [SPU] 0.0.7 release
- [Feature] Add python simulation module.
- [Feature] Support general sort comparator.
- [Feature] Support remainder operation.
- [Feature] Support arithmetic right shift operation.
- [API] Change DataType definition, support more accurate encoding.

Added

- Added support for P2P mode, no longer need to rely on a trusted third party.
- Added support for {datetime, timestamp} data types, as well as related operations.
- Support using ArrowSQL as a data source for Engine
- Added support for {Limit Cast Mod} operators.

Changed

- Polished document outline.

Added

- Optimize SCQLEngine memory usage, release unused tensors immediately.
- Added warning information to the query result.
- Added support for {LEFT JOIN, RIGHT JOIN, CASE WHEN, IF} operators

Changed

- Speed up GROUP BY with HEU in some scenarios.
- Optimized to support billion-level PSI scenarios.
- Drop GRM from SCQL awareness. We extend the syntax of create user statement and modify the syntax of create table statement.
- Used json string format to configure spu runtime in scdb yaml conf.
- Speed up JOIN, IN with Unbalanced PSI in scenarios with unbalanced data.

Added

- Added support for union operator.
- Added support for reading CSV files as a data source for Engine.
- Added support for using PostgreSQL as a database for Engine.
- Added support for change password with ALTER USER statement.
- Added support for removing table-level and database-level permissions with the REVOKE statement.
- Added support for structured audit log.
- Added support for the float64 data type in the Engine.
- Added the Chinese documentation.

Changed

- Change some description in document.
- Enrich test cases.
- Enhanced support for security protocols of Cheetah and ABY3.
- Optimized GROUP BY logic.
- Optimized execution plan nodes.
- Optimized the execution logic of the runSQL.
- Optimized the three party ccl in join node.

Fixed

- Fixed create database failed [19](https://github.com/secretflow/scql/issues/19).
- Fixed not support group by string[48](https://github.com/secretflow/scql/pull/48).

Added

- SCQL init release


Changelog

All notable changes to this project will be documented in this file.

The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

Types of changes

`Added` for new features.
`Changed` for changes in existing functionality.
`Deprecated` for soon-to-be removed features.
`Removed` for now removed features.
`Fixed` for any bug fixes.
`Security` in case of vulnerabilities.

staging
>
> please add your unreleased change here.

- PPU listen address.


Changelog

All notable changes to this project will be documented in this file.

**2024-05-15**