Chia-blockchain

What's Changed

Fixed

- Fixed light wallet (wallet only) syncing issues introduced in 2.4.0

Known Issues

- A breaking backwards compatibility issue was introduced in 2.4.0 in the daemon RPC call `add_private_key`. We expect to resolve this in a future release.
- You cannot import or use a 12-word mnemonic key with 2.4.0 or 2.4.1. To import and use a 12-word mnemonic key we recommend you use 2.3.1. This will be resolved in a future release

Deprecated

macOS 11 (Big Sur) is deprecated. This release (2.4.1) will be the last release to support macOS 11

What's Changed

Added

- Soft fork 5: disallow infinity G1 points as public keys in `AGG_SIG_*` conditions
- DL: Added support for updating multiple datastores in a single batch update
- Add unfinished block to state change event (thanks felixbrucker)
- CHIP-0026 Mempool Updates
- Preliminary support for observer mode. Ability to add public keys via CLI

Changed

- Remove `tx_records` from `dl_update_multiple` RPC (breaking change)
- DL: optimizations for autoinsert and upsert
- Increase farmer fill rate to 70%
- Use Rust types for `RecentChainData`, `ProofBlockHeader` and `WeightProof`
- Use Rust version of `MerkleSet`
- Remove unused files
- Make a couple of DAOWallet methods return lists of transaction records
- Simplify `MerkleSet` by making it immutable
- Add ability to profile the farmer process
- Remove unused current_inner from PoolState
- Optimize `launcher_id_to_p2_puzzle_hash()`
- Add genesis challenge to `get_network_info` RPC
- Puzzle hash optimizations
- Optimize key derivation in the wallet
- Add optional trusted CIDR list
- Make `BLSCache` a proper class
- Split capabilities for each service
- Use kv compressed in DL batch update
- Updated gui to `electron 30.0.9`
- Bump `chia_rs` to `0.9.0` and update G1Element handling
- Bump `boto3` to `1.34.114`
- Bump `chiabip158` to `1.5.1`
- Bump `clvm` to `0.9.10`
- Bump `aiohttp` to `3.9.4`
- Bump `filelock` to `3.14.0`
- Bump `importlib-resources` to `6.4.0`
- Bump `keyring` to `25.1.0`
- Bump `dnspython` to `2.6.1`
- Bump `typing-extensions` to `4.11.0`,
- Bump `packaging` to `24.0`
- Bump `hsms` to `0.3.1`,

Fixed

- Add bytes type to `DerivationRecord.pubkey`
- Do not return unexpected coins from `get_coin_state`
- Fix memo plotid
- Filter out duplicate coins returned by `RequestPuzzleState`
- fix confusion between prompt and don't prompt in the plotnft CLI
- drop deprecated `authentication_public_key` from pool config
- Fixed some typos (thanks wersfeds)
- Make sure to use no more than 61 cpus on windows (fixes 17967)
- Handle reorgs in data layer wallet
- Modify `VerifiedCredential.launch` to handle multiple source coins
- Add tx_config and extra_conditions to DID creation endpoint
- DL: Return exception and error from `get_kv_diff` when either of the hashes has no data
- Link trade cancellations with announcements
- Add coin id index to coin state batching
- Remove homebrew rpaths from `_ssl.cpython.so` on macOS during build (fixes 18099)
- Aligned `lerna` and `nx` versions
- Set permissions in DEB `postinst.sh` for chrome-sandbox (fixes 17956)

Deprecated

macOS 11 (Big Sur) is deprecated. This release (2.4.0) will be the last release to support macOS 11

Added

- Added `warp.green` CATs (`wUSDC.b`, `wmilliETH.b`, `wUSDC`, `wmilliETH`, `wUSDT`) to the known CAT list

Fixed

- Fixed `Install.ps1` for PowerShell 7.4
- Fixed readability of `Could not find parent coin` error log by printing hex and not bytes
- Fixed some shutdown log spam by ensuring signal objects for signal handlers (fixes 17578)
- Fixed negative plot sync durations not crashing the harvester (fixes 15027) (thanks felixbrucker)
- Fixed log spam by only logging warnings about protocol mismatches for farmer and harvester
- Fixed log spam by logging rollbacks only if heights are actually deleted
- Fixed DID update metadata issue (fixes 17412)
- Fixed error codes and add more test coverage for message conditions
- Fixed non-development source install
- Fixed reorg from 0
- Fixed (again) Datalayer download banning
- Improved timelord skip peak logic.
- Used click.Path for make_offer command filename (fixes 10920)
- Handle when xch_target_address in config doesn't decode correctly (fixes 16995)
- Delete unconfirmed Clawback TX
- tighten up the check for duplicate UnfinishedBlocks before requesting that block
- Optimized Datalayer `get_key_by_node`
- Added test for observance of melted CAT balance (fixes 17727)
- increase backwards compatibility by using default values for peer file path
- Added `--skip-keyring` option to `chia start` and use in GUI (fixes 17848)

Added

- Added Python 3.12 support
- Added new subscription and wallet sync protocol support (will be used by the wallet in future releases)
- Added Chip-25 Message Conditions support (https://github.com/Chia-Network/chips/pull/98)
- Added support for HTTP redirect for the pool url (thanks felixbrucker)
- Added `use_delta_sync` option for faster wallet sync (thanks felixbrucker)
- Added Datalayer RPC pagination.
- Added Datalayer multiple batch updates with `submit_on_chain` option.
- Added `get_network_info` RPC to daemon
- Added `new_unfinished_block2` support in Chia seeder
- Added Hint support for SpendSim

Changed

- Transition `FullBlock`, `BlockRecord`, `CoinSpend`, and `HeaderBlock` to rust
- Move tests - all tests and infrastructure are now included in the chia-blockchain package under `chia/_tests`
- Remove `Announcement` class in favor of `Condition` subclasses
- Remove `ignore_max_send_amount`
- Use `psutil.cpu_affinity()` instead of `os.cpu_count()`
- Stop automatic transaction pushing by wallets
- Unify transaction pushing
- For testing purposes added support for non-ssl rpc clients
- Return TXs from CATWallet and Offer creation
- Remove all install.sh code that installs python and leave it to the user to install separately
- Remove old `unhashable` special case in `Streamable`
- Optimize `validate_removals()`
- Remove support for migrating peers from legacy file format
- Set unique peer filenames when swapping to/from testnets
- Cleaner cli output for rpc client fetch errors
- Optimized Datalayer subscription handling by using a `QueuedAsyncPool` for `DataLayer.periodically_manage_data()`
- Update README.md links for wiki & faq sunset
- Update README formatting and links (thanks bknox83)
- Turned concatenation of strings to f-strings (thanks eukub)
- Remove dead code in `multiprocess_validation`
- Improve logging of the height-to-hash and sub-epoch-summaries cache
- Pass full version in `Handshake` (thanks felixbrucker)
- Separate protocol versions for full_node, farmer, harvester, wallet
- Optimized v1 to v2 DB upgrade
- Datalayer: Avoid manage data loop delay for self subscriptions
- Datalayer: Don't download DAT files that are already on disk
- Datalayer: `get_proof` optimizations - use get_ancestors_optimized
- Datalayer: Optimize insert/upsert/delete by using `get_node_by_key`
- Datalayer: stop using fee config setting and remove from initial config
- Datalayer: Optimize clean_node_table's query and speedup by leveraging relaxed foreign_keys
- Enabled compression for cli rpm
- Bump `chia_rs` to `0.6.1`
- Bump `clvm_tools` to `0.4.9`
- Bump `chiavdf` to `1.1.4`
- Bump `chiapos` to `2.0.4`
- Bump `clvm` to `0.9.9`
- Bump `aiohttp` to `3.9.2`
- Bump `anyio` to `4.3.0`
- Bump `boto3` to `1.34.46`
- Bump `aiosqlite` to `0.20.0`
- Bump `colorlog` to `6.8.2`
- Bump `cryptography` to `42.0.5`
- Bump `keyring` to `24.3.1`
- Bump `dnspython` to `2.5.0`
- Bump `watchdog` to `4.0.0`
- Bump `dnslib` to `0.9.24`
- Bump `typing-extensions` to `4.10.0`

Known Issues

- Please be aware that logging at `DEBUG` log level may log your local keyring passphrase to the log file. Note this is **not** your key mnemonic.

Fixed

- Fixed issue with finding bladebit and madmax plotters in CLI and GUI (thanks nanofarmer)
- Fixed issue with banning peers due to incorrect `INVALID_TRANSACTIONS_FILTER_HASH` and `INVALID_BLOCK_COST` log errors (17620)

- Thanks to bhorvitz for major help debugging a performance issue during coin DB lookup

Fixed

- Fix TX amount calculation in trade manager (fixes 16842)
- Subscribe to DIDs that come into wallet (fixes 17242)
- Remove duplicate short option from make_offer command (fixes 17371)
- add `SerializedProgram.to()` to simplify some code
- include information for `setuptools_scm` in git archives
- fix type mismatch with `Optional[bytes]` and `bytes` in `wallet/conditions.py`
- fixed typo in `get_coin_record_by_name` docstring (thanks Abakrombie)
- Fixed readme links (thanks Abakrombie)
- DL: Don't allow mirrors with empty urls (fixes 16920)
- DL: Improve input for CLI `add_missing_files` (fixes 17039)
- DL: Use unsubscribe queue to relax subscriptions lock
- DL: Use Datalayer banning logic for HTTP download failures
- extend the mempool tests for timelocks, and improve error codes
- extend measured sizes for plot check with value for larger K sizes (thanks neurosis69)
- Add a few missing type annotations
- Log string header_hash on long validation warnings
- Fix sorted for dictionary keys of both bytes/xch
- Fixed an issue where `chia wallet did transfer` command mistreats the type of `fee`
- Fix signage point message for remote harvesters with large numbers of pools
- undo BlockRecord cache insert, when DB fails
- Warn if running `install-plotter.sh` as root

Added

- Support for third-party, farmer-rewarded, Harvesters (Chip-22)
- Singleton fast forward
- Verify p2 delegated conditions signatures and add a new SigningMode for Tangem cards (thanks MarvinQuevedo)
- DL: add upsert action
- DL: Add support for generating and verifying DataLayer Proofs of Inclusions `get_proof` and `verify_proof`
- Improve transparency of what full nodes are doing and where they spend their time with additional Mempool logging
- add feature to profile just the block validation
- Add `--override` flag to `make_offer`
- Add full node RPC `get_aggsig_additional_data` to get the aggsig additional data
- Add fork height & rolled_back_records to block event for metrics
- extend Block validation timing logs to measure just the CLVM and conditions
- Add support for defining a list of full node peers to connect to (thanks felixbrucker)
- Add preliminary support for getting coin states in batches
- improve mempool reorg logic when the peak is a non-transaction block
- Add `additions` and `removals` to `get_offer_summary` API response (thanks mikehw)
- improve handling of `UnfinishedBlock`s
- Add testnet11 constants to config if missing when configuring to run on testnet
- We have added several new translations in this release. Thanks to WNFT, advlive, hezoushe

Changed

- reorg optimizations
- bump `chia_rs` to `0.4.1`
- initiate phasing out of the `coin_solutions` name in JSON structs
- slight simplification to `get_min_fee_rate()`
- Remove `coin_solutions` from `SpendBundle` entirely
- use rust types for `VDFInfo`, `VDFProof` and `ClassgroupElement`
- evict entries continuously from `seen_unfinished_blocks`
- move `tools/legacy_keyring.py` to `chia/legacy/keyring.py`
- Rust `proof-of-space`, `reward chain` and `foliage` types
- DL: Compress `get_keys_values` output by hash.
- replace hardcoded value for `db_readers` (thanks neurosis69)
- use rust types for `slots`, `SubEpochSummary` and `SubEpochData`
- Update default testnet to testnet11
- remove old work-around for a bug in version `1.1.4` and earlier
- use rust implementation of `SerializedProgram`
- Rework block fill logic to fill blocks with more SpendBundles (transactions)
- fix typo in logging
- increase farmer block fill rate to 60%
- Force the use of `coin_puzzle_hash` index to `get_unspent_lineage_info_for_puzzle_hash`