Chik-blockchain

Added

- Added support for NFTs!!! :party:
- Added `chik wallet nft` command (see <https://docs.chiknetwork.com/docs/13cli/did_cli>)
- Added `chik wallet did` command (see <https://docs.chiknetwork.com/docs/12rpcs/nft_rpcs>)
- Added RPCs for DID (see <https://docs.chiknetwork.com/docs/12rpcs/did_rpcs>)
- Added RPCs for NFT (see <https://docs.chiknetwork.com/docs/12rpcs/nft_rpcs>)
- Enable stricter mempool rule when dealing with multiple extra arguments
- Added a retry when loading pool info from a pool at 2 minute intervals
- Added CLI options `--sort-by-height` and –sort-by-relevance` to `chik wallet get_transactions`
- Harvester: Introduce `recursive_plot_scan`
- Add libgmp-dev to Bladebit installation - thanks to TheLastCicada
- Add support for multiple of the same CAT in aggregate offers - Thanks to roseiliend

Changed

- New coin selection algorithm based on bitcoin knapsack. Previously chik selected the largest coin
- Updated chikpos to 1.0.10
- Updated chikvdf to 1.0.6
- Updated blspy to 1.0.13
- Updated setproctitle to 1.2.3
- Updated PyYAML to 6.0
- Updated pyinstaller to 5.0
- Bump klvm_tools_rs version to 0.1.9 for klvm stepper and add a test
- Modest speedup of syncing by batching coin lookups
- Cmds: Use the new `plot_count` of `get_pool_state` in `plotnft show`
- Set mempool size back to the original size at launch
- Plotting|tests|setup: Improve `PlotManager` cache
- Wallet: Drop unused `WalletStateManager.get_derivation_index`
- Harvester: Tweak `get_plots` RPC
- Remove explicit multidict version from setup.py
- Simplify install.sh ubuntu version tracking
- Optimize BLS verification when public key is repeated
- Use Install.ps1 in build_windows.ps1
- Updated warning about `CHIK_ROOT` being set when running init
- Cmds: Adjust stop daemon output
- Remove unused functions on MerkleSet
- Optimize `hash_coin_list()`
- Update CONTRIBUTING.md
- Remove outdated 3.8 upgrade comment
- Hint refactor
- Replace MerkleSet with the rust implementation
- Simplify SizedBytes and StructStream
- Allow services to set a non-default max request body size limit
- Reduce the redundant computations of coin_ids in block_body_validation
- Uses the new `from_bytes_unchecked` method in blspy, to improve perfo…
- Remove the cache from CoinStore
- Keep daemon websocket alive during keyring unlock
- Support searching derived addresses on testnet.
- Optimize code to not perform useless subgroup checks
- Restore missing hints being stored as None (instead of 0-length bytes)
- Coin simplification
- Harvester: Use a set instead of a list to speed up availability checks
- Improved performance of debug log output
- Update plotters installation to include an `apt update` - thanks to TheLastCicada
- Early return from `_set_spent function` - Thanks neurosis69
- Remove redundant condition in `get_coin_records` - Thanks neurosis69
- Write python version error to stderr - thanks to LuaKT

Fixed

- Fixed issues with harvesters not reconnecting properly - fixes 11466
- Return not synced if there are no connections - fixes 12090
- Fix issues with wallet resending transactions on various mempool and node errors - fixes 10873
- Fix some issues with `plotnft show` (11897)
- Handle ephemeral ports and dual stack (ipv4 & ipv6)
- Fix issues when wallet syncing and rolling back too far in the past
- Fixes issues with the Farmer Reward dialog incorrectly reporting there is no private key (11036)
- Fix race condition, blockchain can change between two calls to get_peak
- Wallet: Fix `CATLineageStore` creation in `create_new_cat_wallet`
- Fix incorrect return in "rollback_to_block"
- Wallet: Some rollback fixes
- Fix issue with missing coins
- Fix Newer block issue
- Fix jsonify bool
- Fix wallet introducers for testnet
- Correct wallet CLI sent/received indication
- Correct "Older block not found" error message
- Print MempoolInclusionStatus as string
- Optimize Program.curry()
- Improve detection of disconnected websocket between services
- Correct install.sh usage short options list
- Make sure we set the sync to height correctly when we roll back

Added

- Added Support for Python 3.10
- Performance improvements in harvesters during plot refresh. Large farmers likely no longer need to specify a very high plot refresh interval in config.yaml
- Added CLI only `.rpm` and `.deb` packages to official release channels
- Fixed an issue where some coins would be missing after a full sync
- Enabled paginated plot loading and improved plot state reporting
- Updated the farming GUI tab to fix several bugs
- Fix infinite loop with timelord closing
- Simplified install.sh ubuntu version tracking
- Fixed memory leak on the farm page
- Fixed list of plot files "in progress"
- Various farmer rpc improvements
- Improvements to the harvester `get_plots` RPC

Known Issues

There is a known issue where harvesters will not reconnect to the farmer automatically unless you restart the harvester. This bug was introduced in 1.3.4 and we plan to patch it in a coming release.

Added

- Creating an offer now allows you to edit the exchange between two tokens that will auto calculate either the sending token amount or the receiving token amount
- When making an offer, makers can now create an offer including a fee to help get the transaction into the mempool when an offer is accepted
- Implemented `chik rpc` command
- New RPC `get_coin_records_by_hint` - Get coins for a given hint (Thanks freddiecoleman)
- Add maker fee to remaining offer RPCs
- Add healthcheck endpoint to rpc services
- Optional wallet type parameter for `get_wallets` and `wallet show`
- Add `select_coins` RPC method by (Thanks ftruzzi)
- Added `-n`/`--new-address` option to `chik wallet get_address`
- New DBWrapper supporting concurrent readers
- Added `config.yaml` option to run the `full_node` in single-threaded mode
- Build cli only version of debs
- Add `/get_stray_cats` API for accessing unknown CATs

Changed

- Left navigation bar in the GUI has been reorganized and icons have been updated
- Settings has been moved to the new left hand nav bar
- Token selection has been changed to a permanent column in the GUI instead of the drop down list along
- Manage token option has been added at the bottom of the Token column to all users to show/hide token wallets
- Users can show/hide token wallets. If you have auto-discover cats in config.yaml turned off, new tokens will still show up there, but those wallets won’t get created until the token has been toggled on for the first time
- CATs now have a link to Taildatabase.com to look up the Asset ID
- Ongoing improvements to the internal test framework for speed and reliability.
- Significant harvester protocol update: You will need to update your farmer and all your harvesters as this is a breaking change in the harvester protocol. The new protocol solves many scaling issues. In particular, the protocol supports sending delta changes to the farmer - so for example, adding plots to a farm results in only the new plots being reported. We recommend you update your farmer first.
- Updated klvm_tools to 0.4.4
- Updated klvm_tools_rs to 0.1.7
- Changed code to use by default the Rust implementation of klvm_tools (klvm_tools_rs)
- Consolidated socket library to aiohttp and removed websockets dependency
- During node startup, missing blocks in the DB will throw an exception
- Updated cryptography to 36.0.2
- The rust implementation of KLVM is now called `chik_rs` instead of `klvm_rs`.
- Updated code to use improved rust interface `run_generator2`
- Code improvements to prefer connecting to a local trusted node over untrusted nodes

Fixed

- Fixed issues with claiming self-pool rewards with and without a fee
- Fixed wallet creation in edge cases around chain reorgs
- Harvester: Reuse legacy refresh interval if new params aren't available
- Fixed typos `lastest` > `latest` (Thanks daverof)
- Fixed typo in command line argument parsing for `chik db validate`
- Improved backwards compatibility for node RPC calls `get_blockchain_state` and `get_additions_and_removals`
- Fixed issue where `--root_path` option was not honored by `chik configure` CLI command
- Fixed cases where node DB was not created initially using v2 format
- Improved error messages from `chik db upgrade`
- Capitalized display of `Rpc` -> `RPC` in `chik show -s` by (Thanks hugepants)
- Improved handling of chain reorgs with atomic rollback for the wallet
- Handled cases where one node doesn't have the coin we are looking for
- Fixed timelord installation for Debian
- Checked for requesting items when creating an offer
- Minor output formatting/enhancements for `chik wallet show`
- Fixed typo and index issues in wallet database
- Used the rust klvm version instead of python in more places
- Fixed trailing bytes shown in CAT asset ID row when using `chik wallet show`
- Maintain all chain state during reorg until the new fork has been fully validated
- Improved performance of `get_coin_records_by_names` by using proper index (Thanks roseiliend)
- Improved handling of unknown pending balances
- Improved plot load times

Known Issues

- You cannot install and run chik blockchain using the macOS packaged DMG on macOS Mojave (10.14).
- Pending transactions are not retried correctly and so can be stuck in the pending state unless manually removed and re-submitted

Fixed

- In version 1.3.2 our patch for the OpenSSL vulnerability was not complete for the Windows installer. Thank you xsmolasses of Core-Pool.
- MacOS would not update openssl when installing via `install.sh`
- Some debugging information remained in `install.sh`

Fixed

- Fixed OpenSSL vulnerability CVE-2022-0778

Fixed

- Improved config.yaml update concurrency to prevent some cases of the wrong pool being used for a PlotNFT.
- Fixed `chik keys show` displaying non-observer-derived wallet address.
- Fixed `plotnft claim` returning an error.
- Fixed invalid DB commit that prevented rollback of coin store changes.
- Fixed locking issue with `PlotManager.plots` that caused high lookup times on plots.
- Fixed exception when `chik keys migrate` is run without needing migration.
- Fixed farmer rewards dialog (GUI).
- Fixed display of pool payout address (GUI).
- Fixed display of harvesters status when harvesters are restarted (GUI).
- Fixed wallet RPC `get_offers_count` returning an error when there are no trades (Thanks, dkackman!)
- Fixed spelling of "genrated" (Thanks again, dkackman!)
- Fixed typo "log_maxbytessrotation" in initial-config (skweee made their first contribution!)

Added

- Added checks to ensure wallet address prefixes are either `xck` or `txck`.
- Added a better TLS1.3 check to handle cases where python is using a non-openssl TLS library.

Changed

- Update the database queries for the `block_count_metrics` RPC endpoint to utilize indexes effectively for V2 DBs.
- Several improvements to tests.