Nsz

- Resolved title-intaller compatibility with python-zstandard versions later than 0.15.2. NSZ files compressed with modern zstd versions are confirmed to work on the latest Tinfoil, DBI, AtmoXL and TinWoo. Some abandoned title-installer who havn't updated will still be broken. See 120 (_zstandard versions newer than 0.15.2 break compatibility with all title installers except DBI_) for more information.
- Fixed a mistake in the FileExistingChecks code caused by specifying the wrong target file extension when calling CreateTargetDict. This fixes 123 (XCZ Source File Deleted before decompressing on the same output folder as original)
- Fixed NSP and resulting NSZ will be deleted using --rm-source when solid compression fails. This fixes 124 (_NSP and resulting NSZ will be deleted using --rm-source when solid compression fails_)
- Added crc32 hash of master_key_0e. Thanks to 16BitWonder for adding it!
- Implemented option to enable zStandard long distance mode for even better compression as requested in 117 (_Add support for the zStandard long distance mode_)
- Followed the python-zstandard author's feedback regarding flushing to fix all flushing related imperfections
- Fixed "'Counter' object has no attribute 'write'" error when using --create. This fixes 118 (_--create is broken_)
- Implemented directory expansion support for --create and improved documentation. This closes 119 (_The syntax for --create is stupid and the documentation bad_)
- Clarified the plaintext rule of the NSZ file format block compression extension as discussed in 120

After almost 2 years there finally is a new stable release of NSZ! Sorry that it took so long. I will do stable releases more often in the future.

**This version doesn't enforce the use of zstandard v0.15.2 - Please update your title-installer to the latest version to ensure it is compatible. Tinfoil, DBI, AtmoXL and TinWoo are confirmed to work. Some abandoned title-installers will still be broken. For more information see 120**

Changelog

Hotfix 09.09.2022: If you downloaded nsz_v4.1.0_win64_portable.zip before this date please redownload.

- Fixed 84 [GUI] broken input file Selection (Drag & Drop still works). This also fixes 102
- Fixed undupe not deleting any files, added undupe support for NSX (NSP files without titlekeys) and fixed not whitelisting the first occurrence but undupe-whitelist any other occurrence not deleting the first occurrence
- Implemented --undupe-rename
- Adopted this tool to the standard by also skipping the content meta xml and improved the skipping message to follow the print standard
- Fixed Verify not throwing an exemption when verification fails
- Implemented --alwaysParseCnmt
- Handle NSZ verification errors by deleting the corrupted NSZ
- When verifying, show "Verifying" instead of "Compressing" in progressbars
- Implemented --undupe-hardlink. Booth --undupe-hardlink and --undupe-rename now uses the output folder as output location.
- Fixed 87: nsz doesn’t respect -o flag when decompressing
- Add CRC-hash for new master keys 0b, 0c and 0d.
- open file only for reading with 'info' command
- set executable bit
- Kivy finally fixed its Linux issues so we can make installing nsz as easy as never before
- Read masterKeyRevision from either of two positions to resolve some edge cases with strange games
- Updated dependencies in setup.py to match requirements.txt/requirements-gui.txt
- There apparently are v0 DLCs so let's remove the safety check that prevents v0 titles to be deleted if there is an update of that exact titleId. The original purpose of this safety check was to protect base titles in case there is a titleID naming issue but is very unlikely to ever be needed. This fixes 105
- Updated packages inside setup.py to match the new setup.py standard

Replaced PyInstaller with WinPython for the portable Windows release.
- I spent a lot of time deleting every piece of the python standard library not required to run nsz in order to save storage and speed up extraction time by having less files to extract.
- This was done because PyInstaller triggered false positive detections on Windows Defender as reported in 82
- Tested on Windows 7, Windows 10 and Windows Server 2019

This version **ONLY** affects the portable Windows release. The PIP release wasn't updated as only the deployment of the Portable windows build is affected by this change.

After being in development for over half a year here finally NSZ v4.0 which brings a lot of new features. Enjoy that huge update. I will try to make more but smaller releases in the future.

- Implemented Drag & Drop support as requested in 51
- Implemented CRC32 key validation and added support for future masterkeys
- Fixed the issue of master_key_0a not being recognized
- Added CRC32 for master_key_0a
- Windows 7 support for Windows builds
- Improved GUI font size scaling
- Set the NSZ GUI window to be TopMost (always on top) on Windows so Drag & Drop gets much more convenient
- Added a setting to specify if the Kivy window should be always on top or not
- XCI/XCZ finally extracts to folders containing the NCA/NCZ files instead of HFS0 partition dumps
- Fixed a major XCI compatibility bug by implementing compression/decompression support for NCA files with the first section having a smaller or larger offset then 0x4000. This fixes 49
- Added NSPZ (nsZip legacy file format) extraction support
- Make GUI an optional install
- Fixed 59 ncz decompression is not working
- Cleaned up imports for nsz package
- Stop bar manager to avoid broken shells
- Added pywin32 as GUI dependency for Windows. This fixes 56
- Fixed BlockDecompressorReader.seek with whence = 2 (seek relative to the file's end). This fixes 64
- Starting nsz.py from within a different working directory finally works
- Fixes the current Azure Pipeline issue
- Added solid decompression, block decompression, solid compression and block compression tests to azure-pipelines.yml
- Made NSZ new returning with error code 1 if there are any exceptions
- Fixed deadlock in BlockCompressor.py
- Highly improved block decompression speed by caching the current block
- Added Visual Studio 2019 Python Project
- Added titleId and version to the file list and highly improved its design
- The SelectableLabel items inside the game list now properly scales its height according to the available width and text length of the file path. This fixes 50
- Added a multi-language supporting open source font for 61
- Implemented input folder as output folder by default for 61
- Waiting for Enter before exit when started over GUI so errors and console output can be seen before it closes for 74
- Fixed install failing on Kubuntu 20.04 and a lot of other modern Linux distributions by improving install_linux.sh for 75
- Removed code that manipulated the XCI header size for absolutely no reason which fixes 77
- Improved decompression speed by 400% by heavily reducing the amount of performance intensive status bar refresh calls
- The decision if the last block should be decompressed or copied now matches the file format specifications by comparing the decompressed block size of that specific block with its compressed size. This issue was caused by missing the (unlikely) edge case that the last block can be larger when compressed without exceeding the general block size. This fixes 79
- Improved BlockCompression performance and overall CPU usage by reducing the amount of performance intensive status bar refresh calls.
- Ensure that the line right to the curser is clean when the application terminates
- Implemented undupe, undupe-dryrun, undupe-prioritylist, undupe-whitelist and undupe-old-versions to remove duplicate games
- Highly improved the missing prod.keys/keys.txt error message by not showing the stack trace and waiting for a user input before exiting
- Highly improved README.md
- General system stability improvements to enhance the user's experience.

- Fixed XCZ decompression/verification

- Fixed broken decompression in v3.0.0 due to an optional argument not marked as such and an outdated file extension comparison
- Allow the selection of individual files inside the OpenFileDialog
- Made it visible which drive is currently selected inside the OpenFileDialog and SaveFileDialog
- Replaced the background_down image with the background_normal one as it looks ugly inside the FileDialogs
- Removed SaveFileDialog as its unused and a pain to maintain
- Highly improved the OpenFileDialog by allowing switching between the icon and list layout
- Added filter to the OpenFileDialog so it only displays nsp, nsz, xci, xcz and ncz files
- No longer showing the empty placeholder for the device selection on non-Windows platforms an made per OpenFileDialog argument specifiable file filters possible
- Finally enabled the selection of folders and selecting multiple items at the same time
- Automatically creating the empty gui folder required for settings to be saved in nsz portable which is exactly the fix manually applied to nsz_v3.0.0_hotfix1_win64_portable.zip
- Fixed the warnings that appeared in the console on every GUI launch
- Made the file browser view mode buttons in the same design as the Windows device selection buttons
- Implemented deletion of selected GameList items using the delete or backspace key
- Highly improved the GameList item selection and deletion
- Vixed verification only mode not executing when called from GUI
- Set the default amount of threads for solid compression to 3 while keeping the number of logical cores the default for block compression because the majority is now using task parallelization for solid compression
- Fixed: AttributeError: 'RootWidget' object has no attribute 'verify'
- Dirty fixed Kivy throwing "Error in sys.excepthook" during shutdown if the amount of RecycleView data was ever decreasing
- I tried multiple hours fixing this the proper way without success. I also tried removing all children what makes it to throw the same exception without even decreasing the amount of data and tried filling it with dummy data on shutdown in self.rootWidget.gameList.recycleView.shutdown() which didn’t worked because it’s already too late to spawn everything needed to avoid this exception.
- Improved the wording of the error summary
- Updated testing and deployment scripts
- Fixed orphan processes remaining after the main process terminated after block compressing a very short task resulting in the orphan processes spamming "AttributeError: 'ForkAwareLocal' object has no attribute 'connection'" exceptions
- Fixed NSZ GUI icon not showing
- General system stability improvements to enhance the user's experience.