Libnvme

Hannes was busy to get the TLS support for TCP getting into shape. While Tokunori is busy updating the type definitions. And Tomas is working on getting the NBFT bits more usable.

Thanks a lot everyone who contributed to this release via code or bug reports.


Ben Chuang (2):
util: Fixed nvme_id_ns_flbas_to_lbaf_inuse()
test: Add unit test for nvme_id_ns_flbas_to_lbaf_inuse()

Caleb Sander Mateos (2):
sysfs: minimize heap allocations of sysfs paths
test: use diff to compare sysfs output

Daniel Wagner (18):
log: move nvme_{set|get}_debug to log.c
ioctl: export nvme_submit_passthru{64} as weak symbol
ioctl: remove incomplete debug logging infrastructure
tree: fix lba_count size calculation
Revert "ioctl: Return NVMe status in nvme_directive_send_id_endir()"
Revert "ioctl: add nvme_get_features_host_id2()"
Revert "ioctl: add nvme_get_features_timestamp2()"
Revert "ioctl: add nvme_set_features_iocs_profile2()"
Revert "ioctl: add nvme_set_features_host_id2()"
Revert "ioctl: add nvme_set_features_host_behavior2()"
Revert "ioctl: add nvme_set_features_timestamp2()"
Revert "ioctl: Update stub functions to match documentation"
Revert "ioctl: Update function documentation"
Revert "fabrics: retry discovery log page when DNR is not set"
Revert "ioctl: return EPROTO when an NVMe status occurred"
tree: use strtou32 to read lba_size
build: Update version to v1.9
doc: Regenerate all docs for v1.9

Hannes Reinecke (26):
linux: allow for NULL argument in nvme_lookup_keyring()
linux: add nvme_read_key()
linux: add nvme_update_key()
crc32: Add CRC32 algorithm
linux: add nvme_export_tls_key()
linux: add nvme_import_tls_key()
linux: rework nvme_insert_tls_key_versioned()
tree: read TLS key in nvme_configure_ctrl()
json: export TLS key in PSK interchange format
json: import TLS key from PSK interchange format
json: dump TLS key data in PSK interchange format
linux: Add nvme_scan_tls_keys()
config-schema.json.in: tls keys and keyrings are strings
fabrics: keyring is a long
libnvme: add missing symbol nvme_scan_tls_keys
ioctl: return EPROTO when an NVMe status occurred
fabrics: retry discovery log page when DNR is not set
ioctl: Update function documentation
ioctl: Update stub functions to match documentation
ioctl: add nvme_set_features_timestamp2()
ioctl: add nvme_set_features_host_behavior2()
ioctl: add nvme_set_features_host_id2()
ioctl: add nvme_set_features_iocs_profile2()
ioctl: add nvme_get_features_timestamp2()
ioctl: add nvme_get_features_host_id2()
ioctl: Return NVMe status in nvme_directive_send_id_endir()

Leonardo da Cunha (1):
types: Added Command and Feature Lockdown LID

Liang Yan (2):
build: Add vscode directory into ignore
linux: Allocate aligned payload for nvme_get_telemetry_log

Martin George (1):
tree: fix mem leak in nvme_ns_init()

Maurizio Lombardi (1):
fabrics: check the read() return value

Nilay Shroff (2):
libnvme : record the nvme pci adapter physical slot
tree: Add NVM subsystem controller identifier

Tokunori Ikegami (26):
types: Add persistent event log reporting context definitions
types: Add PEL reporting context port identifier type definitions
types: Add PEL header additional information definitions
types: Add boot partition information definitions
types: Fix enum nvme_pel_rci documentation error
types: Add PEL set feature event layout definitions
ioctl: Move nvme_cmd_dword_fields definitions into header file
types: Fix EOM header optional data present fields definition
types: Add optional data present filed mask and shift definition
types: Fix NVME_CSTS_SHST_MASK definition
ioctl: Add nvme_ns_mgmt_delete_timeout()
types: Fix boot partition read offset (BPROF) mask value
types: Add NVME_CMBEBS property definitions
types: Add CMBSWTP property definitions
types: Add NVME_CMIC definitions
types: Add enum nvme_csts documentation
types: add controller status shutdown type (CSTS.ST) definition
types: Add enum nvme_unit/cmbebs/cmbswtp/flbas/cmic documentation
types: add enum nvme_cap documentation
types: add CAP.CPS and CAP.NSSS definitions
test: add CSTS.ST, CAP.CPS and CAP.NSSS registers
examples: fix mi-mctp build warning errors
types: Fix PMRWBM register name
types: fix CRTO.CRIMT mask value definition
types: add controller properties enum documentation
types: add ASQ, ACQ and BPMBL controller properties definitions

Tomas Bzatek (12):
log: Introduce nvme_get_logging_level()
log: Respect DEFAULT_LOGLEVEL on uninitialized logging
doc: Document the NBFT API
nbft: Add SSNS 'unavailable' flag
nbft: Add SSNS 'discovered' flag
tests: Adapt to added NBFT SSNS flags
tests: Add complex NBFT table from Dell R660
nbft: Whitespace fixes
json: Fix uninitialized variables
build: Switch default meson buildtype to 'debugoptimized'
tests: Add sample NBFT table with mpath IPv4+IPv6 discovery
util: Add string constant for ENVME_CONNECT_IGNORED

It's not a very interesting release this time. There are mostly small bug fixes and a few improvements in the testing area. Though it's worth to get these fixes out.

Thanks to all: Hannes Reinecke, Jian Zhang, Jinliang Wang, Leonardo da Cunha, Martin George, Martin Wilck, Tokunori Ikegami, Tomas Bzatek


Daniel Wagner (12):
build: fix release python tag match
build: checkout full repo for checkpatch
json-schema: add keyring and tls_key details
tree: use logical block size for lba
libnvme: export nvme_dump_tree
json: dump the output to the user selected filedescriptor
nvme: allow to overwrite base sysfs path
nvme: allow to overwrite hostnqn and hostid
test: read and dump sysfs tar file
tree: do not issue an error when subsys lookup fails during scanning
build: Update version to v1.8
doc: Regenerate all docs for v1.8

Hannes Reinecke (3):
meson.build: fixup 'join' syntax
Merge pull request 770 from hreinecke/fix-join.v2
fabrics: add 'concat' option

Jian Zhang (1):
example: fix mi identify failed with error cntid

Jinliang Wang (1):
mi: set correct rc and errno when crc mismatch

Leonardo da Cunha (1):
util: Added function to find specific UUID in UUID list.

Martin George (1):
linux: avoid segfault in check-tls-key due to null hostnqn/subsysnqn

Martin Wilck (1):
nbft: avoid duplicate entries in ssns->hfis

Tokunori Ikegami (1):
types: Add controller properties CMBEBS, CMBSWTP and NSSD

Tomas Bzatek (9):
fabrics: Explicitly initialize auto-cleanup variables
linux: Explicitly initialize auto-cleanup variables
tree: Explicitly initialize auto-cleanup variables
util: Explicitly initialize auto-cleanup variables
nbft: Fix (struct nbft_info_subsystem_ns).num_hfis off-by-one
tests: Fix diffs output for duplicate HFI entries
tests: Add sample NBFT table from Dell PowerEdge R760
tests: Add sample NBFT table from Dell PowerEdge R660
linux: Explicitly initialize auto-cleanup variables

dependabot[bot] (1):
build(deps): bump codecov/codecov-action from 3 to 4

The v1.7 contains a bug in the sysfs scan topology code which could double free some memory. As this is a very common code path to execute, it's worth to get this fix out fast.

See 762 for more details.

The highlights of this release are

- allocated payloads aligned (Tomas Bzatek)
- refactoring and improvements of RAE handling in get log pages (Caleb Sander)
- auto cleanup of resources (Caleb Sander)
- build instruction update and improving build situation for older distros
- support for TP8018 (Hannes Reinecke)
- use sysfs only for topology scan (Daniel Wagner)

The last point addresses a long standing problem. Whenever 'nvme list' is used it could add error log entries for certain devices. With the corresponding kernel changes this will not happen anymore. It also unlocks some possible new features. Note this depends on the upcoming 6.8 kernel.

Obviously there were lots of bug fixes everywhere and contributions in form of bug reports etc. Many thanks to everyone who contributed to the project: Alfred Wingate, Brandon Paupore, Caleb Sander, Chris Patterson, Daniel Wagner, Hannes Reinecke, Joy Gu, Martin Belanger, Martin George, Maurizio Lombardi, Nate Thornton, Prashanth Nayak, Sam James, Tokunori Ikegami and Tomas Bzatek.

ALPSS 2023 Release

A couple of noteworthy features made it to this release:
- A parser for the NBFT table (per NVMe-oF boot specification v1.0).
The [Timberland SIG](https://github.com/timberland-sig) provided the code for this.
- Ignoring fabric connect attempts if the execution context doesn't match.
This feature allows to make different users of libnvme to coexist, e.g. nvme-cli, nvme-stas or blktests without trying
to manage the same resource

And as usual there are plenty of fixes all over the place.

A big thanks to contributions from Benjamin Drung, Caleb Sander, Hannes Reinecke, Jeremy Kerr, Lior Weintraub, Martin Belanger, Maurizio Lombardi, Steven Seungcheol Lee, Stuart Hayes, Tokunori Ikegami, Tomas Bzatek, Umer Saleem.



Benjamin Drung (1):
examples: Fix wrong indentation in discover-loop.py

Caleb Sander (3):
fabrics: handle /dev/nvme-fabrics read failure
fabrics: check genctr after getting discovery entries
ioctl: fix RAE bit on last Get Log Page command

Daniel Wagner (27):
tree: Fix argument check in nvme_bytes_to_lba
fabrics: Do not pass unsupported options to kernel
tree: Fix offset argument check in nvme_bytes_to_lba
build: Disable fallback on default
build: Update wrap mode defaults
build: Make json-c dependency lookup not fail
build: Extend summary section
build: Simple muon build configuration
doc: Update README
python: Update test data
ioctl: Explicitly initialize all members of struct nvme_ns_mgmt_args
build: Install missing s390 library
test: Add unit test for ctrl lookups
util: Add ignored error code
fabrics: Filter discovery ctrls out during application context check
tree: Ignore NULL address pointer for phy slot lookup
fabrics: Relax match on well known disc ctrl lookup
scripts: Move helper scripts to a central place
scripts: Call update doc script from top level dir
scripts: Sync release script
build: Move CI build steps into a scripts
scripts: Use spaces instead of tabs
util: Provide empty nvme_ipaddrs_eq for static builds
build: Use containers with matrix build
build: Update cross instruction and drop verbose test flag
build: Update version to v1.5
doc: Regenerate all docs for v1.5

Hannes Reinecke (3):
libnvme: add 'application' setting to the subsystem
libnvme: add 'application' setting to nvme_root
fabrics: filter out subsystems with non-matching application string

Jeremy Kerr (1):
mi: Add nvme_mi_ctrl_id to retrieve controller ID

Lior Weintraub (1):
examples: fix incorrect controller status in MI info output

Martin Belanger (12):
nbft: Doc typo - Use nvme_nbft_free() instead of nbft_free()
Python: Add NBFT support
NBFT: Remove documentation from nbft.c since it's also in nbft.h
Python: make NBFT data more pythonic
Python: Suppress swig warnings about unnamed struct
python/swig: Wrap swig-sensitive struct inside ifwdef SWIG
python/swig: Check swig version to determine whether -py3 is needed
Python: Fix crash during garbage collection
util: Add ipaddrs_eq() to check whether two IP addresses are equal
util: rename ipaddrs_eq() to nvme_ipaddrs_eq() and make public.
test: Add more code coverage for nvme_ipaddrs_eq()
tree: Use nvme_ipaddrs_eq() to compare IP addresses

Maurizio Lombardi (1):
fabrics: fix potential invalid memory access in __nvmf_supported_option()

Steven Seungcheol Lee (4):
types.h: Add FDP related Status Code
types: Add ns-mgmt host software specified fields
types: Add IO command set specific field on nsmgmt
ioctl: io management send, receive args fix

Stuart Hayes (1):
nbft: add NBFT v1.0 table support

Tokunori Ikegami (3):
fabrics: Add EADDRNOTAVAIL error mapping
util: Use HAVE_NETDB instead of HAVE_LIBNSS
json: Use memory block allocated by realloc() instead printbuf

Tomas Bzatek (4):
nbft: Move added symbols to LIBNVME_1_5
nbft: Add a simple unit test
nbft: Fix nbft_ssns_flags endianness test
nbft: Parse the {HOSTID,HOSTNQN}_CONFIGURED flags

Umer Saleem (1):
tree: Add PCI physical slot number for controller