Xrootd

+ **Major bug fixes**
**[XrdFfs]** Fix a bug in xrootdfs reported by issue 1777
**[Server]** Avoid SEGV when client tries to access file after deferred closed.
**[XrdHttp]** The server certificate is renewed by the Refresh thread of the
XrdTlsContext object.
**[XrdHttp]** Fix a segv happening when a client sends a first line starting
with a space.
**[XrdTls]** Shutdown the socket if a SSL error happens when trying to accept
a connection.

+ **Minor bug fixes**
**[Apps]** Avoid SEGV when asking for help.
**[XrdCl]** copy job: fix memory leak (buffers not queued on error).
**[Server]** Add O_RDWR open flag when creating file to avoid fs issue.
**[Server]** Properly handle opaque info for fsctl operations.
**[XrdHttp]** Allow VO names with spaces and other quoted chars.
**[XrdCl]** LocalFileHandler: fail gracefuly on overloaded machines.

+ **Miscellaneous**
**[XrdCl]** Introduce new error code for handling local errors.
**[XrdCl]** local file handler: obtain error code with aio_error.
**[XrdCl]** xrdfs ls: sanitize ls entry.
**[CMake]** Add ENABLE_ switch for scitokens and macaroons, closes 1728.
**[XrdTls]** Start the CRLRefresh thread in XrdTlsContext constructor.
**[XrdTls]** Changed the bit set for the activation of the Refresh thread.
**[XrdTls]** The CRL refresh thread logic only starts when there is a need
for it.
**[XrdTls]** Free current context when a new context is generated.
**[XrdHttpTpc]** Pass src size to OFS via oss.asize.

-------------

+ **New Features**
**[XrdApps]** Provide command line too to manipulate checksum xattr.
**[XrdApps]** xrdreplay: support quoted columns
**[XrdApps]** xrdrecorder: allow to set the output path using XRD_RECORDERPATH
envar.
**[Protocol]** Add reflink capability to protocol via kXR_open options.
**[Server]** Separate out authorization to overwrite data.
**[Server]** Allow set variable values to come from a file.
**[Server]** Implement gStream to monitor all http and xroot TPC events.
**[Server]** Bring packet marking up to current specification.
**[Server]** Provide g-stream monitoring for Third Party Copy (TPC).
**[SciTokens]** Allow the SciToken plugin to consume based on ZTN tokens.
**[Server]** Report experiment and activity codes when present for monitoring.
**[HTTP]** Have the XrdHttp extraction logic match GSI/
**[XrdAcc]** Make the acc subsystem aware of request-based name mapping.
**[XrdFfs]** update xrootdfs to work with XrdEC faster
**[Posix]** Make xrootd proxy, xrootdfs and xrdadler32 work with XrdCl+EC
**[SciTokens]** Save token subject as an XrdSecEntity xattr
**[Throttle]** Track maximum concurrency limits in throttle plugin
**[XrdCl]** xrdfs: support multiple rm paths
**[XrdCl]** record / replay plug-in
**[XrdCl]** In EC, add adjustable preference to servers based on free space
**[XrdCl]** Add recorder plug-in and xrdreply tool.
**[XrdCl]** xrdcp --server: report IP stack to stderr.
**[XrdCl]** Introduce Stream queries (IpAddr, IpStack, HostName).
**[XrdCl]** Implement EC VectorRead.
**[XrdFfs]** same above
**[XrdVomsMapfile]** Add support for VOMS mapfile
**[XrdCl/XrdEc]** Make the remote ec cfg more flexible.
**[Pfc]** Implement async read and readV from the perspective of XrdOucCacheIO.

+ **Major bug fixes**
**[Server]** Adjust for self-move behaviour changes in some compilers.
**[Server]** Modify vector's size instead of capacity to avoid undef behaviour
**[XrdEc]** Make sure returned read size is correct.
**[XrdEc]** Reader: make sure the completion handler is called if the read is of
zero size.
**[XrdCl]** Avoid race condition in AsyncSocketHander on use of reader/writer
objects after link is re-enabled
**[XrdCl]** Set the error status if the re-connection fails early during recovery
**[XrdCl]** xrdcp: don't use a common static status obj across all copy jobs.
**[XrdCl]** ZIP: respect file sizes > 4GB.
**[XrdCl]** Correctly calculate pages in pgread rsp (for small rsp).
**[XrdCl]** PgRead: don't exceed max iovcnt.
**[XrdCl]** Avoid that pgread responses could be timedout while being processed.
**[XrdCl]** Avoid situation where client does not read all of a network message.
**[XrdCl]** Avoid race by using TimeOutSID in single place.
**[Server]** Reset the buffer pointer after a non-aligned pgRead request.
**[XrdPfc]** Count number of active reads on an PfcIO object so that POSIX AIO
bailout detach can be handled correctly.
**[XrdPfc]** Do early exit when prefetching of a block fails with no other
subscribers.
**[XrdHttp]** Map kXR_ItExists to HTTP 409.
**[XrdAcc]** Fix overwrite return code.

+ **Minor bug fixes**
**[Frm]** Fix incorrect logic in frm_admin audit space.
**[Server]** Avoid SEGV during client recovery due to close waitresp.
**[Server]** Allow disablement of the tardy async I/O timeout path.
**[Proxy]** Allow for URLs with username.
**[XrdPss]** Do not trigger DeepLocate when pss.origin is http(s)
**[XrdPosix]** bug fix, report correct st_blocks in EC

+ **Miscellaneous**
**[SciTokens]** Add addition messages and debugging.
**[SciTokens]** Also grant Readdir when token grants read permission.
**[Server]** Ignore -Warray-bounds warnings from stricter check in gcc 12.
**[CMake]** XRootDOSDefs: Use define_default on default values
**[CMake]** Add XrdOuc/XrdOucPgrwUtils.hh to private headers.
**[CMake]** Change Py required version to 3.
**[CI]** Add Ubunty Jammy builds.
**[XrdClHttp]** Move to xrootd core.
**[XrdCl]** Refactor kXR_read raw data socket readout.
**[XrdCl]** Support HostList in lambda completion handlers.
**[XrdCl]** Make sure FileStateHandler is preserved until all outstanding
requests are resolved.
**[XrdCl]** Make sure FS data are preserved until all outstanding requests
are resolved.
**[Crypto]** bf32: Load "legacy" provider for blowfish in openssl v3.

+ **Major bug fixes**
**[XrdCl]** Make sure SocketHandler does not deadlock with PollerBuiltIn.
**[XrdCl]** Pass the login token from redirect rsp to login req.
**[XrdCl]** Fix infinite loop when copying data from msg body to user buffer.
**[XrdCl]** Make sure TPC destination is created with correct permissions.
**[XrdCl]** Fix VectorRead raw data socket readout.
**[XrdCl]** Make sure pgwrite MsgHandler is removed from in-queue after receiving rsp.
**[XrdCl]** Handle properly out-of-order pgread rsp.
**[XrdCrypto]** OpenSSL3: correctly initialize cipher with public key and DH parameters, fixes 1662
**[XrdCrypto]** bf32: respect the key length when encrypting/decrypting.
**[XrdAcc]** Make the acc subsystem aware of request-based name mapping.
**[XrdTpc]** [XrdTpc] Added CLOEXEC flag for curl file descriptors.
**[XProtocol]** Make sure ECANCELED is translated to kXR_Cancelled.
**[XrdSciTokens]** Fix memory corruption.
**[Python]** Fix Python 3.10+ issues from PY_SSIZE_T_CLEAN not being set.
**[XrdHttp]** Support full URIs in the GET request, fixes 1675.
**[PIP]** Fix import syntax to enable shutil.which check.
**[Server]** Return correct pgread offset for sync reads.

+ **Minor bug fixes**
**[XrdHttp]** Use 405 for mkcol/mkdir EEXIST.
**[XrdHttp]** Redirect PUT and POST with 307.
**[XrdHttp]** Use 307 to redirect anything that is not GET.
**[XrdCl]** Remove the leading ? from auto generated login token, fixes 1535.
**[XrdSciTokens]** Also grant Readdir when token grants read permission.

+ **Miscellaneous**
**[x509]** Allow commans in DN's.
**[XrdCl]** xrdcp: turn off progress bar when not running on a terminal, closes 1608.
**[XrdCl]** Simplify kXR_attn handling.
**[XrdCl]** Use pgread only is server version is kXR_PROTPGRWVERSION.
**[OpenSSL]** Provide OpenSSL3 compability.
**[TLS]** Display all OpenSSL messages upon fatal error; fixes 1554.
**[GSI]** Increase default bits from 512 to 2048.
**[PIP]** Add PIP_OPTIONS CMake option for greater control of Python bindings install.
**[Python]** Remove unused Python setup files from old workflows.
**[Python]** Provide cmake switch (XROOTD_PYBUILD_ENV) for setting up python build environment.
**[XrdSys]** Don't abort if it looks like we're about to fork.
**[Utils]** Avoid emitting fatal polling error message unless aborting.
**[Server]** Avoid misleading error message due to queued but delayed event.
**[Tests]** Fix strcpy overflow.
**[HttpTpc]** Vector cleared after use so it can be shrunk.
**[ZTN]** Point to the token via Entity.creds.
**[Server]** Fix MacOS complaints about unused parameters.
**[Oss]** Do not fail a mkdir if directory already exists with the same mode.
**[CMake]** Add an option (FORCE_ENABLED) to fail XrootD build if explicitly enabled features can not be build.
**[CMake]** Include XrdPosix in client-only builds.
**[XProtocol]** Bump protocol version and pgrw version.

+ **Major bug fixes**
**[XrdCl]** xrdfs rm: make sure status for all files is reported.
**[XrdCrypto]** Add DH_get0_p for OPENSSL_VERSION_NUMBER < 0x10100000L.

--------------

+ **Major bug fixes**
**[Posix]** Make sure pointer is set to 0 to avoid memory corruption.
**[GSI]** Generate DH parameters on first call to XrdCryptosslCipher.
**[Server]** Prevent SEGV due to missing lock call for background jobs.
**[SciTokens]** Correct deletion from std::map to avoid SEGV.
**[cmsd]** Avoid SEGV, avoid using pointers after deleting them.
**[XrdCl]** Make sure HS wait is not handled after channel has been TTLed.
**[XrdCl]** Avoid derefferencing null ptr when trasforming ChunkInfo into PageInfo.
**[XrdEc]** Ensure parallel execution of Reader::Read is thread-safe.
**[CMake]** Add XrdSysTrace.hh to private headers.
**[PIP]** Use shutil.which over distutils.spawn.find_executable when possible.
**[Posix]** Make sure pointer is set to 0 to avoid memory corruption.
**[Macaroons]** Avoid undefined behaviour (e.g. SEGV) using std::vector.

+ **Minor bug fixes**
**[SciTokens]** Regularize paths used for authorization.
**[pip]** Sanitize version to be PEP 440 compliant.
**[Python]** Use context manager for opening files.
**[Python]** Install Python bindings with pip if available.
**[RPM]** Add python2-pip to BuildRequires.
**[RPM]** Add python2-pip to BuildRequires.
**[Debian]** Add python3-pip, python3-setuptools as required packages.

+ **Miscellaneous**
**[Utils]** Redefine ENODATA when missing.
**[CMake]** Add support for static openssl libraries
**[CI]** Add GitHub Actions based CI
**[IOEvents]** Improve tracing.
**[XrdCl/XrdEc]** Make XrdEc compatible with vanilla xrootd servers.
**[XrdCl]** xrdfs: allow rm multiple files.

+ **New Features**
**[Server]** Add generic prepare plugin.

**[Server]** Add new class for gathering config data from config file.
**[Server]** Implement firefly network flow monitoring.
**[Server]** Allow prefunctory redirect based on client's net attributes.
**[Server]** Allow embedded spaces in auth id's and paths (acc.encoding).
**[Server]** Allow specification of preferred bind interfaces.
**[Net]** Accommodate K8s network namespaces.
**[cmsd]** Allow flexible path consideration when determining affinity.
**[XrdCl]** Support unaligned PgReads.
**[XrdCl]** Implement PgWrite.
**[XrdCl]** Implement declarative PgRead.
**[XrdCl]** Implement ZipArchive::PgRead.
**[XrdCl]** xrdcp: enables in-fly error correction of corrupted pages
(pgread/pgwrite).
**[XrdCl]** xrdcp: allow multiple --cksum options.
**[XrdCl]** Add checksumming capability to default EC plugin.
**[XrdCl]** SocketHandler: encapsulate the reads/writes operation in
a separate class.
**[XrdCl]** Allow loading XrdEc default plug-in based on cfg file.
**[XrdCl/XrdEc]** Use locate to obtain EC placement gr if empty.
**[XrdEc]** Allow specifying operation t/o.
**[XrdEc]** Make the metadata files relocable.
**[XrdEc]** Allow using the EC lib without metadata files.
**[Xrdpfc]** New cmd line option. Print in json format.

+ **Major bug fixes**
**[Server]** Correct code that frees unsent aio buffers after fatal error.
**[XrdCl]** ZipArchive: always execute callbacks in fresh exec ctx.
**[XrdCl]** Don't issue a close in ~File if the thread-pool has been stopped.

+ **Minor bug fixes**
**[AIO]** Correct test whether or not to turn off aio for Xcache.
**[XrdSciTokens]** Avoid double slashes in the final path after rules.
**[Server]** Do not hold cheksum lock across local checksum computation.
**[Server]** Correct notify option handling for kXR_prepare.
**[XrdCl]** Adjust timeout before retransmitting corrupted pages.
**[XrdCl]** Make sure XCpSrc does not leak.
**[XrdCl]** Add missing err msg if force isn't used and destination exits.
**[XrdCl]** Make sure the path on kXR_open does not inlude '?' if there is no cgi.
**[XrdCl]** ParallelOperation: fix race condition in AtLeast policy.
**[CMake]** Install in private-devel XrdClOperationTimeout.hh &
XrdClFinalOperation.hh

+ **Miscellaneous**
**[Plugins]** Improve fault tolerance of redirlocal plugin.
**[Plugins]** Improve fault tolerance of redirlocal plugin.
**[XrdCmsRedirLocal]** Add localroot option for plug-in. Improve fault tolerance
of RedirLocal plug-in.
**[Macaroons]** Relegate debug messages to debug status.
**[Xcache]** Extend pgread API to return number of corrected checksum errors.
**[cmsd]** Allow more parallelism during data server selection.
**[Utils]** Add utility class to handle url encoding and decoding.
**[Utils]** Add generic port specification to port number utility.
**[Apps]** Reintroduce the xrdprep (a.k.a xprep) command.
**[Apps]** Provide cli to compute crc32c checksum (i.e. xrdcrc32c).
**[Server]** Remove limit on number of args passed to a forked exec.
**[Server]** Add method to create an argv list from a string.
**[Server]** Replace XrdOucTrace by XrdSysTrace, part 1 (internal change).
**[Server]** Use RAtomics to enhance performance where needed.
**[Misc]** Implement RAtomics object all of whose operations use relaxed mem order.
**[Misc]** Add XrdPosixMap.hh to private hears (i.e. developers only).
**[XrdHttp]** Add func to obfuscate paths hidden into strings.
**[XrdHttp]** BuffGetData: better handle the case of wait=false.
**[XrdCl]** Avoid calls to PostMaster for local files.
**[XrdCl]** Do read/write recovery on errSocketTimeout.
**[XrdCl]** Include all chunk details in kXR_readv descripsion.
**[CMake]** Find pthreads using the CMake Thread module Prefer -pthread over
-lpthread if supported by the compiler.
**[CMake]** Enable SSE4.2 for cmsd.
**[CMake]** Add an option to build with asan.
**[Docker]** Add docker imgs with centos 7/8 build env.