Dirac

[integration]

*Core

FIX: (6179) better report of error when importing Module
FIX: (6167) Replaced old vomses/vomsdir code to be able to handle cvmfs vomses. See https://github.com/DIRACGrid/DIRAC/issues/6150
FIX: (6151) Replace deprecated threading.activeCount with active_count
FIX: (6149) use AnyThreadEventLoopPolicy asyncio policy
FIX: (6144) Removing time dependence of TimeUtilities Module
NEW: (6137) add https to issuer address automatically
FIX: (6132) fix error reporting in TornadoService
CHANGE: (6091) changed name and simplified repetitive methods of Utilities.TIme
CHANGE: (6084) BaseRequestHandler encode/decode static methods

*MonitoringSystem

FIX: (6175) MonitoringReporter - late binding to MonitoringDB
FIX: (6076) Removing multiplication in timestamp when committing to monitoring

*WorkloadManagementSystem

FIX: (6173) restore /LocalSite/InstancePath for the case of JobAgents (see issue 6143)
FIX: (6162) use the JobMonitoringClient to check for job parameters (that can be in the ES backend)
NEW: (6134) adding a test to show the modifications made to the JDL before being inserted in the JobDB

*RequestManagementSystem

NEW: (6172) Add option to automatically cancel Scheduled requests after a defined time period. Default behaviour unchanged. Relates to 6136
CHANGE: (6114) Replace BLOBs with TEXTs for ReqDB

*docs

NEW: (6147) add info on installing non-released code from within the pilot

*Resources/Cloud

FIX: (6146) userData need to be in "ascii" string format to meet the requirement of "create_node" when creating VMs from cloud resources

*FrameworkSystem

FIX: (6138) dirac_login: avoid misleading error message, fixes issue 6096
FIX: (6135) dirac_login: Pass proxy as string to writeToProxyFile()
NEW: (6130) add the possibility to add a prefix before the actual log message for a given subLogger

[integration]

*Tests

FIX: (6122) restart Tornado after updating the configuration

*Core

FIX: (6120) don't truncate first character in cli doc strings
FIX: (6103) Race condition which causes multiple connectioons to be opened when the connection to an executor drops
CHANGE: (6103) Improve logging split between message/varmessage in execuctors
FIX: (6083) Grid: BDII make ldapsearch call forward compatible with newer ldapsearch versions

*DataManagementSystem

NEW: (6115) Introduces an option 'ForceIndexedMetadata' to disable the creation of unindexed metadata. Default: False, i.e. preserves the current default where both indexed and unindexed metadata are allowed. Relates to 6029.

*Resources

FIX: (6111) Error in the condition to get FlavorName
FIX: (6110) use identity instead of subject of proxy in CloudCE
FIX: (6102) remove decode from proxy in CloudCE
FIX: (6095) use ceType instead of ceName for CE parameters
FIX: (6088) autodetect cvmfs proxy in default cloudce template
FIX: (6083) ARCCE make ldapsearch call forward compatible with newer ldapsearch versions
FIX: (6080) Adapt StompMQConnector to Stomp 8

*tests

FIX: (6104) typo in testJobDefinitions for new Cloud test
NEW: (6081) added hackathon test for CloudComputingElement

*WorkloadManagement

FIX: (6103) Avoid producing massive log output in OptimizationMind

*Elasticsearch

NEW: (6094) option op_type in index API for Elasticsearch

[integration]

*Web

FIX: (6046) Fix downloading sandboxes from the Job Manager in the WebApp

*Resources

CHANGE: (5996) release stomp version
NEW: (5996) Simple stomp interface

[integration]

*WorkloadManagement

FIX: (6066) In case of a pilot version not matching the production version, the JobAgent expects the error message to contain the words "Pilot version does not match", so the error message was updated accordingly.

*WorkloadManagementSystem

FIX: (6065) Don't crash if systemCall fails

*Resources

NEW: (6061) add SRM+HTTPs as a default TPC protocol in SRM
FIX: (6060) use ceType instead of ceName for CE parameters
FIX: (6052) string format for future in PoolCE

*Core

NEW: (6017) TornadoBaseRequestHandler define a class logger with an extra attribute "tornadoComponent"
NEW: (6017) DIRACDB can now use a parentLogger instead of direct gLogger

*All

CHANGE: (6017) services propagate their local loggers to the DB
CHANGE: (6017) tornado services use local logger

[integration]

*docs

FIX: (6041) Added (renewed) jobs and pilot State Machines drawings

*DataManagementSystem

NEW: (6040) bitterly implement multihop
NEW: (6015) BringOnline setting for FTS transfers can be SE dependant

*Resources

FIX: (6039) HTCondorCE: make sure proxy is available when running condor_rm
NEW: (6038) add CloudComputingElement

*WorkloadManagementSystem

CHANGE: (6038) add hook for pilot cleanup

*RequestManagementSystem

FIX: (6033) if the request ID is an integer the test `is digit()` throws an exception

*Core

FIX: (6031) Allow rootPath to be overridden with DIRAC_ROOT_PATH environment variable

*FrameworkSystem

FIX: (6007) ComponentSupervisionAgent: skip Tornado service

*DMS/WMS/Monitoring

FIX: (6006) Fixed errors in Data Operation Monitoring and PilotsHistory from hackaton

*MonitoringSystem

CHANGE: (6002) Replaced the flags for monitoring with a new unified flag system

*Monitoring/Core

CHANGE: (5944) Divided ComponentMonitoring into AgentMonitoring and ServiceMonitoring

[integration]

*WorkloadManagementSystem

FIX: (6004) StalledJobAgent can force status from Submitting to Failed
FIX: (6004) ElasticJobParametersDB: make sure the docID is less than 512 characters

*WMS/Monitoring

NEW: (5999) Added a PilotsHistory Monitoring

*Subsystem

FIX: (5994) allow to run Watchdog on non x86 platforms

*WorkloadManagement

CHANGE: (5993) dirac-wms-get-cpu-normalization depends on db12 multiple_dirac_benchmark

*Core

FIX: (5985) Set default value of BaseRequestHandler.COMPONENT_NAME

*DataManagementSystem

FIX: (5984) fix a race condition when running multiple FTS3Agents in parallel

*RequestManagementSystem

FIX: (5960) moved REA initialization inside the initialize() method

*MonitoringSystem

FIX: (5955) Fixed data operation and pilot submission monitoring from certif Hackaton