Dirac

[integration]

*WorkloadManagement

FIX: (7480) JobCleaningAgent - select random jobs for deletion rather than head and tail jobs.
FIX: (7475) JobID type in PushJobAgent

*Interfaces

CHANGE: (7472) dfind - more explicit failure report

*DataManagementSystem

NEW: (7471) add tools for consistency checks

*tests

FIX: (7470) check running containers in integration tests script

*WorkloadManagementSystem

CHANGE: (7464) PilotAgentsDB: removed OutputReady and Broker fields

[integration]

*WorkloadManagement

FIX: (7458) jobID type issue in JobAgent

*ConfigurationSystem

FIX: (7454) getQueue() overriding the CE tags

*FrameworkSystem

FIX: (7451) dirac-proxy-init printInfo without the dirac group

[integration]

*WorkloadManagement

FIX: (7448) get pilot logging info with a token from an AREXCE

*WorkloadManagementSystem

FIX: (7447) Each job has its own JobReport in JobAgent
FIX: (7447) JobAgent exits when all the jobs have been processed
FIX: (7446) StatesAccountingAgent: skip the first iteration in order to avoid double commit after a restart
CHANGE: (7439) SandboxStore: remove external SE feature
FIX: (7436) JobDB: fix mismatch of string and integer jobIDs. In some cases API calls would fail because JObDB.getJobParameters and JobDB.getJobsAttributes return dictionaries with integer keys, while the function was called with a string jobID. This fixes for example the StalledJobAgent being unable to reschedule matched jobs.
NEW: (7425) TornadoPilotLoggingHandler modify the handler to accept VO name sent by a pilot. Required in a case where the VO cannot be guessed from a proxy. This change requires https://github.com/DIRACGrid/Pilot/pull/230
NEW: (7421) SandboxDB: add VO field
CHANGE: (7414) move the content of SubmissionPolicy in SiteDirector

*FrameworkSystem

FIX: (7443) correctly set the duration of tokens in cache

*RequestManagementSystem

FIX: (7441) make sure OwnerDN is defined before trying to access its value

*MonitoringSystem

CHANGE: (7432) moved to weekly indices for agent and service monitoring

[integration]

*Test

CHANGE: (7417) write the diracx CsSync config in the CS instead of taking the yaml file from diracx repo

*FrameworkSystem

CHANGE: (7413) removed Proxies persistency flag

*Core

FIX: (7412) Adding VOMS extensions without having environment variables set
NEW: (7412) Add DIRAC_DISABLE_GCONFIG_REFRESH environment variable to prevent gConfig being accidentally used
FIX: (7409) Use proxy lifetime for tokens from legacy proxy exchange (https://github.com/DIRACGrid/diracx/issues/130)

*WorkloadManagement

FIX: (7409) Add DiracX to payload proxies used by compute elements (7402)
FIX: (7406) SiteDirector should not interact with CEs if there is 0 pilot to submit

*WorkloadManagementSystem

CHANGE: (7407) JobDB simplifications
CHANGE: (7405) Removed Private Pilot functionality

[integration]

*WorkloadManagement

FIX: (7399) JobAgent rescheduling wrong jobs
FIX: (7387) JobAgent interaction with JobMonitoringClient

*WorkloadManagementSystem

CHANGE: (7396) PilotAgentsDB: move from OwnerGroup to VO
FIX: (7379) The callback for the Stager was failing, because of a type mismatch in the jobID used to retrieve the status. Jobs never came out of Staging.
NEW: (7375) pilotWrapper: using CVMFS_locations for discovering the pilot files

*FrameworkSystem

FIX: (7391) send notifications for expiring proxies

Documentation on how to deploy a third party tool (fluent-bit) to grab, format and send Dirac current logs to ElasticSearch and/or splitted logs files

*Resources

FIX: (7376) AREXCE should break when a valid delegation ID is found

*Core

FIX: (7374) Converting p12 files with filenames containing special characters

[integration]

*docs

FIX: (7330) just use `pip install DIRAC` for DIRAC client install
FIX: (7330) updated picture for py3 stack

*Interfaces

FIX: (7328) Improve performance of job delete/kill/reschedule API
FIX: (7322) Lower log level for printing version in submitJob

*WorkloadManagementSystem

FIX: (7327) Allow "ANY" in the valid sites list
NEW: (7318) initial FutureClient for JobStateUpdate
FIX: (7316) ElasticJobParametersDB: do not configure the IndexPrefix name