Radical.pilot

- add `docker compose` recipe.
- add option `-gpu` for IBM Spectrum MPI
- add comet resource config
- add doc of env variable
- add interactive schema to frontera config
- add rcfg inspection utilities
- also tarball log files, simplify code
- clarify semantics on `file` and `pwd` schemas
- document programmatical inspection resource definitions
- ensure RADICAL_SMT setting, document for end user
- fixed session cache (resolved `cachedir`)
- fix ornl resource sbox and summit interactive mode
- fix session test cleanup
- keep Spock's resource config in sync with Crusher's config
- make pilot launch and bootstrap CWD-independent
- make staging schemas consistent for pilot and task staging
- only use major and minor version for `prep_env` spec version
- pilot profiles and logfiles are now transferred as tarball 2663
- fix scheduler termination
- remove deprecated FUNCS executor
- support RP within interactive jobs
- simple attempt on api level reconnect
- stage_in.target fix for absolute path Fixes 2590
- update resource config for CrusherORNL
- use current working tree for docker rp source.


--------------------------------------------------------------------------------

- add check for exception message
- add test for `Agent_0`
- fix `cpu_threads` for special tasks (service, sub-agent)
- fix `task['resources']` value
- fix uid generation for components (use shared file for counters)
- fix master task tmgr
- fix raptor tests
- fix rp serializer unittest
- fix sub_agent keyerror
- keep agent's config with sub-agents in sync with default one
- remove confusion of task attribute names (slots vs. resources)
- set default values for agent and service tasks descriptions
- set env variable (`RP_PILOT_SANDBOX`) for agent and service tasks
launchers
- update exec profile events
- update headers for mpirun- and mpiexec-modules
- update LM env setup for `MPIRun` and `MPIExec` special case
(MPT=true)
- update LM IBRun
- update mpi-info extraction


--------------------------------------------------------------------------------

- fix syntactic error in env prep script


--------------------------------------------------------------------------------

- added tests for PRTE LM
- added tests for `rank_cmd` (IBRun and SRun LMs)
- adding TMGR stats
- adding xsede.expanse to the resource config
- always interprete prep_env version request
- anaconda support for prepare_env
- Checking input staging exists before tar-ing Fixes 2483
- ensure pip in venv mode
- fixed `_rm_info` in IBRun LM
- fixed status callback for SAGA Launcher
- fixed type in `ornl.summit_prte` config
- fix Ibrun set rank env
- fix raptor env vals
- use os.path to check if file exists Fixes 2483
- remove node names duplication in SRun LM command
- hide node-count from saga job description
- 'state_history' is no longer supported
- support existing VEs for `prepare_env`
- updated installation of dependencies in bootstrapper
- updated PRTE LM setup and config (including new release of PRRTE on
Summit)
- updating PMGR/AGENT stats - see 2401


--------------------------------------------------------------------------------

- support for MPI function tasks
- support different RAPTOR workers
- simplify / unify task and function descriptions
- refactor resource aquisition
- pilot submission via PSIJ or SAGA
- added resource config for CrusherOLCF/ORNL
- support for execution of serialized function
- pilot size can now be specified in number of nodes
- support for PARSL integration
- improved SMT handling
- fixed resource configuration for `jsrun`
- fix argument escapes
- raptor consistently reports exceptions now


--------------------------------------------------------------------------------

- fix slurm nodefile/nodelist
- clean temporary setup files
- fixed test for LM `Srun`
- local execution needs to check FORK first
- fix Bridges-2 resource config


--------------------------------------------------------------------------------