Qcg-pilotjob

Performance report tools

Performance report tools

New features:
* support for gathering launched processes info
Updates:
* minor bug fixes

* Support for resume mechanism
* Fixed logging
* Support for canceling submitted jobs
* Optimized wait4all client API method
* Automatically close service when all jobs finish and there is no active interface
* Developer documentation updated with description of launching slurm tests with docker compose
* Bug fixes

* new execution models `intelmpi`, `srunmpi`, `openmpi` designed to launch MPI applications with different implementations and various HPC Slurm configurations
* initial support for hyper-threading nodes, discovering hyper-threading configurations and binding more than single CPU to process
* bugfix related to parsing slurm node list
* bugfix related to freezing while launching MPI applications

* new form of documentation based on Sphinx at https://qcg-pilotjob.readthedocs.io
* changed package name to **qcg-pilotjob** (previously QCGPilotManager)
* changed Python library module name to **qcg.pilotjob** (previously qcg.appscheduler)
* updated documentation in API methods
* added more optimal way of handling iterative jobs
* job names cannot contain any special character nor the variable in form ``${}``
* iterations of job's will automatically have assigned job name in format: ``MAIN_JOB_NAME:ITERATION_INDEX``
* changed ``iterate``element in job description:
* the new name is ``iteration``
* the new format is dictionary with ``start`` (optional) and ``stop`` keys
* changed API methods:
* ``qcg.pilotjob.api.job.Joblist``:
* ``addStd()`` -> ``add_std()``
* ``jobNames()`` -> ``job_names()``
* ``orderedJobNames()`` -> ``ordered_job_names()``
* ``orderedJobs()`` -> ``ordered_jobs()``
* ``loadFromFile()`` -> ``load_from_file()``
* ``saveToFile()`` -> ``save_to_file()``
* ``qcg.pilotjob.api.manager.Manager``:
* ``sendRequest()`` -> ``send_request()``
* ``isStatusFinished()`` -> ``is_status_finished()``
* ``qcg.pilotjob.api.manager.LocalManager``:
* ``stopManager()`` -> ``kill_manager_process()``
* new method ``qcg.pilotjob.api.manager.Manager.info_parsed()`` - returns job information in parsed form
* ``qcg.pilotjob.api.manager.Manager.resources()`` - changed attributes in response:
* ``totalCores`` -> ``total_cores``
* ``totalNodes`` -> ``total_nodes``
* ``usedCores`` -> ``used_cores``
* ``freeCores`` -> ``free_cores``