Demisto-sdk

* Added an option to specify a marketplace for certain playbook fields: All input fields: *key*, *value*, *description*, *required*, *playbookInputKey*. The following task fields: *scriptId*, *scriptarguments*, *loop.scriptArguments*, *message*, *form*. The task id mappings (for example the first task can be converted by "0" -> "0:xsoar"). The *left* and *right* options of *condition*/*builtincondition* task fields (and their nested fields). [4375](https://github.com/demisto/demisto-sdk/pull/4375)
* Added the *-h* option as a short option for the *--help* flag in ***typer***-based commands. [4350](https://github.com/demisto/demisto-sdk/pull/4350)
* Modified the **error-code** command to show information using the new BaseValidator standard. When such isn't available, defaults to legacy-style inforamtion. [4374](https://github.com/demisto/demisto-sdk/pull/4374)
* Added support to **run-specific-validations** flag to the new validate format. [4380](https://github.com/demisto/demisto-sdk/pull/4380)
* Modified PA107 to fail when the key **marketplaces** is missing from the pack_metadata.json file. [4379](https://github.com/demisto/demisto-sdk/pull/4379)
* Added a *--fix* option to DA100 and fixed the incorrect check in DA101. [4381](https://github.com/demisto/demisto-sdk/pull/4381)
* Fixed an issue where **pre-commit** and **validate** commands ignored changed files when running on an external contribution PR. [4351](https://github.com/demisto/demisto-sdk/pull/4351)
* Fixed an issue where RN103 failed on newly added packs due to missing release notes. [4383](https://github.com/demisto/demisto-sdk/pull/4383)
* Fixed an issue where the *auto_update_docker_image* field was not updated correctly in the the content-graph. [4287](https://github.com/demisto/demisto-sdk/pull/4287)
* Moved PB125 to the new validation format. The validation checks that a playbook condition task doesn't has only a default nexttask. [4365](https://github.com/demisto/demisto-sdk/pull/4365)
* Moved PB114, PB119 to the new validation format. [4348](https://github.com/demisto/demisto-sdk/pull/4348)
* Added support for different validation modes (-i, -a, -g) was added to the new validate command. [4301](https://github.com/demisto/demisto-sdk/pull/4301)
* Moved PB115 to the new validation format. The validation checks if the 'quietmode' field of all tasks in playbook are not in default value. [4366](https://github.com/demisto/demisto-sdk/pull/4366)
* Moved PB116 to the new format. The validation checks that indicator playbooks stop on error. [4364](https://github.com/demisto/demisto-sdk/pull/4364)
* Moved PB109 to the new validate format. The validation checks that taskid field and id field under task field contains equal values. [4358](https://github.com/demisto/demisto-sdk/pull/4358)
* Moved DS108 to the new validation format. The validation ensures that there's a dot at the end of each description line. [4339](https://github.com/demisto/demisto-sdk/pull/4339)
* Moved PB122 to the new validation format. Validate whether branches of built-in conditional tasks are handled properly. [4363](https://github.com/demisto/demisto-sdk/pull/4363)
* Modified MR103 to a path validation. Validates that the file names are the same as its folder. [4376](https://github.com/demisto/demisto-sdk/pull/4376)
* Moved MR101 to the new validation format and combined it with MR102. Validates that the modeling rule yml file contains the schema and rules keys and that they are empty. [4368](https://github.com/demisto/demisto-sdk/pull/4368)
* Moved RM107 to the new validation format. The validation checks that all placeholders are removed and all sections are filled in the readme files. [4373](https://github.com/demisto/demisto-sdk/pull/4373)
* Modified IMAGES_BATCH variable to be configurable per environment. [4382](https://github.com/demisto/demisto-sdk/pull/4382)
* Moved PB106 to new validation format. The validation checks if the playbook uses a specific instance. [4360](https://github.com/demisto/demisto-sdk/pull/4360)
* Moved the RP102 to the new validation format. The validation checks wether the id field equals the details field in an indicator type [4355](https://github.com/demisto/demisto-sdk/pull/4355)
* Moved MR106 to the new validation format. The validation verifies the types in schema files of modeling rules. [4372](https://github.com/demisto/demisto-sdk/pull/4372)
* Moved RP103 to the new validation format. The validation make sure the indicator type id is valid. (can include letters, numbers whitespaces, ampersands and underscores.) [4361](https://github.com/demisto/demisto-sdk/pull/4361)

* Fixed an issue where the logic for retrieving the latest Docker image was based on the entire tag (x.y.z.abcde) instead of just the last part of the image tag (_._._.abcde). Only the last part will now be used, per demisto/dockerfiles convention. [4294](https://github.com/demisto/demisto-sdk/pull/4294)
* demist-sdk **lint** command is deprecated and should be fully removed from the SDK on September 1st. Please use the **pre-commit** command instead. [4336](https://github.com/demisto/demisto-sdk/pull/4336)
* Removed support for IN124 - 'is param valid is hidden' validation from old-validate flow and prevent the validation from being ignored. The validation and the related information can be found in the new-validate flow. [4317](https://github.com/demisto/demisto-sdk/pull/4317)
* Added support for new XSIAM content items - Case Fields, Case layouts and Case Layout Rules. [4240](https://github.com/demisto/demisto-sdk/pull/4240)
* Added DS101 to the new validation format. Check if the beta disclaimer exists in the detailed description. [4289](https://github.com/demisto/demisto-sdk/pull/4289)
* Added the `--force` flag to the **generate-docs** command to force the README.md generation instead of use version control to update the doc. [4303](https://github.com/demisto/demisto-sdk/pull/4303)
* Added DS105 to the new validation format. "check if DESCRIPTION file contains contribution details" [4347](https://github.com/demisto/demisto-sdk/pull/4347)
* Added DS106 to the new validation format. "Check if the description file exist and the name is valid" [4357](https://github.com/demisto/demisto-sdk/pull/4357)
* updated the tenacity version to fix an installation error [4352](https://github.com/demisto/demisto-sdk/pull/4352)
* Fixed an issue where the **pre-commit** command would fail on simple repository due to a missing `docker_native_image_config.json` file. [4314](https://github.com/demisto/demisto-sdk/pull/4314)
* Fixed an issue in the **download** command where downloading with `force` and `run-format` flags did not merge YML fields. [4328](https://github.com/demisto/demisto-sdk/pull/4328)
* Fixed an issue in **generate-docs** where integration commands arguments had missing descriptions. [4320](https://github.com/demisto/demisto-sdk/pull/4320)
* Fixed an issue where validations searching for `demisto` in strings would find it in URLs (`/demisto/content`). [4341](https://github.com/demisto/demisto-sdk/pull/4341)
* Fixed an issue where **generate-docs** command couldn't find the sections within the integration README.md when updating documentation for modified commands. [4303](https://github.com/demisto/demisto-sdk/pull/4303)
* Fixed an issue where modified command names were treated as a new command. [4303](https://github.com/demisto/demisto-sdk/pull/4303)
* Fixed the **update-release-notes** command to support the right template for incident fields, incident types, layouts, generic objects, indicator types, and indicator fields. [4304](https://github.com/demisto/demisto-sdk/pull/4304)
* Fixed an issue in the **pre-commit** command where if the `DEMISTO_DEFAULT_BRANCH` environment variable was set to something other than "master", the command would fail. [4325](https://github.com/demisto/demisto-sdk/pull/4325)
* Fixed an issue where **validate-content-path** checked suffixes of test- or doc-files [4337](https://github.com/demisto/demisto-sdk/pull/4337)
* Fixed an issue where **format** did not work with private github repositories. [4313](https://github.com/demisto/demisto-sdk/pull/4313)
* Fixed an issue in the **format** command where using the `--deprecate` flag would not properly work on beta integrations. [4332](https://github.com/demisto/demisto-sdk/pull/4332)
* Modified the RM108 validation to follow the new validation format. [4275](https://github.com/demisto/demisto-sdk/pull/4275)
* Modeled base_playbook tasks into objects to ease on the use in various flows. [4343](https://github.com/demisto/demisto-sdk/pull/4343)
* Added a new flow that uploads a playbook execution report JSON to the artifacts bucket. [4284](https://github.com/demisto/demisto-sdk/pull/4284)
* Started adaption for relative paths enforcement in the upload flow - The flow will now attempt to create a json file including a dict objects of all the image paths appears in the markdown files in relative path formats. [4338](https://github.com/demisto/demisto-sdk/pull/4338)
* Updated the `artifacts_bucket` argument of the test-content command to be optional. [4334](https://github.com/demisto/demisto-sdk/pull/4334)
* Modified the test-pre-commit-command validate hook to run only BA100 validation. [4336](https://github.com/demisto/demisto-sdk/pull/4336)
* Converted the PB105 validation to the new format. The validation verifies the playbook doesn't contain deleteContext with all=Yes. [4356](https://github.com/demisto/demisto-sdk/pull/4356)
* Moved PB108 to the new validate format. The validate checks that the 'taskid' and the 'id' under the 'task' field are from UUID format. [4359](https://github.com/demisto/demisto-sdk/pull/4359)
* Modified the MR100 validation to follow the new validation format. [4331](https://github.com/demisto/demisto-sdk/pull/4331)
* Added PB126 to the new validation format. Ensure that conditional tasks have more than path which is not the default one [4349](https://github.com/demisto/demisto-sdk/pull/4349)
* Added the `removed_integration_parameter` validation to the new validate as `NoRemovedIntegrationParametersValidator`. [4354](https://github.com/demisto/demisto-sdk/pull/4354)
* Modified validations RN103 and RN104 to follow the new validations format. [4275](https://github.com/demisto/demisto-sdk/pull/4275)
* Added the PB103 to the new validation format. Validate whether there is an unconnected task. [4340](https://github.com/demisto/demisto-sdk/pull/4340)

* Started a deprecation process of the **lint** command. It will be fully removed soon. Use **demisto-sdk pre-commit** instead. [4286](https://github.com/demisto/demisto-sdk/pull/4286)
* Added support for Python 3.11 [2801](https://github.com/demisto/demisto-sdk/pull/2801)
* Added validation for image files in doc_files folder. [4249](https://github.com/demisto/demisto-sdk/pull/4249)
* Refactored PB101 and PB123 valildations. [4273](https://github.com/demisto/demisto-sdk/pull/4273)
* Refactored validation IF116, Check whether a selectValue key in an incidentField of type multiSelect contains empty options. [4278](https://github.com/demisto/demisto-sdk/pull/4278)
* Added support for IT valildations in the new validation command. [4264](https://github.com/demisto/demisto-sdk/pull/4264)
* Converted the RM106 validation to the new format. The validation verifies that README doesn't contain the word 'demisto'. [4295](https://github.com/demisto/demisto-sdk/pull/4295)
* Converted the DS107 validation to the new format. The validation verifies the integration description doesn't contain the word 'demisto'. [4296](https://github.com/demisto/demisto-sdk/pull/4296)
* Added XSIAM prefix for the `defaultDataSource` integration README. [4305](https://github.com/demisto/demisto-sdk/pull/4305)
* When updating an existing graph, the list of updated packs is now sorted. [4261](https://github.com/demisto/demisto-sdk/pull/4261)
* Refactored all DA valildations. [4264](https://github.com/demisto/demisto-sdk/pull/4264)
* Updated validation BC106, Verify that the fromVersion key in an incident field has not been changed. [4276](https://github.com/demisto/demisto-sdk/pull/4276)
* Refactored validation DS100, check whether a description file exists for a beta integration. [4274](https://github.com/demisto/demisto-sdk/pull/4274)
* Removed support for the `defaultDataSource` field in the pack metadata for hybrid packs. [4302](https://github.com/demisto/demisto-sdk/pull/4302)
* Refactored validation IM111, Verify the integration image is within the allowed dimensions. [4255](https://github.com/demisto/demisto-sdk/pull/4255)
* Added the `defaultDataSource` field to the pack metadata. [4139](https://github.com/demisto/demisto-sdk/pull/4139)
* Change the default `fromversion` of XSIAM content items to 8.0.0 [4243](https://github.com/demisto/demisto-sdk/pull/4243)
* Fixed an issue where `.demisto-sdk-conf` did not take into consideration command arguments setting to `false`. [4253](https://github.com/demisto/demisto-sdk/pull/4253)
* Fixed an issue where **format** did not take `.demisto-sdk-conf` into consideration. [4253](https://github.com/demisto/demisto-sdk/pull/4253)
* More detailed error message with action items for validation RM108. [4269](https://github.com/demisto/demisto-sdk/pull/4269)
* Removed lint step from all sdk build steps. [4286](https://github.com/demisto/demisto-sdk/pull/4286)

* Fixed an issue where **validate** ran from-version validation on `trigger` content items which do not have *from_version* field. [4235](https://github.com/demisto/demisto-sdk/pull/4235)
* Fixed an issue where requests to dockerhub failed on rate-limits when authenticating with username and password. [4227](https://github.com/demisto/demisto-sdk/pull/4227)
* Fixed an issue where reading **pre-commit** config templates would not handle cases with key=false and key:mode=true. [4238](https://github.com/demisto/demisto-sdk/pull/4238)
* Improved printing of file paths in the internal gitutil. [4251](https://github.com/demisto/demisto-sdk/pull/4251)

* Added the `--docker_image` and `--image_ref` flags to **pre-commit* to override values from configuration files. [4223](https://github.com/demisto/demisto-sdk/pull/4223)
* Removed the `update-additional-dependencies` script and pre-commit hook. [4225](https://github.com/demisto/demisto-sdk/pull/4225)

* Fix metadata (i.e. description) for XSOAR6 marketplace. [4208](https://github.com/demisto/demisto-sdk/pull/4208)
* Fixed an issue where `xsoar_on_prem` tag, was not removed as part of the parsing process. [4218](https://github.com/demisto/demisto-sdk/pull/4218)
* Added support to delete packs in **graph update** [4205](https://github.com/demisto/demisto-sdk/pull/4205)
* Added a default `.pre-commit-config_template.yaml` file that will be used by **pre-commit** command in case such does not exist in the target repository. [4194](https://github.com/demisto/demisto-sdk/pull/4194)
* Fixed an issue where the graph was not fully cleaned before import in **graph update** [4215](https://github.com/demisto/demisto-sdk/pull/4215)
* Fixed an issue where tests were not collected in VSCode after **setup-env** [4219](https://github.com/demisto/demisto-sdk/pull/4219)
* Fixed an issue where validate spammed logs when running. [4203](https://github.com/demisto/demisto-sdk/pull/4203)
* Added the **dump-api** command to dump the demisto-sdk API to a JSON file. [4214](https://github.com/demisto/demisto-sdk/pull/4214)