Compliance-trestle

Chore

* chore: Merge pull request 679 from IBM/develop

feat: Trestle release ([`6582a5c`](https://github.com/oscal-compass/compliance-trestle/commit/6582a5cb20ff092763beb5059fbb8c34dd712b79))

* chore: Adding google analytics to website (680)

Signed-off-by: Chris Butler <christhebutlers.me> ([`4375ab9`](https://github.com/oscal-compass/compliance-trestle/commit/4375ab92fca03a699cdd788c0bfe01b9a60a45c0))

* chore: Merge back version tags and changelog into develop. ([`1ba9815`](https://github.com/oscal-compass/compliance-trestle/commit/1ba9815b75b82ee04acffbea4c1532fdd0f1feb4))

Feature

* feat: Schema validate command including miscellaneous fixes. (665)

* chore: Initial skeleton

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Clean up of text_files_equal (664)

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Working on unit tests.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Complete basic Unit tests

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Cleaning up code.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Removing target model from scope

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: adding testing.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Added remaining unit tests.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix:Adding the missing files.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix:Added extra documentation.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Addressed issues in review

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Adding more unit tests.

Signed-off-by: Chris Butler <christhebutlers.me> ([`3ab088a`](https://github.com/oscal-compass/compliance-trestle/commit/3ab088a9a9b4927a660510fe6fe8438a9b48fdfa))

* feat: new command href and now ssp gen uses caching to pull catalog from remote (669)

* first reworking of cache. tests pass

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* have expiration working.

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* added test

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* improved uri handling and tests

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* added new command href

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* ssp gen works via cache

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* increased coverage

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* fixed docstring

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* fix unix test failures

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* more href tests and fixes based on pr feedback

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* boost coverage

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* fix docstrings

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* windows drive path issue

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* added docs for href and now dont cache local hrefs

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* updated cli.md

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* updated href text 3

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* fixed changes to pre-commit for mdformat

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* fix: Correct missing/bad mdformatted documents and add mdformat to pre-commit.

Signed-off-by: Chris Butler <christhebutlers.me>

Co-authored-by: Chris Butler <christhebutlers.me> ([`660ef47`](https://github.com/oscal-compass/compliance-trestle/commit/660ef47b48d17ce19ab31690ef8264afb085e326))

Fix

* fix: Improved error handling of yaml headers in markdown files. (676)

* chore: Initial skeleton

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Clean up of text_files_equal (664)

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Working on unit tests.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Complete basic Unit tests

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Cleaning up code.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Removing target model from scope

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: adding testing.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Added remaining unit tests.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix:Adding the missing files.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix:Added extra documentation.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Addressed issues in review

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Improved error handling of yaml header.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Adding more unit tests.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Covering bad yaml headers with testing.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Covering bad yaml headers with testing.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Bad md header.

Signed-off-by: Chris Butler <christhebutlers.me> ([`1983925`](https://github.com/oscal-compass/compliance-trestle/commit/198392543a864ab213d869ddeaa123817d69b3c2))

* fix: Documentation fixes as well as fixes to json serializisation for full utf-8 support. (674)

Signed-off-by: Chris Butler <christhebutlers.me> ([`d051638`](https://github.com/oscal-compass/compliance-trestle/commit/d0516381a8be4d4c97c14395965ade00f8181083))

* fix: relocate ParameterHelper class. (667)

Co-authored-by: Chris Butler <christhebutlers.me> ([`0dbf472`](https://github.com/oscal-compass/compliance-trestle/commit/0dbf472c5d3513fb85d66e4f76bb3bc037fc726f))

* fix: file compare issue in task xlsx-to-component-definition unit test (666)

* Fix file compare issue in task xlsx-to-component-definition unit test

trestle version increases with each release, which affects the produced
output but not in any material way with respect to the unit tests at
hand.

fix is to employ local function to get_trestle version which nominally
returns the actual trestle version, but to mock said function in the
unit test.

* fix: file compare issue in task xlsx-to-component-definition unit test

* Use trestle version 0.21.0 in compare data, same as parameter-helper
fix. ([`052d184`](https://github.com/oscal-compass/compliance-trestle/commit/052d184a1cb5b83e034e7f2bc7c8a240299f7b6e))

Chore

* chore: Further improvements to testing performance (662)

* chore: Improving testing performance in CICD

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Further scleaning of CICD to optimise performance

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Further scleaning of CICD to optimise performance

Signed-off-by: Chris Butler <christhebutlers.me> ([`e281fa9`](https://github.com/oscal-compass/compliance-trestle/commit/e281fa936fbd232e36825e4609585c4e669f6ca7))

* chore: Improving testing performance for the CICD pipeline(661)

Signed-off-by: Chris Butler <christhebutlers.me> ([`83abe2d`](https://github.com/oscal-compass/compliance-trestle/commit/83abe2dd8a74c818cfac5e45b4e2900cb609c423))

* chore: Merge back version tags and changelog into develop. ([`4e1bb9f`](https://github.com/oscal-compass/compliance-trestle/commit/4e1bb9fee0ccc67f2be27693eb28b3707e1fe888))

Documentation

* docs: Cross link documentation between compliance-trestle and compliance-trestle-demos repositories. (637)

* feat: Added demonstration content.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Cleaned up demo content.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Removed dupicate demos.

Signed-off-by: Chris Butler <christhebutlers.me> ([`f28aca1`](https://github.com/oscal-compass/compliance-trestle/commit/f28aca1073888a7575a277c819449302e8e52b23))

Feature

* feat: Trestle Release 659 from IBM/develop

feat: Trestle release ([`6329c82`](https://github.com/oscal-compass/compliance-trestle/commit/6329c82ddd59e2699bd6e7dc8cd571e948fa21f6))

* feat: describe command to describe contents of model files with optional element path (650)

* added describe.py file

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* initial describe parsing

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* describe mostly working

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* added comments

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* added test file

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* added typing for docstrings

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* more docstring fixes

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* boost coverage

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* wrong test docstring

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* more tests and enhancements

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* initial documentation for describe

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* updated docs for split and describe

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* added new md doc files

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* check for commas and added to docs for describe

Signed-off-by: Frank Suits <frankstau1.ibm.com>

Co-authored-by: Chris Butler <christhebutlers.me> ([`905ff8a`](https://github.com/oscal-compass/compliance-trestle/commit/905ff8ac3cb0c7f11a8d8601bbcbcb2f9b40cae0))

* feat: spread sheet to component definition (635)

* spread sheet to OSCAL component definition task

* spread sheet to OSCAL component definition task

* Merge with develop, minor fixes.

* Add missing column specs to -i output.

* Relocate references to IBM and SCC from code to config.

* Remove hard-coded NIST values, relocate to config file.

* Use from trestle.utils.fs import text_files_equal

* Fix flake8.

* Remove the copy of the nist 800-53 catalog.

* Remove the copy of the nist 800-53 catalog.

Signed-off-by: Lou DeGenaro <lou.degenarogmail.com>

* flake8, but no complaint on my laptop?

* Fix bare except.

* Fix bare except.

Signed-off-by: Lou DeGenaro <lou.degenarogmail.com>

* linter fixes.

* linter fixes.

* Reduce size of main execute function.

Size of for loop reduced to 28 lines, including comments.
Minor bug fix in output catalog.

* Fix test spreadsheets.

- remove hidden and unused columns
- delete ods file

* To identify column use heading (row 1) rather than letter.

* Cosmetic fix to doc (for tanium-to-oscal).

* Remove unused column and between blank columns from &34;good&34; spread sheet.

Also, remove corresponding heading check from code.

* Document trestle task xlsx-to-oscal-component-definition. ([`6fe4e22`](https://github.com/oscal-compass/compliance-trestle/commit/6fe4e22ce9235e95ccd73c836bc8cbedfa99799c))

Fix

* fix: ssp dropping section prose when in profile, now supporting profile & catalog section prose. (657)

* fixed section issue in ssps

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* added docs

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* boost coverage

Signed-off-by: Frank Suits <frankstau1.ibm.com>

Co-authored-by: Chris Butler <christhebutlers.me> ([`4eadf47`](https://github.com/oscal-compass/compliance-trestle/commit/4eadf475dc0ccd0f38bd365b9b71be90e6f98cce))

* fix: ssp section generation failed due to changes due to 1.0.0 (649)

* fixed ssp section generation - changes due to 1.0.0

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* tweaked doc string

Signed-off-by: Frank Suits <frankstau1.ibm.com>

Co-authored-by: Chris Butler <christhebutlers.me> ([`26dac34`](https://github.com/oscal-compass/compliance-trestle/commit/26dac345c65a59ef49f49af11dbacb1f2094ceb4))

* fix: split bugs and make -f optional (639)

* split working except for parent issue

Signed-off-by: fsuits <frankstau1.ibm.com>

* split working - needs cleanup

Signed-off-by: fsuits <frankstau1.ibm.com>

* cleaned up and fixed compdef props issue

Signed-off-by: fsuits <frankstau1.ibm.com>

* fixed rel path split issue

Signed-off-by: fsuits <frankstau1.ibm.com>

* renamed respository refs

Signed-off-by: fsuits <frankstau1.ibm.com>

* start split with no -f

Signed-off-by: fsuits <frankstau1.ibm.com>

* split with no file works

Signed-off-by: fsuits <frankstau1.ibm.com>

* updated docs

Signed-off-by: fsuits <frankstau1.ibm.com>

* boost coverage

Signed-off-by: fsuits <frankstau1.ibm.com>

* fix lint issue

Signed-off-by: fsuits <frankstau1.ibm.com>

* made requested changes from pr feedback.

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* fixed split issues with new repository

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* converted TLO to TopLevelOscalModel

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* fixed extra variable assignment

Signed-off-by: Frank Suits <frankstau1.ibm.com>

* added try/except for test chdir

Signed-off-by: Frank Suits <frankstau1.ibm.com> ([`c514301`](https://github.com/oscal-compass/compliance-trestle/commit/c51430175117e1c1071442d3c564fae4afcef461))

* fix: Cleanup and enhancement of linting. (636)

* fix: Improved linting

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Improved linting

Signed-off-by: Chris Butler <christhebutlers.me> ([`631eba9`](https://github.com/oscal-compass/compliance-trestle/commit/631eba9ac1795bfcd109ed0e840898c2e6101528))

Chore

* chore: Merge back version tags and changelog into develop. ([`7656043`](https://github.com/oscal-compass/compliance-trestle/commit/7656043d4311f909b2fc3fa82ffe1d930a36c787))

Feature

* feat: Adding a global option to trestle author headers. (628)

* feat: Adding a global option to trestle author headers.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Added some unit tests for trestle author.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Added tests for missing coverage.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Updated docs.

Signed-off-by: Chris Butler <christhebutlers.me> ([`16f0265`](https://github.com/oscal-compass/compliance-trestle/commit/16f0265b1296066a203a5f844d89fd642a00fdb6))

* feat: Repository APIs to allow developer a consistent interface to a trestle repo. (583)

* Added Repo APIs and set trestle root in main command

* implementing read for managedOSCAL

* fix init validation in commad_docs

* fix: Restructured command inherhitence to ensure trestle-root is found.

Signed-off-by: Chris Butler <christhebutlers.me>

* Completed ManagedOSCAL class implementation

* removed __main__ from trestle_repo

* Updated tests for trestle_root

* Moved trestle_repo.ps to trestle/core/repository.py ans some other cleanup

* Update fs.py

Small typo error.

Co-authored-by: Vikas <avikasin.ibm.com>
Co-authored-by: Chris Butler <christhebutlers.me> ([`7bfabc5`](https://github.com/oscal-compass/compliance-trestle/commit/7bfabc5a9e078cbfb6b190d3ccb7f06942d9ea37))

Fix

* fix: Added test cases for Repository code (625)

* Added test cases for Repository code

* updated comment

* added more test cases

* updated tests

* updated test

* updated repository split code and tests

Co-authored-by: Vikas <avikasin.ibm.com> ([`c3f8a33`](https://github.com/oscal-compass/compliance-trestle/commit/c3f8a339bb66ea4723c9b1fa7b7ef30edf275cb5))

* fix: split catalog star, enable split of model with wildcard (626)

* split nearly working

Signed-off-by: fsuits <frankstau1.ibm.com>

* split star seems ok

Signed-off-by: fsuits <frankstau1.ibm.com>

* boosted coverage - split star seems fine

Signed-off-by: fsuits <frankstau1.ibm.com>

* cleaned up, about to pull develop

Signed-off-by: fsuits <frankstau1.ibm.com>

* added doc

Signed-off-by: fsuits <frankstau1.ibm.com>

* fixed error in docstring

Signed-off-by: fsuits <frankstau1.ibm.com> ([`d17389e`](https://github.com/oscal-compass/compliance-trestle/commit/d17389e824ce8f33f2a091cd541622fb40513a37))

* fix: tutorial tweaks (623)

* added editing of files in test of ssp assemble

Signed-off-by: fsuits <frankstau1.ibm.com>

* improved handling of prose for implementations in ssp assemble

Signed-off-by: fsuits <frankstau1.ibm.com>

* boost coverage

Signed-off-by: fsuits <frankstau1.ibm.com>

* tweaks to the tutorial

Signed-off-by: fsuits <frankstau1.ibm.com>

* explicit download of catalog file from nist github.

Signed-off-by: fsuits <frankstau1.ibm.com>

* fixed backslash

Signed-off-by: fsuits <frankstau1.ibm.com> ([`3ab018d`](https://github.com/oscal-compass/compliance-trestle/commit/3ab018d6dd63ae4ee98d90daca9b5580687ac8ae))

* fix: Add gfm support for mdformat (620)

Signed-off-by: Chris Butler <christhebutlers.me> ([`f67a74c`](https://github.com/oscal-compass/compliance-trestle/commit/f67a74c63aedd1cabdb6fcfd8f5be99b25886949))

* fix: ssp assemble prose, all extraction of general prose for responses (618)

* added editing of files in test of ssp assemble

Signed-off-by: fsuits <frankstau1.ibm.com>

* improved handling of prose for implementations in ssp assemble

Signed-off-by: fsuits <frankstau1.ibm.com>

* boost coverage

Signed-off-by: fsuits <frankstau1.ibm.com> ([`06e8627`](https://github.com/oscal-compass/compliance-trestle/commit/06e862705bbf3880678324ba29e4be54e54322e6))

* fix: boost coverage fix split_too_fine (615)

* improved test coverage, fixed split_too_fine, removed dict queries that arent needed

Signed-off-by: fsuits <frankstau1.ibm.com>

* removed exception check in validate

Signed-off-by: fsuits <frankstau1.ibm.com>

* reworked split_too_fine to deal with pydantic collection classes

Signed-off-by: fsuits <frankstau1.ibm.com>

* improved typing and simplified multiple ifs to try except

Signed-off-by: fsuits <frankstau1.ibm.com> ([`891227b`](https://github.com/oscal-compass/compliance-trestle/commit/891227b9899b38f7ce609f8b4b715740cb9a84f7))

Unknown

* Merge pull request 629 from IBM/develop

feat: Release of trestle repository functionality ([`4135275`](https://github.com/oscal-compass/compliance-trestle/commit/4135275e0874d1a5107e5494075c7ef4bae2d9f7))

Chore

* chore: [ImgBot] Optimize images (609)

*Total -- 343.57kb -> 285.47kb (16.91%)

Chore

* chore: Merge back version tags and changelog into develop. ([`2b987f9`](https://github.com/oscal-compass/compliance-trestle/commit/2b987f99f3f8bd3c4b36aec071887e7f4766882c))

Fix

* fix: Small scale fixes to the author validation system. (572) (573)

* fix: Minor fixes of author capability

Signed-off-by: Chris Butler <christhebutlers.me>

* fix:Adding more unit tests

Signed-off-by: Chris Butler <christhebutlers.me>

* fix:Added test fixtures.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Remove redundant statement.

Signed-off-by: Chris Butler <christhebutlers.me> ([`04e16cc`](https://github.com/oscal-compass/compliance-trestle/commit/04e16ccd508607eadb2c0ab4db69fb324cf0e24c))

* fix: Small scale fixes to the author validation system. (572)

* fix: Minor fixes of author capability

Signed-off-by: Chris Butler <christhebutlers.me>

* fix:Adding more unit tests

Signed-off-by: Chris Butler <christhebutlers.me>

* fix:Added test fixtures.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Remove redundant statement.

Signed-off-by: Chris Butler <christhebutlers.me> ([`8cd2232`](https://github.com/oscal-compass/compliance-trestle/commit/8cd22323c0b0bcb556c15fa3bb91d4a7c36bb683))

Chore

* chore: Merge back version tags and changelog into develop. ([`f98a852`](https://github.com/oscal-compass/compliance-trestle/commit/f98a852b6782f0c0760b1aab8a30eeef16039085))

Feature

* feat: Allow explicit inclusion / exclusion of readme files in author workflows (570)

* feat: Optional flags for readme validation

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Added missing test files.

Signed-off-by: Chris Butler <christhebutlers.me> ([`0ca1d20`](https://github.com/oscal-compass/compliance-trestle/commit/0ca1d202fa4865acf20fb9156a9c13437350b16e))

Fix

* fix: Replace yaml library to ensure that errors are thrown / recognised on duplicate keys. (569)

* chore: Moderniing to ruamel.yaml

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Bad testing data

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Replace yaml library with modernized and safe yaml library

Signed-off-by: Chris Butler <christhebutlers.me>

* chore: Fixing missing code format / linting.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Corrected behaviour in UT&39;s by forcing file flush in oscal_write

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: Correct docs setup.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: For content flushing / IO issues.

Signed-off-by: Chris Butler <christhebutlers.me>

* fix: More YAML IO sync issues

Signed-off-by: Chris Butler <christhebutlers.me> ([`9464420`](https://github.com/oscal-compass/compliance-trestle/commit/9464420cb3bba1dc684051ff35e2d13e9a115203))

Unknown

* Trestle release - update prior to OSCAL 1.0.0 support.

Pre OSCAL 1.0.0 release ([`797a291`](https://github.com/oscal-compass/compliance-trestle/commit/797a2918dbbe4771ae950364c560c4561216b011))