Instructlab-sdg

What's Changed
* fix: formatting error by RobotSail in https://github.com/instructlab/sdg/pull/378
* Prefer tesserocr over easyocr, if available by bbrowning in https://github.com/instructlab/sdg/pull/369
* ci: add large-size E2E CI job by nathan-weinberg in https://github.com/instructlab/sdg/pull/380
* Add Release Strategy Document by khaledsulayman in https://github.com/instructlab/sdg/pull/381
* Docling models path by aakankshaduggal in https://github.com/instructlab/sdg/pull/362
* Check for tokenizer in downloaded models directory by khaledsulayman in https://github.com/instructlab/sdg/pull/364
* fix: upsample the phase10 knowledge dataset by RobotSail in https://github.com/instructlab/sdg/pull/377
* build(deps): bump DavidAnson/markdownlint-cli2-action from 17.0.0 to 18.0.0 by dependabot in https://github.com/instructlab/sdg/pull/386
* Delete .gitattributes by khaledsulayman in https://github.com/instructlab/sdg/pull/393

New Contributors
* RobotSail made their first contribution in https://github.com/instructlab/sdg/pull/378

**Full Changelog**: https://github.com/instructlab/sdg/compare/v0.5.0...v0.6.0

What's Changed
* build(deps): bump actions/cache from 4.1.0 to 4.1.1 by dependabot in https://github.com/instructlab/sdg/pull/300
* build(deps): bump rojopolis/spellcheck-github-actions from 0.42.0 to 0.43.0 by dependabot in https://github.com/instructlab/sdg/pull/299
* build(deps): bump actions/checkout from 4.2.0 to 4.2.1 by dependabot in https://github.com/instructlab/sdg/pull/298
* chore: rename 'basic-workflow-tests' to 'e2e-custom' by nathan-weinberg in https://github.com/instructlab/sdg/pull/306
* fix: change "group" to "tag" for mmlu_branch task config by alimaredia in https://github.com/instructlab/sdg/pull/305
* fix: remove stop token from mixtral by cdoern in https://github.com/instructlab/sdg/pull/310
* ci: update small E2E job to align with CLI and Training by nathan-weinberg in https://github.com/instructlab/sdg/pull/317
* ci: update medium job to run as PR check by nathan-weinberg in https://github.com/instructlab/sdg/pull/318
* build(deps): bump rojopolis/spellcheck-github-actions from 0.43.0 to 0.43.1 by dependabot in https://github.com/instructlab/sdg/pull/314
* fix: medium E2E CI job was missing HF_TOKEN by nathan-weinberg in https://github.com/instructlab/sdg/pull/319
* build(deps): bump actions/cache from 4.1.1 to 4.1.2 by dependabot in https://github.com/instructlab/sdg/pull/320
* ci: use org variable for AWS EC2 AMI in E2E CI jobs by nathan-weinberg in https://github.com/instructlab/sdg/pull/322
* ci: convert med E2E CI job to L4 GPU by nathan-weinberg in https://github.com/instructlab/sdg/pull/325
* build(deps): bump rojopolis/spellcheck-github-actions from 0.43.1 to 0.44.0 by dependabot in https://github.com/instructlab/sdg/pull/326
* build(deps): bump actions/setup-python from 5.2.0 to 5.3.0 by dependabot in https://github.com/instructlab/sdg/pull/323
* build(deps): bump pypa/gh-action-pypi-publish from 1.10.3 to 1.11.0 by dependabot in https://github.com/instructlab/sdg/pull/327
* build(deps): bump actions/checkout from 4.2.1 to 4.2.2 by dependabot in https://github.com/instructlab/sdg/pull/321
* build(deps): bump machulav/ec2-github-runner from 2.3.6 to 2.3.7 by dependabot in https://github.com/instructlab/sdg/pull/328
* build(deps): bump hynek/build-and-inspect-python-package from 2.9.0 to 2.10.0 by dependabot in https://github.com/instructlab/sdg/pull/329
* build(deps): bump rhysd/actionlint from 1.7.3 to 1.7.4 in /.github/workflows by dependabot in https://github.com/instructlab/sdg/pull/332
* build(deps): bump pypa/gh-action-pypi-publish from 1.11.0 to 1.12.0 by dependabot in https://github.com/instructlab/sdg/pull/337
* build(deps): bump rojopolis/spellcheck-github-actions from 0.44.0 to 0.45.0 by dependabot in https://github.com/instructlab/sdg/pull/338
* build(deps): bump pypa/gh-action-pypi-publish from 1.12.0 to 1.12.2 by dependabot in https://github.com/instructlab/sdg/pull/342
* Integrate Context-Aware Chunking and PDF Support by khaledsulayman in https://github.com/instructlab/sdg/pull/284
* feat: parametrize system prompt by jaideepr97 in https://github.com/instructlab/sdg/pull/339
* feat: support converting messages datasets into multiple pre-training formats by jaideepr97 in https://github.com/instructlab/sdg/pull/341
* Move to Docling v2 APIs by bbrowning in https://github.com/instructlab/sdg/pull/347
* feat: expose max_num_tokens as configurable by cdoern in https://github.com/instructlab/sdg/pull/340
* Remove unnecessary requirement for qna.yaml in ContextAwareChunker by khaledsulayman in https://github.com/instructlab/sdg/pull/351
* Upgrade docling, expand chunking testing by bbrowning in https://github.com/instructlab/sdg/pull/349
* Don't attempt batching with InstructLab's llama-cpp-python by bbrowning in https://github.com/instructlab/sdg/pull/358
* Consolidate test sample documents into one subdir by bbrowning in https://github.com/instructlab/sdg/pull/356
* Move a spurious print to a debug log message by bbrowning in https://github.com/instructlab/sdg/pull/359
* Only use CPU for the docling OCR models by bbrowning in https://github.com/instructlab/sdg/pull/361
* Data mix fix by aakankshaduggal in https://github.com/instructlab/sdg/pull/366

New Contributors
* alimaredia made their first contribution in https://github.com/instructlab/sdg/pull/305

**Full Changelog**: https://github.com/instructlab/sdg/compare/v0.4.2...v0.5.0

What's Changed
* build(deps): bump actions/checkout from 4.2.1 to 4.2.2 by dependabot in https://github.com/instructlab/sdg/pull/321
* build(deps): bump machulav/ec2-github-runner from 2.3.6 to 2.3.7 by dependabot in https://github.com/instructlab/sdg/pull/328
* build(deps): bump hynek/build-and-inspect-python-package from 2.9.0 to 2.10.0 by dependabot in https://github.com/instructlab/sdg/pull/329
* build(deps): bump rhysd/actionlint from 1.7.3 to 1.7.4 in /.github/workflows by dependabot in https://github.com/instructlab/sdg/pull/332
* build(deps): bump pypa/gh-action-pypi-publish from 1.11.0 to 1.12.0 by dependabot in https://github.com/instructlab/sdg/pull/337
* build(deps): bump rojopolis/spellcheck-github-actions from 0.44.0 to 0.45.0 by dependabot in https://github.com/instructlab/sdg/pull/338
* build(deps): bump pypa/gh-action-pypi-publish from 1.12.0 to 1.12.2 by dependabot in https://github.com/instructlab/sdg/pull/342
* Integrate Context-Aware Chunking and PDF Support by khaledsulayman in https://github.com/instructlab/sdg/pull/284
* feat: parametrize system prompt by jaideepr97 in https://github.com/instructlab/sdg/pull/339
* feat: support converting messages datasets into multiple pre-training formats by jaideepr97 in https://github.com/instructlab/sdg/pull/341
* Move to Docling v2 APIs by bbrowning in https://github.com/instructlab/sdg/pull/347
* feat: expose max_num_tokens as configurable by cdoern in https://github.com/instructlab/sdg/pull/340
* Remove unnecessary requirement for qna.yaml in ContextAwareChunker by khaledsulayman in https://github.com/instructlab/sdg/pull/351
* Upgrade docling, expand chunking testing by bbrowning in https://github.com/instructlab/sdg/pull/349


**Full Changelog**: https://github.com/instructlab/sdg/compare/v0.5.0a1...v0.5.0a2

What's Changed
* build(deps): bump actions/cache from 4.1.0 to 4.1.1 by dependabot in https://github.com/instructlab/sdg/pull/300
* build(deps): bump rojopolis/spellcheck-github-actions from 0.42.0 to 0.43.0 by dependabot in https://github.com/instructlab/sdg/pull/299
* build(deps): bump actions/checkout from 4.2.0 to 4.2.1 by dependabot in https://github.com/instructlab/sdg/pull/298
* chore: rename 'basic-workflow-tests' to 'e2e-custom' by nathan-weinberg in https://github.com/instructlab/sdg/pull/306
* fix: change "group" to "tag" for mmlu_branch task config by alimaredia in https://github.com/instructlab/sdg/pull/305
* fix: remove stop token from mixtral by cdoern in https://github.com/instructlab/sdg/pull/310
* ci: update small E2E job to align with CLI and Training by nathan-weinberg in https://github.com/instructlab/sdg/pull/317
* ci: update medium job to run as PR check by nathan-weinberg in https://github.com/instructlab/sdg/pull/318
* build(deps): bump rojopolis/spellcheck-github-actions from 0.43.0 to 0.43.1 by dependabot in https://github.com/instructlab/sdg/pull/314
* fix: medium E2E CI job was missing HF_TOKEN by nathan-weinberg in https://github.com/instructlab/sdg/pull/319
* build(deps): bump actions/cache from 4.1.1 to 4.1.2 by dependabot in https://github.com/instructlab/sdg/pull/320
* ci: use org variable for AWS EC2 AMI in E2E CI jobs by nathan-weinberg in https://github.com/instructlab/sdg/pull/322
* ci: convert med E2E CI job to L4 GPU by nathan-weinberg in https://github.com/instructlab/sdg/pull/325
* build(deps): bump rojopolis/spellcheck-github-actions from 0.43.1 to 0.44.0 by dependabot in https://github.com/instructlab/sdg/pull/326
* build(deps): bump actions/setup-python from 5.2.0 to 5.3.0 by dependabot in https://github.com/instructlab/sdg/pull/323
* build(deps): bump pypa/gh-action-pypi-publish from 1.10.3 to 1.11.0 by dependabot in https://github.com/instructlab/sdg/pull/327

New Contributors
* alimaredia made their first contribution in https://github.com/instructlab/sdg/pull/305

**Full Changelog**: https://github.com/instructlab/sdg/compare/v0.4.2...v0.5.0a1

What's Changed
* fix: remove stop token from mixtral (backport 310) by mergify in https://github.com/instructlab/sdg/pull/311


**Full Changelog**: https://github.com/instructlab/sdg/compare/v0.4.1...v0.4.2

What's Changed
* chore: rename 'basic-workflow-tests' to 'e2e-custom' (backport 306) by mergify in https://github.com/instructlab/sdg/pull/309
* fix: change "group" to "tag" for mmlu_branch task config (backport 305) by mergify in https://github.com/instructlab/sdg/pull/308


**Full Changelog**: https://github.com/instructlab/sdg/compare/v0.4.0...v0.4.1