Lhotse

What's Changed

Recipes
* Recipe for the Chinese Dysarthric Speech Database by JinZr in https://github.com/lhotse-speech/lhotse/pull/1423
* Optimized ReazonSpeech download speed using hf datasets features by yuta0306 in https://github.com/lhotse-speech/lhotse/pull/1434

New features
* Option to save audio in the original format when exporting to shar by anteju in https://github.com/lhotse-speech/lhotse/pull/1422
* `CutSet.from_huggingface_dataset()` for importing HF datasets by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1433
* Extend AIStore serialization backend to writing by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1435

Other improvements
* change max_frames to max_duration in docs by pengzhendong in https://github.com/lhotse-speech/lhotse/pull/1419
* add opensmile url by pengzhendong in https://github.com/lhotse-speech/lhotse/pull/1424
* File reading IO refactoring into backends by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1421
* Fix .m4a support in some setups (possibly for other formats not supported by libsndfile) by racoiaws in https://github.com/lhotse-speech/lhotse/pull/1427
* add to_dict for CustomFieldMixin class by pengzhendong in https://github.com/lhotse-speech/lhotse/pull/1426
* Fix consecutive same sampler selection in round robin sampler with num_workers>1 by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1432
* Fixed copying MixedCut with custom attributes set by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1436

New Contributors
* racoiaws made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1427
* yuta0306 made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1434

**Full Changelog**: https://github.com/lhotse-speech/lhotse/compare/v1.28.0...v1.29.0

New features
* Implement conversion from CutSet to HuggingFace dataset by domklement in https://github.com/lhotse-speech/lhotse/pull/1398
* Add workflow: annotate DNSMOS P.835 by yfyeung in https://github.com/lhotse-speech/lhotse/pull/1406

New recipes
* Add recipe for the Santa Barbara Corpus of Spoken American English (SBCSAE) by mmaciej2 in https://github.com/lhotse-speech/lhotse/pull/1395
* Adds radio data recipe by m-wiesner in https://github.com/lhotse-speech/lhotse/pull/1400
* Fleurs by m-wiesner in https://github.com/lhotse-speech/lhotse/pull/1402
* Add the Emilia corpus by csukuangfj in https://github.com/lhotse-speech/lhotse/pull/1404

What's Changed
* [spgispeech] Fix durations object is null issue by frankyoujian in https://github.com/lhotse-speech/lhotse/pull/1390
* Fix backend to None while ffmpeg is unavailable. by pengzhendong in https://github.com/lhotse-speech/lhotse/pull/1392
* Fix ksponspeech recipe by yfyeung in https://github.com/lhotse-speech/lhotse/pull/1394
* Fix cli for ksponspeech by yfyeung in https://github.com/lhotse-speech/lhotse/pull/1393
* [fix] fisher_english recipe by pengzhendong in https://github.com/lhotse-speech/lhotse/pull/1410
* downgrading sphinx version from 7.2.6 to 7.1.2 by annapovey in https://github.com/lhotse-speech/lhotse/pull/1409
* Update lhotse.py by pengzhendong in https://github.com/lhotse-speech/lhotse/pull/1414
* Make torchaudio an optional dependency by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1382
* minor fix by pengzhendong in https://github.com/lhotse-speech/lhotse/pull/1418
* Support for AIStore ObjectFile resilient reading when AIStore SDK version >=1.9.1 is present

New Contributors
* frankyoujian made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1390
* pengzhendong made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1392
* mmaciej2 made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1395
* domklement made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1398
* annapovey made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1409

**Full Changelog**: https://github.com/lhotse-speech/lhotse/compare/v1.27.0...v1.28.0

New recipes
* [Recipe] Wenetspeech4tts by yuekaizhang in https://github.com/lhotse-speech/lhotse/pull/1384
* [Recipe] Spatial LibriSpeech by JinZr in https://github.com/lhotse-speech/lhotse/pull/1386

Other enhancements
* Cap the 'trng' random seeds to 2**31 avoiding numpy error by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1379
* `CutSet`.prefetch() for background cuts loading during iteration by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1380
* Include a copyright NOTICE listing major copyright holders by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1381
* Added has_custom to MixedCut by anteju in https://github.com/lhotse-speech/lhotse/pull/1383
* Fix to fixed batch size bucketing and audio loading network connectio… by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1387

New Contributors
* anteju made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1383

**Full Changelog**: https://github.com/lhotse-speech/lhotse/compare/v1.26.0...v1.27.0

What's Changed
* Add EARS recipe by Ryu1845 in https://github.com/lhotse-speech/lhotse/pull/1375
* Concurrent dynamic bucketing by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1373
* Refactor bucket selection for customization by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1377

New Contributors
* Ryu1845 made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1375

**Full Changelog**: https://github.com/lhotse-speech/lhotse/compare/v1.25.0...v1.26.0

What's Changed
* [feature] Add `.narrowband()` effect (mulaw, lpc10 codecs) by rouseabout in https://github.com/lhotse-speech/lhotse/pull/1348
* [feature/optimization] Support for pre-determined batch sizes in `DynamicBucketingSampler` by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1372
* [bug] Fix `MixedCut` transforms serialization by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1370



**Full Changelog**: https://github.com/lhotse-speech/lhotse/compare/v1.24.2...v1.25.0

New recipes
* Add KsponSpeech recipe by whsqkaak in https://github.com/lhotse-speech/lhotse/pull/1353

New features
Several new APIs for manifest classes added in 1361:
* `cut.iter_data()` which iterates over (key, manifest) pairs of all data items attached to a given cut (e.g., `("recording", Recording(...)), ("custom_features", TemporalArray(...))`)
* `is_in_memory` property for all manifest types to indicate if it contains data that is held in memory
* `is_placeholder` for non-cut manifests to indicate if a manifest is just a placeholder (has some metadata, but can't be used to load data)
* `cut.drop_in_memory_data()` which converts manifests with in-memory data to placeholders (this is useful for manifests that live longer than just dataloading to avoid blowing up CPU memory and/or slowing down the program)

Bug fixes
* Restoring smart open for local files if available by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1360
* Fix Recording.to_dict() when transforms are dicts and transform pickling issues by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1355
* Utils for discovering attached data and dropping in-memory data by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1361
* Numpy 2.0 compatibility by pzelasko in https://github.com/lhotse-speech/lhotse/pull/1362

New Contributors
* whsqkaak made their first contribution in https://github.com/lhotse-speech/lhotse/pull/1353

**Full Changelog**: https://github.com/lhotse-speech/lhotse/compare/v1.24.1...v1.24.2