Highlights
**Supports nested tensordicts**:
* [Feature] Nested tensordicts by vmoens in https://github.com/facebookresearch/rl/pull/256
* [Feature]: Index nested tensordicts using tuples by vmoens in https://github.com/facebookresearch/rl/pull/262
* [Feature]: flatten nested tensordicts by vmoens in https://github.com/facebookresearch/rl/pull/264
**Padding for tensordicts**:
* [Feature] Implement padding for tensordicts by ajhinsvark in https://github.com/facebookresearch/rl/pull/257
**Speed improvements**:
* [Feature]: faster meta-tensor API for TensorDict by vmoens in https://github.com/facebookresearch/rl/pull/272
* [Feature]: faster safetanh transform via C++ bindings by vmoens in https://github.com/facebookresearch/rl/pull/289
* [Feature]: Improving training efficiency by vmoens in https://github.com/facebookresearch/rl/pull/293
**Logging capabilities**:
* [Feature]: Refactored logging to be able to support other loggers easily by nicolas-dufour in https://github.com/facebookresearch/rl/pull/270
* [Feature] Wandb logger by nicolas-dufour in https://github.com/facebookresearch/rl/pull/274
**Doc**
* [Doc]: TorchRL demo by vmoens in https://github.com/facebookresearch/rl/pull/284
* [Doc] Added TensorDict tutorial by nicolas-dufour in https://github.com/facebookresearch/rl/pull/255
* [Doc] Tensordictmodule tutorial by nicolas-dufour in https://github.com/facebookresearch/rl/pull/267
What's Changed
* MacOs versioning and release bugfix by vmoens in https://github.com/facebookresearch/rl/pull/247
* Setup metadata by vmoens in https://github.com/facebookresearch/rl/pull/248
* Fix setup instructions by vmoens in https://github.com/facebookresearch/rl/pull/250
* Fix a bug when segment_tree size is exactly 2^N by xiaomengy in https://github.com/facebookresearch/rl/pull/251
* Added test for RewardRescale transform by nicolas-dufour in https://github.com/facebookresearch/rl/pull/252
* Empty TensorDict population in loops by vmoens in https://github.com/facebookresearch/rl/pull/253
* Memmap del bugfix by vmoens in https://github.com/facebookresearch/rl/pull/254
* [BugFix]: recursion error when calling `permute(...).to_tensordict()` by vmoens in https://github.com/facebookresearch/rl/pull/260
* Differentiable PPOLoss for IRL by vmoens in https://github.com/facebookresearch/rl/pull/240
* [BugFix]: avoid deleting true in_keys in TensorDictSequence by vmoens in https://github.com/facebookresearch/rl/pull/261
* [Feature] Add issue and pull request template by Benjamin-eecs in https://github.com/facebookresearch/rl/pull/263
* [Test]: test nested CompositeSpec by vmoens in https://github.com/facebookresearch/rl/pull/265
* [Test]: test squeezed TensorDict by vmoens in https://github.com/facebookresearch/rl/pull/269
* [Test]: TensorDict: test tensordict created on cuda and sub-tensordict indexed along 2nd dimension by vmoens in https://github.com/facebookresearch/rl/pull/268
* Refactor the `torch.stack` with destination by khmigor in https://github.com/facebookresearch/rl/pull/245
* Small tweaks to make the replay buffer code more consistent by shagunsodhani in https://github.com/facebookresearch/rl/pull/275
* [BugFix]: Minor bugs in docstrings by vmoens in https://github.com/facebookresearch/rl/pull/276
* [BugFix]: update wrong links in issue and pull request template by Benjamin-eecs in https://github.com/facebookresearch/rl/pull/286
* [BugFix]: quickfix: force gym 0.24 installation until issue with rendering is resolved by vmoens in https://github.com/facebookresearch/rl/pull/283
* [Doc]: remove pip install from CONTRIBUTING.md by vmoens in https://github.com/facebookresearch/rl/pull/288
* [BugFix]: fix GLFW3 error when installing dm_control by vmoens in https://github.com/facebookresearch/rl/pull/291
* [BugFix]: Fix examples by vmoens in https://github.com/facebookresearch/rl/pull/290
* [Doc] Simplify PR template by vmoens in https://github.com/facebookresearch/rl/pull/292
* [BugFix]: Replay buffer bugfixes by vmoens in https://github.com/facebookresearch/rl/pull/294
* [Doc] MacOs M1 troubleshooting by ramonmedel in https://github.com/facebookresearch/rl/pull/296
* [QuickFix]: update issue and pr template by Benjamin-eecs in https://github.com/facebookresearch/rl/pull/303
* [Test] tests for `BinarizeReward` by srikanthmg85 in https://github.com/facebookresearch/rl/pull/302
* [BugFix]: L2-priority for PRB by vmoens in https://github.com/facebookresearch/rl/pull/305
* [Feature] Transforms: `Compose.insert` and `TransformedEnv.insert_transform` by rmartimov in https://github.com/facebookresearch/rl/pull/304
* [BugFix] Fix flaky test by waiting for procs instead of sleep by nairbv in https://github.com/facebookresearch/rl/pull/306
* [BugFix] Fix a build warning, setuptools/distutils import order by nairbv in https://github.com/facebookresearch/rl/pull/307
* ufmt issue if imports in order requested by distutils by nairbv in https://github.com/facebookresearch/rl/pull/308
* [BugFix]: Conda to pip for circleci by vmoens in https://github.com/facebookresearch/rl/pull/310
* [BugFix] Support list-based boolean masks for TensorDict by benoitdescamps in https://github.com/facebookresearch/rl/pull/299
* [Feature] Truly invertible tensordict permutation of dimensions by ramonmedel in https://github.com/facebookresearch/rl/pull/295
* [Feature] Rename _TensorDict into TensorDictBase by yoavnavon in https://github.com/facebookresearch/rl/pull/316
New Contributors
* nicolas-dufour made their first contribution in https://github.com/facebookresearch/rl/pull/252
* ajhinsvark made their first contribution in https://github.com/facebookresearch/rl/pull/257
* ramonmedel made their first contribution in https://github.com/facebookresearch/rl/pull/296
* srikanthmg85 made their first contribution in https://github.com/facebookresearch/rl/pull/302
* rmartimov made their first contribution in https://github.com/facebookresearch/rl/pull/304
* nairbv made their first contribution in https://github.com/facebookresearch/rl/pull/306
* benoitdescamps made their first contribution in https://github.com/facebookresearch/rl/pull/299
* yoavnavon made their first contribution in https://github.com/facebookresearch/rl/pull/316
**Full Changelog**: https://github.com/facebookresearch/rl/compare/v0.0.1...v0.0.1b