Projectaria-tools

🎉We’re excited to announce Project Aria Tools v1.5.5🎉

**[PyPI]**
- Added Windows support to our wheels on PyPI

**[MPS]**
- Shown how to best use [SLAM online calibration](https://github.com/facebookresearch/projectaria_tools/blob/main/core/examples/mps_quickstart_tutorial.ipynb) and a time offset for the RGB camera
- MPSDataProvider can now provide the [version ID of the MPS service](https://github.com/facebookresearch/projectaria_tools/commit/890e57b59bc9e1cd7cf9d30d0d605189f8eb3fdf)

**[Documentation]**
- [How to install projectaria_tools from pypi for windows](https://facebookresearch.github.io/projectaria_tools/docs/data_utilities/installation/installation_python)
- [How to install VRS tools and VRS Player](https://facebookresearch.github.io/projectaria_tools/docs/data_formats/aria_vrs/aria_vrs_tools_installation)
- [How to use VRSPlayer](https://facebookresearch.github.io/projectaria_tools/docs/data_formats/aria_vrs/aria_vrsplayer)
- [How to use VRS tools to trim VRS file in time or stream wise](https://facebookresearch.github.io/projectaria_tools/docs/data_formats/aria_vrs/aria_vrs_command_line)

**[ADT]**
- [All objects in ADT now have downloadable 3D models in glb format](https://facebookresearch.github.io/projectaria_tools/docs/open_datasets/aria_digital_twin_dataset/object_models)
- [ADT rerun visualizer now supports visualizing 3D object models](https://facebookresearch.github.io/projectaria_tools/docs/open_datasets/aria_digital_twin_dataset/object_models#visualizing-object-models)

🎉 We’re excited to announce Project Aria Tools v1.5.4 🎉

**[Core]**

Projectaria_tools can now be compiled for native windows support. Assuming Visual Studio Compiler is setup on the machine (default to `Visual Studio 16 2019` but `Visual Studio 17 2022` is also supported, if generator is updated in the cmake command line `-G`)

C++ compilation + unit test run with Pixi package manager
pixi run run_c
Python compilation + unit test run with Pixi package manager
pixi run run_python


**[Dataset]**
ADTv2 [Tutorial notebook update](https://github.com/facebookresearch/projectaria_tools/commit/c824f6b8782fa29c48fb308eb67a0ea3330916ba)

**[Documentation]**
Added [HOT3D to the OpenDataset wiki page](https://facebookresearch.github.io/projectaria_tools/docs/open_datasets/hot3d)
[Enhanced documentation of ARK TimeSync feature](https://facebookresearch.github.io/projectaria_tools/docs/ARK/sdk/samples/ticsync_sample)

**[MPS/MPS-CLI]**
Add [support of Normals for wrist and palm helping to get the orientation of hands](https://facebookresearch.github.io/projectaria_tools/docs/data_formats/mps/hand_tracking#hand-tracking-outputs)

**[MPS Code Sample]**
[Python notebook showing how to align MediaPipe Hand tracking with MPS wrist and palm tracking](https://github.com/facebookresearch/projectaria_tools/tree/main/tools/samples/python/mps_handtracking_overlay_media_pipe)

🎉 We’re excited to announce Project Aria Tools v1.5.2. 🎉

**[API]**
- VrsDataProvider
- Add support of VRS metadata/file tags and time sync mode
- Calibration
- Add better support for [rotating calibration data](https://github.com/facebookresearch/projectaria_tools/commit/616766ba0a86c1bc31341019d97987f67411bb18) (intrinsics, extrinsics)
- See usage either on [wiki](https://facebookresearch.github.io/projectaria_tools/docs/data_utilities/advanced_code_snippets/image_utilities#rotated-image-clockwise-90-degrees) or in the [AEA](https://github.com/facebookresearch/projectaria_tools/pull/90) dataset viewer
Expose [camera calibration rescaling function](https://github.com/facebookresearch/projectaria_tools/commit/8692a230b76539dc0e3583a2ced1f65f41c34e8d)

**[Code Samples]**
- C++
- [VRS Image mutation](https://github.com/facebookresearch/projectaria_tools/commit/6133b26f9c1f0ada4e33bbb32956b9621c475823)
- Python
- TicSync notebook [tutorial](https://github.com/facebookresearch/projectaria_tools/blob/b4599e1b69b17629e2c0c7e1ae74c94493710f78/core/examples/ticsync_tutorial.ipynb)
- MPS [EyeGaze Depth Estimation](https://github.com/facebookresearch/projectaria_tools/commit/ff0ec97b17e830617f417f14f263f31b84311e3b)
- ADT - [Notebook on converting depth maps to point clouds](https://github.com/facebookresearch/projectaria_tools/commit/093bd1c85e605ba292f0a93384054a7c52641ecf)

**[Tools - Python]**
- [VRS to MP4](https://facebookresearch.github.io/projectaria_tools/docs/data_utilities/advanced_code_snippets/vrs_to_mp4)
- Improved timing accuracy during export
- Updated to include timestamps in the metadata

**[MPS-CLI]**
- API update to mps-cli to support Aria Studio

**[Build]**
- Continuous Integration (adapt to changing software/hardware environment)
- C++ - [Fix for Pangolin](https://github.com/facebookresearch/projectaria_tools/commit/63c42728af405e01c697b6d4fe373592f1b5928f)
- Python wheels - [Fix cibuildwheel version](https://github.com/facebookresearch/projectaria_tools/commit/f8481609a4d4622962d00149dd9104f09db5bf89)
- Python wheels - Fix GitHub runner to be Intel or Mac Silicon

**[Visualization]**
- MPS Viewer - [Enable showing RGB images upright, undistorted, or unchanged](https://github.com/facebookresearch/projectaria_tools/commit/daa89dba94df36b2c83f3117f6d12045a4d58d37)

**[Projects/Dataset]**
- ADT
- Data & Tooling Updated to v2.0
- We have removed the notion of subsequences. All subsequence are now separated into their own sequence folder
- Tooling including visualization and downloaders have been updated to new file structure, but are still backwards compatible
- We have removed access to challenge data now that the challenge has completed
- Visualization
- Python - Add option to add image rectification to the viewer
- C++ - Update Pangolin viewer to better aspect ratio
- AEA
- Visualization - Python - [Ease image rotation/undistortion](https://github.com/facebookresearch/projectaria_tools/pull/90)

**[Documentation]**
- Various improvements, including:
- New [Pairing Additional Glasses and Troubleshooting](https://facebookresearch.github.io/projectaria_tools/docs/ARK/glasses_manual/pair_glasses)
- New [Project Aria Glasses Cable Clip instructions](https://facebookresearch.github.io/projectaria_tools/docs/ARK/glasses_manual/cable_clip)
- Updated Aria Digital Twin (ADT) v2.0 updated to support [Aria Dataset Explorer](https://explorer.projectaria.com/)
- New [Aria Dataset Explorer](https://facebookresearch.github.io/projectaria_tools/docs/open_datasets/dataset_explorer)
- New [Aria Studio](https://facebookresearch.github.io/projectaria_tools/docs/ARK/aria_studio)
- New [Time Synchronized Recordings with Multiple Aria Devices](https://facebookresearch.github.io/projectaria_tools/docs/ARK/sdk/ticsync)
- New [Project Aria FAQ](https://facebookresearch.github.io/projectaria_tools/docs/faq)
- Updated [Info page](https://facebookresearch.github.io/projectaria_tools/docs/intro) and [About ARK page](https://facebookresearch.github.io/projectaria_tools/docs/ARK/about_ARK)

🎉 **We’re excited to announce Project Aria Tools v1.5.0.** 🎉

**[Tools - Python]**
- ASR code sample shows how to use [Faster Whisper](https://github.com/SYSTRAN/faster-whisper) to run Whisper Speech Recognition on an Aria audio stream. The ASR outputs are time aligned with [Aria Device Time](https://facebookresearch.github.io/projectaria_tools/docs/data_formats/aria_vrs/timestamps_in_aria_vrs#vrs-timestamps-single-device). Go to the [Automated Speech Recognition Readme](https://github.com/facebookresearch/projectaria_tools/blob/main/tools/samples/python/automated_speech_recognition/Readme.md) for how to get started.

**[MPS CLI]**
- Support for new MPS service, [hand tracking](https://facebookresearch.github.io/projectaria_tools/docs/ARK/sw_release_notes#new-hand-tracking-mps-wrist-and-palm-tracking)
- Updated Eye Tracking to support [depth estimation](https://facebookresearch.github.io/projectaria_tools/docs/ARK/sw_release_notes#update-to-eye-gaze-outputs---depth-estimations)

**[Documentation]**
- Various improvements, including:
- New [MPS Troubleshooting](https://facebookresearch.github.io/projectaria_tools/docs/ARK/mps/mps_troubleshooting) page
- New [Collaborative Tools Page](https://facebookresearch.github.io/projectaria_tools/docs/collaborative_tools), did you know you can use Aria data with Nerfstudio?
- New [Hand Tracking Data Formats](https://facebookresearch.github.io/projectaria_tools/docs/data_formats/mps/hand_tracking)
- Updated [MPS Google Colab tutorials](https://facebookresearch.github.io/projectaria_tools/docs/data_utilities/getting_started#running--jupyter-notebooks-on-google-colab)