Docarray

> Release time: 2023-12-22 12:12:15



🙇 We'd like to thank all contributors for this new release! In particular,
954, Joan Fontanals, Tony Yang, Naymul Islam, Ben Shaver, Jina Dev Bot, 🙇


🆕 New Features

- [[ff00b604](https://github.com/jina-ai/docarray/commit/ff00b6049f5f50bae4786f310907424b45791104)] __-__ __index__: add epsilla connector (#1835) (*Tony Yang*)
- [[522811f4](https://github.com/jina-ai/docarray/commit/522811f4b47e1c0f30fe13bb84c7625e349d0656)] __-__ use literal in type hints (#1827) (*Ben Shaver*)

🐞 Bug fixes

- [[1f86e263](https://github.com/jina-ai/docarray/commit/1f86e263effaeab61f9c9e42becd37622595cd96)] __-__ error type hints in Python3.12 (#1147) (1840) (*954*)
- [[21e107bd](https://github.com/jina-ai/docarray/commit/21e107bdaaae319c728c141a076d44738b7ec32e)] __-__ fix issue serializing deserializing complex schemas (#1836) (*Joan Fontanals*)
- [[3cfa0b8f](https://github.com/jina-ai/docarray/commit/3cfa0b8ff877d95cef0637f7f177499f0a9c6cfd)] __-__ fix storage issue in torchtensor class (#1833) (*Naymul Islam*)

📗 Documentation

- [[a2421a6a](https://github.com/jina-ai/docarray/commit/a2421a6a86e4e42a10771e7070be7932caeb1d33)] __-__ __epsilla__: add epsilla integration guide (#1838) (*Tony Yang*)
- [[82918fe7](https://github.com/jina-ai/docarray/commit/82918fe7b6207ac112e096f88cccc71d80fc0afe)] __-__ fix sign commit commad in docs (#1834) (*Naymul Islam*)

🍹 Other Improvements

- [[0e183ff0](https://github.com/jina-ai/docarray/commit/0e183ff0d48555b56fa34989513ac4fb53135626)] __-__ upgrade version (#1841) (*Joan Fontanals*)
- [[8de3e175](https://github.com/jina-ai/docarray/commit/8de3e1757bdb23b509ad2630219c3c26605308f0)] __-__ refactor test of the torchtensor (#1837) (*Naymul Islam*)
- [[d5d928b8](https://github.com/jina-ai/docarray/commit/d5d928b82f36a3279277c07bed44fd22bb0bba34)] __-__ __version__: the next version will be 0.39.2 (*Jina Dev Bot*)

> Release time: 2023-10-23 08:56:38



🙇 We'd like to thank all contributors for this new release! In particular,
Joan Fontanals, Johannes Messner, dependabot[bot], Jina Dev Bot, 🙇


🐞 Bug fixes

- [[98d1f1f0](https://github.com/jina-ai/docarray/commit/98d1f1f0a61851883c9598ce17d8f58594939c26)] __-__ from_dataframe with numpy==1.26.1 and type handling in python 3.9 (#1823) (*Johannes Messner*)

🍹 Other Improvements

- [[6094854a](https://github.com/jina-ai/docarray/commit/6094854a5c113d58e55b98f778624766ac1c82f6)] __-__ update version before patch release (#1826) (*Joan Fontanals*)
- [[7479f59a](https://github.com/jina-ai/docarray/commit/7479f59a69616256cf61679a5a3246f376c22af0)] __-__ __deps__: bump pillow from 9.3.0 to 10.0.1 (#1819) (*dependabot[bot]*)
- [[08bfa9cf](https://github.com/jina-ai/docarray/commit/08bfa9cfae4d23bed2cd794f67fc5581a0f33133)] __-__ __version__: the next version will be 0.39.1 (*Jina Dev Bot*)

<a name=release-note-0-40-0></a>

> Release time: 2023-10-02 13:06:02



🙇 We'd like to thank all contributors for this new release! In particular,
Joan Fontanals, samsja, lvzi, Puneeth K, Jina Dev Bot, 🙇


🆕 New Features

- [[83d2236a](https://github.com/jina-ai/docarray/commit/83d2236a356bd108e686abae20a06c7fbc12899f)] __-__ enable dynamic doc with Pydantic v2 (#1795) (*Joan Fontanals*)
- [[2a1cc9e4](https://github.com/jina-ai/docarray/commit/2a1cc9e4c975cef50760c8a459d4be30a4da4116)] __-__ add BaseDocWithoutId (#1803) (*samsja*)
- [[8fba9e45](https://github.com/jina-ai/docarray/commit/8fba9e45f995f2d65efbea2c837f2f70dfe3e858)] __-__ remove JAC (#1791) (*Joan Fontanals*)
- [[715252a7](https://github.com/jina-ai/docarray/commit/715252a72177e83cb81736106f34d0ab2960ce56)] __-__ hybrid pydantic support for both v1 and v2 (#1652) (*samsja*)

🐞 Bug fixes

- [[c2b08fa5](https://github.com/jina-ai/docarray/commit/c2b08fa5cd9fab30fc4a1fe61d1373e943912fe7)] __-__ docstring tests with pydantic v2 (#1816) (*samsja*)
- [[3da3603b](https://github.com/jina-ai/docarray/commit/3da3603b6a0f69016504fcbb2cd303d68cf764ec)] __-__ allow config extension in pydantic v2 (#1814) (*samsja*)
- [[4a1bc26a](https://github.com/jina-ai/docarray/commit/4a1bc26a15dd02bbefa5607519f992a283bae975)] __-__ allow nested model dump via docvec (#1808) (*samsja*)
- [[26d776dd](https://github.com/jina-ai/docarray/commit/26d776dd4b49ee17d92b9c97b0af9ff4ab5a4cdc)] __-__ validate before (#1806) (*samsja*)
- [[7209b784](https://github.com/jina-ai/docarray/commit/7209b7849a2f9afd8cb98e01f80591d30ba28ec7)] __-__ fix double subscriptable error (#1800) (*Joan Fontanals*)
- [[2937e253](https://github.com/jina-ai/docarray/commit/2937e253f8a946872a310b93de5c706279eb5adb)] __-__ make DocList compatible with BaseDocWithoutId (#1805) (*samsja*)
- [[0148e99c](https://github.com/jina-ai/docarray/commit/0148e99c47ae9e1fc02c5bfc2ee717afa0633748)] __-__ milvus connection para missing (#1802) (*lvzi*)
- [[2f3b85e3](https://github.com/jina-ai/docarray/commit/2f3b85e333446cfa9b8c4877c4ccf9ae49cae660)] __-__ raise exception when type of DocList is object (#1794) (*Puneeth K*)

🧼 Code Refactoring

- [[3718a747](https://github.com/jina-ai/docarray/commit/3718a747c806b87e331903b73747d864ace42725)] __-__ add is_index_empty API (#1801) (*Joan Fontanals*)

📗 Documentation

- [[061bd81a](https://github.com/jina-ai/docarray/commit/061bd81aa3307f13281c1c51b0ef79761cd7c5a5)] __-__ fix documentation for pydantic v2 (#1815) (*samsja*)
- [[d0b99909](https://github.com/jina-ai/docarray/commit/d0b99909052d1640670764015e4e385319fdc776)] __-__ adding field descriptions to predefined mesh 3D document (#1789) (*Puneeth K*)
- [[18d3afce](https://github.com/jina-ai/docarray/commit/18d3afceb1a9206c1b6f9184e7d720f4f09510c9)] __-__ adding field descriptions to predefined point cloud 3D document (#1792) (*Puneeth K*)
- [[4ef49394](https://github.com/jina-ai/docarray/commit/4ef493943d1ee73613b51800980239a30fe5ae73)] __-__ adding field descriptions to predefined video document (#1775) (*Puneeth K*)
- [[68cc1423](https://github.com/jina-ai/docarray/commit/68cc1423058c18d27f13cae3bd307fba5d6e9aaa)] __-__ adding field descriptions to predefined text document (#1770) (*Puneeth K*)
- [[441db26d](https://github.com/jina-ai/docarray/commit/441db26dc3e58d72b44595131b42aa411c98774d)] __-__ adding field descriptions to predefined image document (#1772) (*Puneeth K*)
- [[35d2138c](https://github.com/jina-ai/docarray/commit/35d2138c2d7d246b6de87de829dd870d05fc54bf)] __-__ adding field descriptions to predefined audio document (#1774) (*Puneeth K*)

🏁 Unit Test and CICD

- [[9a6b1e64](https://github.com/jina-ai/docarray/commit/9a6b1e646e1ce5c97b81413f83b0b5a12a2c4732)] __-__ move the pydantic check inside test (#1812) (*Joan Fontanals*)
- [[92de15e6](https://github.com/jina-ai/docarray/commit/92de15e6a6b42d4afe34b744e0c4f1ae581861bc)] __-__ remove skip of s3 (#1811) (*Joan Fontanals*)
- [[bfac0939](https://github.com/jina-ai/docarray/commit/bfac09399a514073bcde6c72535942623ecc0e84)] __-__ remove skips (#1809) (*Joan Fontanals*)
- [[dce39075](https://github.com/jina-ai/docarray/commit/dce3907560b987b9c5fc956c7ccf0cf38405d798)] __-__ fix test (#1807) (*Joan Fontanals*)
- [[8f32866e](https://github.com/jina-ai/docarray/commit/8f32866e1cd3aa139a88cfca2beaa502656dc76b)] __-__ remove skipif for pydantic (#1796) (*Joan Fontanals*)

🍹 Other Improvements

- [[7693cf7c](https://github.com/jina-ai/docarray/commit/7693cf7c27b94d616bae37a183cc9c734bc285ee)] __-__ update version to 0.39.0 (#1818) (*Joan Fontanals*)
- [[a4fdb77d](https://github.com/jina-ai/docarray/commit/a4fdb77db92af2e49b8a9680950439f9ca5c1870)] __-__ fix failing test (#1793) (*Joan Fontanals*)
- [[805a9825](https://github.com/jina-ai/docarray/commit/805a9825fd59848bb205461e9da71934395c0768)] __-__ __version__: the next version will be 0.38.1 (*Jina Dev Bot*)

<a name=release-note-0-39-1></a>

> Release time: 2023-09-07 13:40:16



🙇 We'd like to thank all contributors for this new release! In particular,
Joan Fontanals, Johannes Messner, samsja, AlaeddineAbdessalem, Jina Dev Bot, 🙇


🐞 Bug fixes

- [[fb174560](https://github.com/jina-ai/docarray/commit/fb174560aad3b2d554c14cefeef940f8030dfdd2)] __-__ skip doc attributes in __annotations__ but not in __fields__ (#1777) (*Joan Fontanals*)
- [[3dc525f4](https://github.com/jina-ai/docarray/commit/3dc525f46d8a8771b7f18070beae0c0758371dd6)] __-__ make DocList.to_json() return str instead of bytes (#1769) (*Johannes Messner*)
- [[2af8a0c6](https://github.com/jina-ai/docarray/commit/2af8a0c60213a46f2b86e4c418bb5d3ef732051c)] __-__ casting in reduce before appending (#1758) (*AlaeddineAbdessalem*)

🧼 Code Refactoring

- [[08ca686d](https://github.com/jina-ai/docarray/commit/08ca686dd397b103e6330cd479ad4519126f90b6)] __-__ use safe_issubclass (#1778) (*Joan Fontanals*)

📗 Documentation

- [[189ff637](https://github.com/jina-ai/docarray/commit/189ff637e790c59dfea1af3447666b34c9fb9fdf)] __-__ explain how to set document config (#1773) (*Johannes Messner*)
- [[cd4854c9](https://github.com/jina-ai/docarray/commit/cd4854c9b9e89abc5537be70a5a79d9a8ea47782)] __-__ add workaround for torch compile (#1754) (*Johannes Messner*)
- [[587ab5b3](https://github.com/jina-ai/docarray/commit/587ab5b39160bdeda1b86d3c09d2296c443cd42e)] __-__ add note about pickling dynamically created doc class (#1763) (*Joan Fontanals*)
- [[61bf9c7a](https://github.com/jina-ai/docarray/commit/61bf9c7a88a033e0551287fac5f1260fa4d355bf)] __-__ improve filtering docstrings (#1762) (*Joan Fontanals*)

🍹 Other Improvements

- [[7ec88b46](https://github.com/jina-ai/docarray/commit/7ec88b46e44b52d0400d1495e56387f367aabd2f)] __-__ update minor (#1781) (*Joan Fontanals*)
- [[cc2339db](https://github.com/jina-ai/docarray/commit/cc2339db44626e622f3b2f354d0c5f8d8a0b20ea)] __-__ remove pydantic ref from issue template (#1767) (*samsja*)
- [[d5cb02fb](https://github.com/jina-ai/docarray/commit/d5cb02fbd5cc7392fb92f30c1e7ea436507eb892)] __-__ __version__: the next version will be 0.37.2 (*Jina Dev Bot*)

<a name=release-note-0-39-0></a>

> Release time: 2023-08-22 14:09:53



🙇 We'd like to thank all contributors for this new release! In particular,
samsja, AlaeddineAbdessalem, TERBOUCHE Hacene, Joan Fontanals, Jina Dev Bot, 🙇


🐞 Bug fixes

- [[0ad18a63](https://github.com/jina-ai/docarray/commit/0ad18a63e6bb1073c080eb3ac304bd90439e878b)] __-__ bump version (#1757) (*samsja*)
- [[46c5dfd0](https://github.com/jina-ai/docarray/commit/46c5dfd0aa1f10723c99a3e9a39c099dc08710e8)] __-__ relax the schema check in update mixin (#1755) (*AlaeddineAbdessalem*)
- [[6c771125](https://github.com/jina-ai/docarray/commit/6c771125e5e278c5c176a35ccc619e90098c7339)] __-__ __qdrant__: fix non-class type fields #1748 (1752) (*TERBOUCHE Hacene*)
- [[adb0d014](https://github.com/jina-ai/docarray/commit/adb0d0141032c72cf2412a8b998c78cd9a920a9e)] __-__ fix dynamic class creation with doubly nested schemas (#1747) (*AlaeddineAbdessalem*)
- [[691d939e](https://github.com/jina-ai/docarray/commit/691d939e8021a2589c5d5106ec1270179618599d)] __-__ fix readme test (#1746) (*samsja*)

📗 Documentation

- [[a39c4f98](https://github.com/jina-ai/docarray/commit/a39c4f982331d6ef3145127797b1bcedc8e05248)] __-__ update readme (#1744) (*Joan Fontanals*)

🍹 Other Improvements

- [[bd3d8f03](https://github.com/jina-ai/docarray/commit/bd3d8f0354c56559c3ae8a30f06b566ed7945f6e)] __-__ __version__: the next version will be 0.37.1 (*Jina Dev Bot*)

<a name=release-note-0-38-0></a>

> Release time: 2023-08-03 03:11:16



🙇 We'd like to thank all contributors for this new release! In particular,
Joan Fontanals, Saba Sturua, Johannes Messner, Jina Dev Bot, 🙇


🆕 New Features

- [[31c2bb9c](https://github.com/jina-ai/docarray/commit/31c2bb9c00c2cea9e148d112c1d6226d7f6c19b9)] __-__ add description and example to ID field of BaseDoc (#1737) (*Joan Fontanals*)
- [[efeab90d](https://github.com/jina-ai/docarray/commit/efeab90d3840f94b15e7767a07be0f617cb8387c)] __-__ tensor_type for all DocVec serializations (#1679) (*Johannes Messner*)
- [[00e980dc](https://github.com/jina-ai/docarray/commit/00e980dcfc3872b7b833184169a777527387016b)] __-__ filtering in hnsw (#1718) (*Saba Sturua*)
- [[7ad70bfc](https://github.com/jina-ai/docarray/commit/7ad70bfc751841aee5f8747c681a259e2363cbe8)] __-__ update for inmemory index (#1724) (*Saba Sturua*)
- [[007f1131](https://github.com/jina-ai/docarray/commit/007f1131844975d812a040c85cc21b6fa19366bd)] __-__ support milvus (#1681) (*Saba Sturua*)
- [[c96707a1](https://github.com/jina-ai/docarray/commit/c96707a133e21b7810aa57da78fb2a49b448a41a)] __-__ InMemoryExactNNIndex pre filtering (#1713) (*Saba Sturua*)

🐞 Bug fixes

- [[d2c82d49](https://github.com/jina-ai/docarray/commit/d2c82d49e3a92e5d5ba29d1e4ce9b31435c73f95)] __-__ tensor equals type raises exception (#1739) (*Johannes Messner*)
- [[87ec19f8](https://github.com/jina-ai/docarray/commit/87ec19f83827cb2bc1c56087de3ef05d6bcd8e02)] __-__ add description and title to dynamic class (#1734) (*Joan Fontanals*)
- [[896c20be](https://github.com/jina-ai/docarray/commit/896c20be0c32c9dc9136f2eea7bdbb8e5cf2da0e)] __-__ create more info from dynamic (#1733) (*Joan Fontanals*)
- [[0e130100](https://github.com/jina-ai/docarray/commit/0e1301006403c59d99cd7c8ae77e6a7bef837838)] __-__ fix call to unsafe issubclass (#1731) (*Joan Fontanals*)
- [[4cd58500](https://github.com/jina-ai/docarray/commit/4cd5850062af4515bc2aebd2b1727372a49867dc)] __-__ collection and index name in qdrant (#1723) (*Joan Fontanals*)
- [[304a4e9b](https://github.com/jina-ai/docarray/commit/304a4e9b61a9eab7584cd3859a83663ddb3227ef)] __-__ fix deepcopy torchtensor (#1720) (*Joan Fontanals*)

🧼 Code Refactoring

- [[a643f6ad](https://github.com/jina-ai/docarray/commit/a643f6adada89dd1e7e4ddf0f92c3e27fb51a23b)] __-__ hnswlib performance (#1727) (*Joan Fontanals*)
- [[19aec21a](https://github.com/jina-ai/docarray/commit/19aec21aa043cbe3556744f871297ad9d171ba50)] __-__ do not recompute every time num_docs (#1729) (*Joan Fontanals*)

📗 Documentation

- [[7c10295c](https://github.com/jina-ai/docarray/commit/7c10295c964df273483bb0391ceeee35f57c9b28)] __-__ make document indices self-contained (#1678) (*Saba Sturua*)

🏁 Unit Test and CICD

- [[7be038c8](https://github.com/jina-ai/docarray/commit/7be038c8bcf48c77e45b7d2654b10b563603cd32)] __-__ refactor test to be independent (#1738) (*Joan Fontanals*)
- [[24c00cc8](https://github.com/jina-ai/docarray/commit/24c00cc8b7cb85f1e2ef3dea76df3382380e5c99)] __-__ refactor hnswlib test subindex (#1732) (*Joan Fontanals*)

🍹 Other Improvements

- [[77b4dc1f](https://github.com/jina-ai/docarray/commit/77b4dc1f1c24c1552b01489725205b7ebd55311c)] __-__ update version (#1743) (*Joan Fontanals*)
- [[3be6f2b9](https://github.com/jina-ai/docarray/commit/3be6f2b9eca79e154ca445524b6bf32ff5910fbc)] __-__ avoid extra debugging (#1730) (*Joan Fontanals*)
- [[24143a1f](https://github.com/jina-ai/docarray/commit/24143a1f7a3fbcbf33523b983eec8efd8817ebc4)] __-__ refactor filter in hnswlib (#1728) (*Joan Fontanals*)
- [[410665ad](https://github.com/jina-ai/docarray/commit/410665ad9ae59c0687c780bdfb2a65d8e8097f8a)] __-__ add JAX to README (#1722) (*Joan Fontanals*)
- [[2a866aea](https://github.com/jina-ai/docarray/commit/2a866aea9f2779ea59b6ed26177c65bbaee33d3a)] __-__ add link to roadmap in readme (#1715) (*Joan Fontanals*)
- [[68b0c5b8](https://github.com/jina-ai/docarray/commit/68b0c5b86c572f7f7f2fc3a4b838d7bd484ba77e)] __-__ __version__: the next version will be 0.36.1 (*Jina Dev Bot*)

<a name=release-note-0-37-1></a>