Lancedb

🛠 Breaking Changes

- feat!: upgrade Lance to 0.18.0 by LuQQiu in https://github.com/lancedb/lancedb/pull/1657

🎉 New Features

- feat: implement Remote connection for LanceDB Rust by wjones127 in https://github.com/lancedb/lancedb/pull/1639
- feat(node): let NODE API region default to us-east-1 by LuQQiu in https://github.com/lancedb/lancedb/pull/1631
- feat: fix creating empty table and creating table by a list of RecordBatch for remote python sdk by eddyxu in https://github.com/lancedb/lancedb/pull/1650
- feat(rust): remote endpoints for schema, version, count_rows by wjones127 in https://github.com/lancedb/lancedb/pull/1644
- feat(rust): remote client write data endpoint by wjones127 in https://github.com/lancedb/lancedb/pull/1645
- feat!: upgrade Lance to 0.18.0 by LuQQiu in https://github.com/lancedb/lancedb/pull/1657

🐛 Bug Fixes

- fix: support pyarrow input types by LuQQiu in https://github.com/lancedb/lancedb/pull/1628
- fix: add appropriate QueryBuilder overloads to LanceTable.search by sayandipdutta in https://github.com/lancedb/lancedb/pull/1558
- fix: unterminated string literal on table update by sayandipdutta in https://github.com/lancedb/lancedb/pull/1573
- fix: allow pass optional args in colbert reranker by AyushExel in https://github.com/lancedb/lancedb/pull/1649

📚 Documentation

- docs: improve the docs and API param name by BubbleCal in https://github.com/lancedb/lancedb/pull/1629
- docs: rag section in guide by PrashantDixit0 in https://github.com/lancedb/lancedb/pull/1619
- docs: update FTS docs for JS SDK by BubbleCal in https://github.com/lancedb/lancedb/pull/1634
- docs: add understand embeddings v1 by rithikJha in https://github.com/lancedb/lancedb/pull/1643
- docs: hnsw documentation by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1640

🔧 Build and CI

- ci: enable java auto release by LuQQiu in https://github.com/lancedb/lancedb/pull/1602



python-v0.14.0-beta.0
🛠 Breaking Changes

- feat!: upgrade Lance to 0.18.0 by LuQQiu in https://github.com/lancedb/lancedb/pull/1657
- Lance file format v2.0 is now the default for new tables. You can still use v1.x by passing `data_storage_version="legacy"` when creating a table.

🎉 New Features

- feat: implement Remote connection for LanceDB Rust by wjones127 in https://github.com/lancedb/lancedb/pull/1639
- feat(node): let NODE API region default to us-east-1 by LuQQiu in https://github.com/lancedb/lancedb/pull/1631
- feat: fix creating empty table and creating table by a list of RecordBatch for remote python sdk by eddyxu in https://github.com/lancedb/lancedb/pull/1650
- feat(rust): remote endpoints for schema, version, count_rows by wjones127 in https://github.com/lancedb/lancedb/pull/1644
- feat(rust): remote client write data endpoint by wjones127 in https://github.com/lancedb/lancedb/pull/1645
- feat!: upgrade Lance to 0.18.0 by LuQQiu in https://github.com/lancedb/lancedb/pull/1657

🐛 Bug Fixes

- fix: support pyarrow input types by LuQQiu in https://github.com/lancedb/lancedb/pull/1628
- fix: add appropriate QueryBuilder overloads to LanceTable.search by sayandipdutta in https://github.com/lancedb/lancedb/pull/1558
- fix: unterminated string literal on table update by sayandipdutta in https://github.com/lancedb/lancedb/pull/1573
- fix: allow pass optional args in colbert reranker by AyushExel in https://github.com/lancedb/lancedb/pull/1649

📚 Documentation

- docs: improve the docs and API param name by BubbleCal in https://github.com/lancedb/lancedb/pull/1629
- docs: rag section in guide by PrashantDixit0 in https://github.com/lancedb/lancedb/pull/1619
- docs: update FTS docs for JS SDK by BubbleCal in https://github.com/lancedb/lancedb/pull/1634
- docs: add understand embeddings v1 by rithikJha in https://github.com/lancedb/lancedb/pull/1643
- docs: hnsw documentation by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1640

🔧 Build and CI

- ci: enable java auto release by LuQQiu in https://github.com/lancedb/lancedb/pull/1602

🛠 Breaking Changes

- feat!: migrate FTS from tantivy to lance-index by BubbleCal in https://github.com/lancedb/lancedb/pull/1483
- feat!: better api for manual hybrid queries by AyushExel in https://github.com/lancedb/lancedb/pull/1575

🎉 New Features

- feat!: migrate FTS from tantivy to lance-index by BubbleCal in https://github.com/lancedb/lancedb/pull/1483
- feat(python): add to_list to async api by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1520
- feat: create bitmap and label list scalar index using python async api by eddyxu in https://github.com/lancedb/lancedb/pull/1529
- feat(nodejs): add bitmap and label list index types in nodejs by eddyxu in https://github.com/lancedb/lancedb/pull/1532
- feat: allow new scalar index types to be created in remote table by rpgreen in https://github.com/lancedb/lancedb/pull/1538
- feat(nodejs): add delete unverified by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1530
- feat(python): add delete unverified parameter by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1542
- feat: support to query/index FTS on RemoteTable/AsyncTable by BubbleCal in https://github.com/lancedb/lancedb/pull/1537
- feat: add answerdotai rerankers support and minor improvements by AyushExel in https://github.com/lancedb/lancedb/pull/1560
- feat!: better api for manual hybrid queries by AyushExel in https://github.com/lancedb/lancedb/pull/1575
- feat: update default reranker to RRF by AyushExel in https://github.com/lancedb/lancedb/pull/1580
- feat(python, rust): expose offset in query by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1556
- feat: support to create table from record batch iterator by BubbleCal in https://github.com/lancedb/lancedb/pull/1593
- feat: upgrade lance to v0.17.0 by wjones127 in https://github.com/lancedb/lancedb/pull/1608
- feat: enable phrase_query(bool) for hybrid search queries by jameswu1991 in https://github.com/lancedb/lancedb/pull/1578
- feat: add flag to enable faster manifest paths by wjones127 in https://github.com/lancedb/lancedb/pull/1612
- feat(nodejs): expose offset by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1620
- feat: support to build FTS without positions by BubbleCal in https://github.com/lancedb/lancedb/pull/1621
- feat: expose hnsw indices by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1595

🐛 Bug Fixes

- fix: remove native.d.ts from .npmignore by mattbasta in https://github.com/lancedb/lancedb/pull/1531
- fix: rerank attribute unknown by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1554
- fix(bug): limit fix by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1548
- fix(node): read consistency level fix by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1567
- fix: specify column to search for FTS by BubbleCal in https://github.com/lancedb/lancedb/pull/1572
- docs: removed the unnecessary fence code tag by ousiax in https://github.com/lancedb/lancedb/pull/1599
- fix(python): remove unmaintained ratelimiter dependency by antoniomdk in https://github.com/lancedb/lancedb/pull/1603

📚 Documentation

- docs: add lancedb embedding fcn on cloud docs by AyushExel in https://github.com/lancedb/lancedb/pull/1521
- docs: add `create_fts_index` doc in Python API Reference by BubbleCal in https://github.com/lancedb/lancedb/pull/1533
- docs: add vector search example by rithikJha in https://github.com/lancedb/lancedb/pull/1543
- docs: add a section to describe scalar index by eddyxu in https://github.com/lancedb/lancedb/pull/1495
- docs: add chatbot example and improve quality of other examples by rithikJha in https://github.com/lancedb/lancedb/pull/1544
- docs: add evaluation example by rithikJha in https://github.com/lancedb/lancedb/pull/1552
- docs: add AI agent example by rithikJha in https://github.com/lancedb/lancedb/pull/1553
- docs: add dlt-lancedb integration page by rahuljo in https://github.com/lancedb/lancedb/pull/1551
- docs: add recommender system example by rithikJha in https://github.com/lancedb/lancedb/pull/1561
- docs: update serverless_lancedb_with_s3_and_lambda.md by bllchmbrs in https://github.com/lancedb/lancedb/pull/1559
- docs: revamp embedding models by rithikJha in https://github.com/lancedb/lancedb/pull/1568
- docs: fix links, convert backslash to forward slash in mkdocs.yml by rithikJha in https://github.com/lancedb/lancedb/pull/1571
- docs: revamp Python example: Overview page and remove redundant examples and notebooks by rithikJha in https://github.com/lancedb/lancedb/pull/1574
- docs: add hnsw docs by AyushExel in https://github.com/lancedb/lancedb/pull/1570
- docs: improve overall language on all example pages by rithikJha in https://github.com/lancedb/lancedb/pull/1582
- docs: add multi-vector reranking, answerdotai and studies section by AyushExel in https://github.com/lancedb/lancedb/pull/1579
- docs: fix links - quick start to embedding by rithikJha in https://github.com/lancedb/lancedb/pull/1591
- docs: removed the unnecessary fence code tag by ousiax in https://github.com/lancedb/lancedb/pull/1599
- docs: add changes to Embeddings-> Available models-> overview page by rithikJha in https://github.com/lancedb/lancedb/pull/1596
- docs: fix get_registry() usage by philz in https://github.com/lancedb/lancedb/pull/1601
- docs: added a blank line between a paragraph and a list block by ousiax in https://github.com/lancedb/lancedb/pull/1604

🔧 Build and CI

- ci: public java package by eddyxu in https://github.com/lancedb/lancedb/pull/1485



python-v0.13.0
🛠 Breaking Changes

- feat!: migrate FTS from tantivy to lance-index by BubbleCal in https://github.com/lancedb/lancedb/pull/1483
- feat!: better api for manual hybrid queries by AyushExel in https://github.com/lancedb/lancedb/pull/1575

🎉 New Features

- feat!: migrate FTS from tantivy to lance-index by BubbleCal in https://github.com/lancedb/lancedb/pull/1483
- feat(python): add to_list to async api by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1520
- feat: create bitmap and label list scalar index using python async api by eddyxu in https://github.com/lancedb/lancedb/pull/1529
- feat(nodejs): add bitmap and label list index types in nodejs by eddyxu in https://github.com/lancedb/lancedb/pull/1532
- feat: allow new scalar index types to be created in remote table by rpgreen in https://github.com/lancedb/lancedb/pull/1538
- feat(nodejs): add delete unverified by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1530
- feat(python): add delete unverified parameter by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1542
- feat: support to query/index FTS on RemoteTable/AsyncTable by BubbleCal in https://github.com/lancedb/lancedb/pull/1537
- feat: add answerdotai rerankers support and minor improvements by AyushExel in https://github.com/lancedb/lancedb/pull/1560
- feat!: better api for manual hybrid queries by AyushExel in https://github.com/lancedb/lancedb/pull/1575
- feat: update default reranker to RRF by AyushExel in https://github.com/lancedb/lancedb/pull/1580
- feat(python, rust): expose offset in query by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1556
- feat: support to create table from record batch iterator by BubbleCal in https://github.com/lancedb/lancedb/pull/1593
- feat: upgrade lance to v0.17.0 by wjones127 in https://github.com/lancedb/lancedb/pull/1608
- feat: enable phrase_query(bool) for hybrid search queries by jameswu1991 in https://github.com/lancedb/lancedb/pull/1578
- feat: add flag to enable faster manifest paths by wjones127 in https://github.com/lancedb/lancedb/pull/1612
- feat(nodejs): expose offset by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1620
- feat: support to build FTS without positions by BubbleCal in https://github.com/lancedb/lancedb/pull/1621
- feat: expose hnsw indices by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1595

🐛 Bug Fixes

- fix: remove native.d.ts from .npmignore by mattbasta in https://github.com/lancedb/lancedb/pull/1531
- fix: rerank attribute unknown by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1554
- fix(bug): limit fix by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1548
- fix(node): read consistency level fix by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1567
- fix: specify column to search for FTS by BubbleCal in https://github.com/lancedb/lancedb/pull/1572
- docs: removed the unnecessary fence code tag by ousiax in https://github.com/lancedb/lancedb/pull/1599
- fix(python): remove unmaintained ratelimiter dependency by antoniomdk in https://github.com/lancedb/lancedb/pull/1603

📚 Documentation

- docs: add lancedb embedding fcn on cloud docs by AyushExel in https://github.com/lancedb/lancedb/pull/1521
- docs: add `create_fts_index` doc in Python API Reference by BubbleCal in https://github.com/lancedb/lancedb/pull/1533
- docs: add vector search example by rithikJha in https://github.com/lancedb/lancedb/pull/1543
- docs: add a section to describe scalar index by eddyxu in https://github.com/lancedb/lancedb/pull/1495
- docs: add chatbot example and improve quality of other examples by rithikJha in https://github.com/lancedb/lancedb/pull/1544
- docs: add evaluation example by rithikJha in https://github.com/lancedb/lancedb/pull/1552
- docs: add AI agent example by rithikJha in https://github.com/lancedb/lancedb/pull/1553
- docs: add dlt-lancedb integration page by rahuljo in https://github.com/lancedb/lancedb/pull/1551
- docs: add recommender system example by rithikJha in https://github.com/lancedb/lancedb/pull/1561
- docs: update serverless_lancedb_with_s3_and_lambda.md by bllchmbrs in https://github.com/lancedb/lancedb/pull/1559
- docs: revamp embedding models by rithikJha in https://github.com/lancedb/lancedb/pull/1568
- docs: fix links, convert backslash to forward slash in mkdocs.yml by rithikJha in https://github.com/lancedb/lancedb/pull/1571
- docs: revamp Python example: Overview page and remove redundant examples and notebooks by rithikJha in https://github.com/lancedb/lancedb/pull/1574
- docs: add hnsw docs by AyushExel in https://github.com/lancedb/lancedb/pull/1570
- docs: improve overall language on all example pages by rithikJha in https://github.com/lancedb/lancedb/pull/1582
- docs: add multi-vector reranking, answerdotai and studies section by AyushExel in https://github.com/lancedb/lancedb/pull/1579
- docs: fix links - quick start to embedding by rithikJha in https://github.com/lancedb/lancedb/pull/1591
- docs: removed the unnecessary fence code tag by ousiax in https://github.com/lancedb/lancedb/pull/1599
- docs: add changes to Embeddings-> Available models-> overview page by rithikJha in https://github.com/lancedb/lancedb/pull/1596
- docs: fix get_registry() usage by philz in https://github.com/lancedb/lancedb/pull/1601
- docs: added a blank line between a paragraph and a list block by ousiax in https://github.com/lancedb/lancedb/pull/1604

🔧 Build and CI

- ci: public java package by eddyxu in https://github.com/lancedb/lancedb/pull/1485

🎉 New Features

- feat: allow new scalar index types to be created in remote table by rpgreen in https://github.com/lancedb/lancedb/pull/1538
- feat(nodejs): add delete unverified by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1530
- feat(python): add delete unverified parameter by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1542
- feat: support to query/index FTS on RemoteTable/AsyncTable by BubbleCal in https://github.com/lancedb/lancedb/pull/1537

🐛 Bug Fixes

- fix: remove native.d.ts from .npmignore by mattbasta in https://github.com/lancedb/lancedb/pull/1531
- fix: rerank attribute unknown by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1554

📚 Documentation

- docs: add `create_fts_index` doc in Python API Reference by BubbleCal in https://github.com/lancedb/lancedb/pull/1533
- docs: add vector search example by rithikJha in https://github.com/lancedb/lancedb/pull/1543
- docs: add a section to describe scalar index by eddyxu in https://github.com/lancedb/lancedb/pull/1495
- docs: add chatbot example and improve quality of other examples by rithikJha in https://github.com/lancedb/lancedb/pull/1544
- docs: add evaluation example by rithikJha in https://github.com/lancedb/lancedb/pull/1552
- docs: add AI agent example by rithikJha in https://github.com/lancedb/lancedb/pull/1553
- docs: add dlt-lancedb integration page by rahuljo in https://github.com/lancedb/lancedb/pull/1551



python-v0.13.0-beta.1
🎉 New Features

- feat: allow new scalar index types to be created in remote table by rpgreen in https://github.com/lancedb/lancedb/pull/1538
- feat(nodejs): add delete unverified by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1530
- feat(python): add delete unverified parameter by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1542
- feat: support to query/index FTS on RemoteTable/AsyncTable by BubbleCal in https://github.com/lancedb/lancedb/pull/1537

🐛 Bug Fixes

- fix: remove native.d.ts from .npmignore by mattbasta in https://github.com/lancedb/lancedb/pull/1531
- fix: rerank attribute unknown by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1554

📚 Documentation

- docs: add `create_fts_index` doc in Python API Reference by BubbleCal in https://github.com/lancedb/lancedb/pull/1533
- docs: add vector search example by rithikJha in https://github.com/lancedb/lancedb/pull/1543
- docs: add a section to describe scalar index by eddyxu in https://github.com/lancedb/lancedb/pull/1495
- docs: add chatbot example and improve quality of other examples by rithikJha in https://github.com/lancedb/lancedb/pull/1544
- docs: add evaluation example by rithikJha in https://github.com/lancedb/lancedb/pull/1552
- docs: add AI agent example by rithikJha in https://github.com/lancedb/lancedb/pull/1553
- docs: add dlt-lancedb integration page by rahuljo in https://github.com/lancedb/lancedb/pull/1551

🛠 Breaking Changes

- feat!: migrate FTS from tantivy to lance-index by BubbleCal in https://github.com/lancedb/lancedb/pull/1483

🎉 New Features

- feat!: migrate FTS from tantivy to lance-index by BubbleCal in https://github.com/lancedb/lancedb/pull/1483
- feat(python): add to_list to async api by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1520
- feat: create bitmap and label list scalar index using python async api by eddyxu in https://github.com/lancedb/lancedb/pull/1529
- feat(nodejs): add bitmap and label list index types in nodejs by eddyxu in https://github.com/lancedb/lancedb/pull/1532

📚 Documentation

- docs: add lancedb embedding fcn on cloud docs by AyushExel in https://github.com/lancedb/lancedb/pull/1521



python-v0.13.0-beta.0
🛠 Breaking Changes

- feat!: migrate FTS from tantivy to lance-index by BubbleCal in https://github.com/lancedb/lancedb/pull/1483

🎉 New Features

- feat!: migrate FTS from tantivy to lance-index by BubbleCal in https://github.com/lancedb/lancedb/pull/1483
- feat(python): add to_list to async api by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1520
- feat: create bitmap and label list scalar index using python async api by eddyxu in https://github.com/lancedb/lancedb/pull/1529
- feat(nodejs): add bitmap and label list index types in nodejs by eddyxu in https://github.com/lancedb/lancedb/pull/1532

📚 Documentation

- docs: add lancedb embedding fcn on cloud docs by AyushExel in https://github.com/lancedb/lancedb/pull/1521

🛠 Breaking Changes

- feat!: upgrade lance to 0.16 by eddyxu in https://github.com/lancedb/lancedb/pull/1519

🎉 New Features

- feat!: upgrade lance to 0.16 by eddyxu in https://github.com/lancedb/lancedb/pull/1519

🐛 Bug Fixes

- fix: run java stages in parallel by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1472
- fix: return LanceMergeInsertBuilder in overridden merge_insert method on remote table by rpgreen in https://github.com/lancedb/lancedb/pull/1484
- fix(nodejs): address import issues in `lancedb` npm module by wjones127 in https://github.com/lancedb/lancedb/pull/1503
- fix(node): export optimize options by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1518

📚 Documentation

- docs: custom embedding function for ts by universalmind303 in https://github.com/lancedb/lancedb/pull/1479
- docs: update examples docs by rithikJha in https://github.com/lancedb/lancedb/pull/1488
- docs: revamp example docs by rithikJha in https://github.com/lancedb/lancedb/pull/1512

🔧 Build and CI

- ci: fix release by upgrading to Node 18 by wjones127 in https://github.com/lancedb/lancedb/pull/1494



python-v0.12.0
🛠 Breaking Changes

- feat!: upgrade lance to 0.16 by eddyxu in https://github.com/lancedb/lancedb/pull/1519

🎉 New Features

- feat(python): add watsonx embeddings to registry by h0rv in https://github.com/lancedb/lancedb/pull/1486
- feat(python): multi-vector reranking support by AyushExel in https://github.com/lancedb/lancedb/pull/1481
- feat(python): support embedding functions in remote table by AyushExel in https://github.com/lancedb/lancedb/pull/1405
- feat(python): index config repr method by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1509
- feat(python): optimize stats repr method by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1510
- feat!: upgrade lance to 0.16 by eddyxu in https://github.com/lancedb/lancedb/pull/1519

🐛 Bug Fixes

- fix: run java stages in parallel by gagan-bhullar-tech in https://github.com/lancedb/lancedb/pull/1472
- fix: return LanceMergeInsertBuilder in overridden merge_insert method on remote table by rpgreen in https://github.com/lancedb/lancedb/pull/1484

📚 Documentation

- docs: custom embedding function for ts by universalmind303 in https://github.com/lancedb/lancedb/pull/1479
- docs: update examples docs by rithikJha in https://github.com/lancedb/lancedb/pull/1488
- docs: revamp example docs by rithikJha in https://github.com/lancedb/lancedb/pull/1512

🔧 Build and CI

- ci: fix release by upgrading to Node 18 by wjones127 in https://github.com/lancedb/lancedb/pull/1494