We’d like to announce the release of Hyperleaup 0.1.2, which introduces the following improvements:
- Adds an experimental `LARGEFILE` creation mode option to improve performance when creating a Hyper file for a large dataset. It does this by saving multiple files and using an array of Parquet file paths in the Tableau Hyper API `COPY` command.
_Note_: This creation mode only works with the Databricks File System (DBFS).
Credits: Dustin Vannoy (dustinvannoy-db)