Hats-import

What's Changed
* Bump pre-commit-ci/lite-action from 1.0.2 to 1.0.3 by dependabot in https://github.com/astronomy-commons/hats-import/pull/399
* Bump dawidd6/action-download-artifact from 3 to 6 by dependabot in https://github.com/astronomy-commons/hats-import/pull/398
* Move sparse histogram to hipscat by camposandro in https://github.com/astronomy-commons/hats-import/pull/405
* Run conversion from main pipeline script. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/414
* Remove pandas metadata in hipscat conversion by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/413
* Support reading a file to pyarrow table in catalog import by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/415
* Merge development branch by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/417
* Update copier by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/416
* Keep track of expected number of margin rows written. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/418
* Fix calls to read_hats by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/420
* Update dependencies by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/421


**Full Changelog**: https://github.com/astronomy-commons/hats-import/compare/v0.4.0...v0.4.1

What's Changed
* Add additional ps1 type files from STScI by johnny-gossick in https://github.com/astronomy-commons/hats-import/pull/372
* Add package version property by camposandro in https://github.com/astronomy-commons/hats-import/pull/371
* Support user-supplied run_stages on catalog import by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/377
* Verify pandas read with compression kwarg. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/380
* Flag to include radec columns in index creation. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/378
* Bundle dependency requirements with release by camposandro in https://github.com/astronomy-commons/hats-import/pull/381
* Update LINCC logo with 2024 version by nevencaplar in https://github.com/astronomy-commons/hats-import/pull/383
* Remove temporary directory when all intermediate files are deleted by camposandro in https://github.com/astronomy-commons/hats-import/pull/382
* Benchmark and speed up to first stage of binning. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/385
* Replace FilePointer with universal pathlib by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/387
* Hats renaming by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/408
* Remove locally-created package before publishing. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/409
* Use virtual environment when creating requirements file by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/410
* Use stable sorts when sorting by the index by jeremykubica in https://github.com/astronomy-commons/hats-import/pull/411
* Create virtual environment and ignore changes to requirements file. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/412

New Contributors
* johnny-gossick made their first contribution in https://github.com/astronomy-commons/hats-import/pull/372
* nevencaplar made their first contribution in https://github.com/astronomy-commons/hats-import/pull/383

**Full Changelog**: https://github.com/astronomy-commons/hats-import/compare/v0.3.5...v0.4.0

What's Changed
* Add additional ps1 type files from STScI by johnny-gossick in https://github.com/astronomy-commons/hats-import/pull/372
* Add package version property by camposandro in https://github.com/astronomy-commons/hats-import/pull/371
* Support user-supplied run_stages on catalog import by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/377
* Verify pandas read with compression kwarg. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/380
* Flag to include radec columns in index creation. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/378
* Bundle dependency requirements with release by camposandro in https://github.com/astronomy-commons/hats-import/pull/381
* Update LINCC logo with 2024 version by nevencaplar in https://github.com/astronomy-commons/hats-import/pull/383
* Remove temporary directory when all intermediate files are deleted by camposandro in https://github.com/astronomy-commons/hats-import/pull/382
* Benchmark and speed up to first stage of binning. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/385
* Replace FilePointer with universal pathlib by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/387
* Hats renaming by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/408
* Remove locally-created package before publishing. by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/409
* Use virtual environment when creating requirements file by delucchi-cmu in https://github.com/astronomy-commons/hats-import/pull/410

New Contributors
* johnny-gossick made their first contribution in https://github.com/astronomy-commons/hats-import/pull/372
* nevencaplar made their first contribution in https://github.com/astronomy-commons/hats-import/pull/383

**Full Changelog**: https://github.com/astronomy-commons/hats-import/compare/v0.3.5...v0.3.6b0

What's Changed
* Bump actions/add-to-project from 1.0.1 to 1.0.2 by dependabot in https://github.com/astronomy-commons/hipscat-import/pull/340
* Use list of names, instead of pandas index. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/343
* Enable python 3.12 in CI by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/329
* Use hipscat for healpix dependency. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/346
* Check the total number of rows throughout the catalog import pipeline by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/345
* Use consistent pandas file io method. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/349
* Read parquet files with arrow schema by camposandro in https://github.com/astronomy-commons/hipscat-import/pull/348
* Fix CSV reader from recent changes in hipscat library by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/359
* Add schema to source data in SOAP pipeline by camposandro in https://github.com/astronomy-commons/hipscat-import/pull/360
* Provide `drop_empty_siblings` argument by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/357
* Margin generation improvements. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/356
* Use total returned from write_parquet_metadata by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/365
* Change default margin order by hombit in https://github.com/astronomy-commons/hipscat-import/pull/366
* Distinguish error message for empty list vs None. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/367
* Require recent hipscat by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/368


**Full Changelog**: https://github.com/astronomy-commons/hipscat-import/compare/v0.3.4...v0.3.5

What's Changed
* Update arguments.rst by hombit in https://github.com/astronomy-commons/hipscat-import/pull/326
* Pickle instead of scatter. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/328
* Update margin cache catalog info parameters by camposandro in https://github.com/astronomy-commons/hipscat-import/pull/332
* Use pathlib for pytest fixtures. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/333
* Enable "index file" reads for catalog import by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/334
* Enable std tqdm bar, refactor for re-use. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/330
* Only specify the astropy table columns once. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/336
* Require recent hipscat by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/337


**Full Changelog**: https://github.com/astronomy-commons/hipscat-import/compare/v0.3.3...v0.3.4

What's Changed
* Assorted small doc fixes by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/310
* User arguments to retain intermediate files by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/311
* Apply `read_columns` kwarg in parquet reader by troyraen in https://github.com/astronomy-commons/hipscat-import/pull/315
* Get all file_reader provenance info programmatically by troyraen in https://github.com/astronomy-commons/hipscat-import/pull/316
* Spruce up the way we check for original input files. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/314
* Fail fast on reduce stage failures. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/317
* Print file name for mapping/splitting failures. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/318
* Explicitly depend on scipy by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/320
* Redact storage options, as this may include user keys. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/322
* Resume functionality for margin cache pipeline. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/321
* Tidy up some resume functionality by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/324
* Use the original catalog schema in more reads/writes. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/325
* Use a subset of pixels when creating a margin cache. by delucchi-cmu in https://github.com/astronomy-commons/hipscat-import/pull/323


**Full Changelog**: https://github.com/astronomy-commons/hipscat-import/compare/v0.3.2...v0.3.3