Lumen

This release updates Lumen for compatibility with latest Panel and Param releases. Additionally it adds a `DuckDb` source, focuses on a number of improvements for validation and serialization of Lumen specs.

Features

- Add `DuckDb` source ([366](https://github.com/holoviz/lumen/pull/366))
- Automatically support for automatically generating filters ([419](https://github.com/holoviz/lumen/pull/419), [#501](https://github.com/holoviz/lumen/pull/501))
- Add `Sum`, `Count` and `Eval` transforms ([425](https://github.com/holoviz/lumen/pull/425))
- Add lifecycle callbacks to `Config` ([429](https://github.com/holoviz/lumen/pull/429), [#441](https://github.com/holoviz/lumen/pull/441))

Enhancements

- Do not apply range and multi-select filters if it spans entire range ([420](https://github.com/holoviz/lumen/pull/420))
- Implement support for recursive layout specifications ([424](https://github.com/holoviz/lumen/pull/424))
- Add a shortcut for downloading a view ([427](https://github.com/holoviz/lumen/pull/427))
- Add `View.title` option ([430](https://github.com/holoviz/lumen/pull/430))
- Display loading indicator on `View` ([435](https://github.com/holoviz/lumen/pull/435))
- Improve `Download` with Index and Filename parameters ([438](https://github.com/holoviz/lumen/pull/438))
- Allow configuring a `View` data limit ([443](https://github.com/holoviz/lumen/pull/443))
- Add description to sidebar ([457](https://github.com/holoviz/lumen/pull/457))
- Sanitize string input in `SQLFilter` ([463](https://github.com/holoviz/lumen/pull/463))
- Add `config.show_traceback` ([465](https://github.com/holoviz/lumen/pull/465))
- Allow referencing `Variable` in `Pipeline` table definition ([478](https://github.com/holoviz/lumen/pull/478))
- Ensure valid key validation is enabled for all components ([493](https://github.com/holoviz/lumen/pull/493), [#498](https://github.com/holoviz/lumen/pull/498))

Bug fixes

- Fix how Layouts resolve internal pipelines ([418](https://github.com/holoviz/lumen/pull/418))
- Correctly sync `WidgetFilter` with url ([491](https://github.com/holoviz/lumen/pull/491))
- Allow roundtrip of `Layout` `to_spec` and `from_spec` ([495](https://github.com/holoviz/lumen/pull/495))
- Ensure Lumen yaml paths can be correctly resolved on Windows ([af86b04](https://github.com/holoviz/lumen/commit/af86b044345b5b087689c63fe735f3504ebb6d6b))

Compatibility

- Compatibility for Panel 1.0 ([449](https://github.com/holoviz/lumen/pull/449))
- Compatibility with Param 2 ([475](https://github.com/holoviz/lumen/pull/475))
- Add Python 3.12 and drop Python 3.7 and 3.8 ([497](https://github.com/holoviz/lumen/pull/497))

This micro-release fixes a few issues related to the introduction of `Variable` types and `Source` hashing in the Lumen 0.5.0 release.

Bug fixes

- Dynamically create `Variable` classes to avoid shared state ([413](https://github.com/holoviz/lumen/pull/413))
- Better handling for shared apply button ([414](https://github.com/holoviz/lumen/pull/414))
- Add `Source` hash to schema cache file ([415](https://github.com/holoviz/lumen/pull/415))

Compatibility

- Update panel pin

Documentation

- Fixes for penguins and precipitation examples ([416](https://github.com/holoviz/lumen/pull/416))

This minor release completely overhauls the internals of Lumen by adding three new concepts:

1. The `Pipeline` which encapsulates any data transformations and filtering applied to a table.
2. `Variable` references which can be used to coordinate controls across a dashboard.
3. `SQLTransform` components which allow pushing compute down to a SQL database.

Additionally this release adds support for validating a specification without actually evaluating it and serializing all Lumen components to a spec.

Features

- Add ability to expose `View` controls ([137](https://github.com/holoviz/lumen/pull/137))
- Add `project_lnglat` and `pivot` transforms ([140](https://github.com/holoviz/lumen/pull/140), [#271](https://github.com/holoviz/lumen/pull/271))
- Add `Altair`, `hvPlotUIView` and `Panel` View ([141](https://github.com/holoviz/lumen/pull/141), [#250](https://github.com/holoviz/lumen/pull/250), [#287](https://github.com/holoviz/lumen/pull/287))
- Add loading status messages ([150](https://github.com/holoviz/lumen/pull/150))
- Implement `BinFilter`, `DateFilter` ([155](https://github.com/holoviz/lumen/pull/155), [#159](https://github.com/holoviz/lumen/pull/159), [#276](https://github.com/holoviz/lumen/pull/276))
- Add ability to sync dashboard state with URL parameters ([207](https://github.com/holoviz/lumen/pull/207))
- Add `IntakeDremio` source ([213](https://github.com/holoviz/lumen/pull/213), [#244](https://github.com/holoviz/lumen/pull/244))
- Implement `SQLTransform` ([222](https://github.com/holoviz/lumen/pull/222), [#232](https://github.com/holoviz/lumen/pull/232), [#384](https://github.com/holoviz/lumen/pull/384))
- Implement `Variable` API ([242](https://github.com/holoviz/lumen/pull/242), [#275](https://github.com/holoviz/lumen/pull/275), [#347](https://github.com/holoviz/lumen/pull/347), [#394](https://github.com/holoviz/lumen/pull/394))
- Add `throttled` options to `Widget` variable and `Filter` ([264](https://github.com/holoviz/lumen/pull/264))
- Add `Pipeline` class which encapsulates internal data transformations ([291](https://github.com/holoviz/lumen/pull/291), [#399](https://github.com/holoviz/lumen/pull/399), [#385](https://github.com/holoviz/lumen/pull/385), [#387](https://github.com/holoviz/lumen/pull/387), [#400](https://github.com/holoviz/lumen/pull/400))
- Implement ability to validate dashboard and pipeline specifications ([312](https://github.com/holoviz/lumen/pull/312))
- Implement `Component.to_spec` ([317](https://github.com/holoviz/lumen/pull/317))
- Add precache command ([340](https://github.com/holoviz/lumen/pull/340))

Enhancements

- Give AE5 admin users access to all deployments ([138](https://github.com/holoviz/lumen/pull/138))
- Refactored loading of local modules ([147](https://github.com/holoviz/lumen/pull/147))
- Do not require auth in dev mode ([151](https://github.com/holoviz/lumen/pull/151))
- Allow resolving explicit module references in type declarations ([152](https://github.com/holoviz/lumen/pull/152))
- Refactor internals to allow lazy rendering ([153](https://github.com/holoviz/lumen/pull/153))
- Add `config.reloadable` options ([154](https://github.com/holoviz/lumen/pull/154))
- Warn when no data is available ([156](https://github.com/holoviz/lumen/pull/156))
- Enable `FlexBox` layout if available ([157](https://github.com/holoviz/lumen/pull/157))
- Clean up styling of filters ([158](https://github.com/holoviz/lumen/pull/158))
- Add support for throttling of DateFilter ([161](https://github.com/holoviz/lumen/pull/161))
- Implement threaded background loading of targets ([179](https://github.com/holoviz/lumen/pull/179))
- Add support for auth plugins ([185](https://github.com/holoviz/lumen/pull/185))
- Expose `WidgetFilter` `visible` parameter ([186](https://github.com/holoviz/lumen/pull/186))
- Only load full schema if needed ([175](https://github.com/holoviz/lumen/pull/175))
- Expose the disabled property of filters ([195](https://github.com/holoviz/lumen/pull/195))
- Add control panel for each view ([196](https://github.com/holoviz/lumen/pull/196))
- Add validation to ensure filters on views actually apply to a view ([201](https://github.com/holoviz/lumen/pull/201))
- Render only applicable filters when tabbed ([208](https://github.com/holoviz/lumen/pull/208))
- Hide `Card` header when in `Tabs` ([210](https://github.com/holoviz/lumen/pull/210))
- Add ability to define `controls` on `Transform` ([211](https://github.com/holoviz/lumen/pull/211))
- Allow control over whether auth is case-sensitive ([212](https://github.com/holoviz/lumen/pull/212))
- Add `Transform.apply_to` classmethod ([220](https://github.com/holoviz/lumen/pull/220))
- Add jobs information to `AE5Source` tables ([221](https://github.com/holoviz/lumen/pull/221))
- Add support for making `View` data downloadable ([230](https://github.com/holoviz/lumen/pull/230))
- Allow declaring control options ([234](https://github.com/holoviz/lumen/pull/234))
- Use `SQLTransforms` to compute SQL Source schemas on database ([246](https://github.com/holoviz/lumen/pull/246))
- Apply `Filter`s in SQL where applicable ([255](https://github.com/holoviz/lumen/pull/255))
- Improve and enhance schema caching ([256](https://github.com/holoviz/lumen/pull/256))
- Allow `Variable`s to reference each other ([259](https://github.com/holoviz/lumen/pull/259))
- Add `AE5Source` resource allocation table ([249](https://github.com/holoviz/lumen/pull/249))
- Use `as_materialized` method to materialize `Variable`s ([257](https://github.com/holoviz/lumen/pull/257))
- Add configurable launcher gallery ([270](https://github.com/holoviz/lumen/pull/270))
- Group variables by target if appropriate ([283](https://github.com/holoviz/lumen/pull/283))
- Implement thread locking for caches ([296](https://github.com/holoviz/lumen/pull/296))
- Fix cache for `dask.dataframe` ([305](https://github.com/holoviz/lumen/pull/305))
- Notify user of runtime errors ([322](https://github.com/holoviz/lumen/pull/322))
- Add functionality to manually apply updates ([330](https://github.com/holoviz/lumen/pull/330))
- Allow for adding widgets as filters programmatically ([332](https://github.com/holoviz/lumen/pull/332))
- Improve the logic behind importing a module ([335](https://github.com/holoviz/lumen/pull/335))
- Allow instantiating `Dashboard` with spec ([363](https://github.com/holoviz/lumen/pull/363))
- Improve support for exporting `View` and `Target` to_spec ([365](https://github.com/holoviz/lumen/pull/365))
- Allow declaring per query caching behavior at Source level ([367](https://github.com/holoviz/lumen/pull/367))
- Ensure views are rendered lazily ([381](https://github.com/holoviz/lumen/pull/381))

Bug fixes

- Fix `AE5Source` admin user_info (b4d3867)
- Fix `DerivedSource.clear_cache` ([148](https://github.com/holoviz/lumen/pull/148))
- Fix ncols warning ([149](https://github.com/holoviz/lumen/pull/149))
- Various fixes for filters ([162](https://github.com/holoviz/lumen/pull/162))
- Handle booleans in schema ([164](https://github.com/holoviz/lumen/pull/164))
- Fix filtering logic for multi-range queries ([160](https://github.com/holoviz/lumen/pull/160))
- Ensure modules persist across sessions ([165](https://github.com/holoviz/lumen/pull/165))
- Ensure `Tabulator` extension is loaded ([176](https://github.com/holoviz/lumen/pull/176))
- Fix `IntakeBaseSource.load_schema` option ([178](https://github.com/holoviz/lumen/pull/178))
- Make robust to warm and autoreload options ([209](https://github.com/holoviz/lumen/pull/209))
- Deactivate the loading spinner after rerender ([225](https://github.com/holoviz/lumen/pull/225))
- Fixes and improvements for SQL sources and transforms ([243](https://github.com/holoviz/lumen/pull/243))
- Add support NULL queries in SQLFilter ([274](https://github.com/holoviz/lumen/pull/274))
- Fix logic for clearing cache
- Ensure global filters are recreated ([166](https://github.com/holoviz/lumen/pull/166))
- Fix issue with log out ([241](https://github.com/holoviz/lumen/pull/241))
- Fixes for schema caching ([260](https://github.com/holoviz/lumen/pull/260))
- Fix setting of Widget variable default ([263](https://github.com/holoviz/lumen/pull/263))
- Fixes for reload button layout and functionality ([298](https://github.com/holoviz/lumen/pull/298))
- Avoid leaking panel config settings ([349](https://github.com/holoviz/lumen/pull/349))
- Ensure schema is still generated for empty dataframe ([376](https://github.com/holoviz/lumen/pull/376))
- Ensure error in layout initialization does not break entire dashboard ([383](https://github.com/holoviz/lumen/pull/383))
- Clean up handling of global and per-session state ([388](https://github.com/holoviz/lumen/pull/388))
- Small fixes for layout rendering and sorting of enums ([401](https://github.com/holoviz/lumen/pull/401), [#403](https://github.com/holoviz/lumen/pull/403))

Backward compatibility

- Rename `Target` to `Layout` ([393](https://github.com/holoviz/lumen/pull/393))
- Add patch for backwards compatibility with Panel 0.12.6 ([233](https://github.com/holoviz/lumen/pull/233))

Documentation

- Initial draft of comparing Lumen to other tools ([145](https://github.com/holoviz/lumen/pull/145))
- Add Pipeline notebook
- Fix the bikes example ([204](https://github.com/holoviz/lumen/pull/204))
- Overhaul Lumen documentation and add logo ([288](https://github.com/holoviz/lumen/pull/288))
- Getting started section ([323](https://github.com/holoviz/lumen/pull/323))
- initializing the how to section ([325](https://github.com/holoviz/lumen/pull/325))
- Add reference guide skeleton ([327](https://github.com/holoviz/lumen/pull/327))
- Adding how to on caching ([329](https://github.com/holoviz/lumen/pull/329))
- Docs for data visualization views ([333](https://github.com/holoviz/lumen/pull/333))
- Add docs for data outtake for downloading data ([334](https://github.com/holoviz/lumen/pull/334))
- Create core concepts and update tutorial in getting started guide ([336](https://github.com/holoviz/lumen/pull/336))
- Create how to on custom local components ([343](https://github.com/holoviz/lumen/pull/343))
- Add reference docs ([368](https://github.com/holoviz/lumen/pull/368))
- Improve rendering of reference docs ([409](https://github.com/holoviz/lumen/pull/409))
- Consistently link to reference docs ([410](https://github.com/holoviz/lumen/pull/410))
- Add earthquake example ([411](https://github.com/holoviz/lumen/pull/411))

Minor release:

- Fix filtering of Views
- Add precipitation data files ([133](https://github.com/holoviz/lumen/pull/133))

(Relatively) major release:

New features:
- Handle errors while rendering dashboard ([131](https://github.com/holoviz/lumen/pull/131))
- Defer rendering of dashboard contents until page is rendered ([123](https://github.com/holoviz/lumen/pull/123))
- Add Melt transform ([122](https://github.com/holoviz/lumen/pull/122))
- Implement DerivedSource with ability to filter and transform existing sources ([121](https://github.com/holoviz/lumen/pull/121))
- Add caching to DerivedSource
- Use Datetime pickers ([119](https://github.com/holoviz/lumen/pull/119))

Bugfixes and minor improvements:

- Clear original source cache on DerivedSource
- Allow providing custom Download labels ([130](https://github.com/holoviz/lumen/pull/130))
- Fix handling of range filters ([129](https://github.com/holoviz/lumen/pull/129))
- Unpack panes correctly on Views ([128](https://github.com/holoviz/lumen/pull/128))
- Fixed dask kwarg on JSONSource ([127](https://github.com/holoviz/lumen/pull/127))
- Pin python3.8 in conda build env
- Ensure None on widget filter is handled ([120](https://github.com/holoviz/lumen/pull/120))
- Improve docs ([112](https://github.com/holoviz/lumen/pull/112))

Minor release:

- Updated dependencies
- Add Download options to targets ([110](https://github.com/holoviz/lumen/pull/110))
- Make editable a configurable option ([109](https://github.com/holoviz/lumen/pull/109))
- Improve docs ([107](https://github.com/holoviz/lumen/pull/107), [#108](https://github.com/holoviz/lumen/pull/108))
- Gracefully handle missing dask and parquet libraries ([105](https://github.com/holoviz/lumen/pull/105))