Great-expectations

* [FEATURE] Add new expectation: expect column values to match powers of a base g… (5219) (thanks rifatKomodoDragon)
* [FEATURE] Replace UserConfigurableProfiler with OnboardingDataAssistant in "CLI suite new --profile" Jupyter Notebooks (5236)
* [FEATURE] `DatasourceStore` (5206)
* [FEATURE] add new expectation on validating hexadecimals (5188) (thanks andrewsx)
* [FEATURE] Usage Statistics Events for Profiler and DataAssistant "get_expectation_suite()" methods. (5251)
* [FEATURE] `InlineStoreBackend` (5216)
* [FEATURE] The "column.histogram" metric must support integer values of the "bins" parameter for all execution engine options. (5258)
* [FEATURE] Initial implementation of `DataContextVariables` accessors (5238)
* [FEATURE] `OnboardingDataAssistant` plots for `expect_table_columns_to_match_set` (5208)
* [FEATURE] `DataContextVariables` CRUD for `config_variables_file_path` (5262)
* [FEATURE] `DataContextVariables` CRUD for `plugins_directory` (5263)
* [FEATURE] `DataContextVariables` CRUD for store name accessors (5264)
* [BUGFIX] Hive temporary tables creation fix (4956) (thanks jaume-ferrarons)
* [BUGFIX] Provide error handling when metric fails for all Batch data samples (5256)
* [BUGFIX] Patch automated release test date comparisons (5278)
* [DOCS] How to compare two tables with the UserConfigurableProfiler (5050)
* [DOCS] How to create a Custom Column Pair Map Expectation w/ supporting template & example (4926)
* [DOCS] Auto API documentation script (4964)
* [DOCS] Update formatting of links to public methods in class docs generated by auto API script (5247)
* [DOCS] In the reference section of the ToC remove duplicates and update category pages (5248)
* [DOCS] Update DataContext docstring (5250)
* [MAINTENANCE] Add CodeSee architecture diagram workflow to repository (5235) (thanks codesee-maps[bot])
* [MAINTENANCE] Fix links to API docs (5246) (thanks andyjessen)
* [MAINTENANCE] Unpin cryptography upper bound (5249)
* [MAINTENANCE] Don't use jupyter-client 7.3.2 (5252)
* [MAINTENANCE] Re-introduce jupyter-client 7.3.2 (5253)
* [MAINTENANCE] Add `cloud` mark to `pytest.ini` (5254)
* [MAINTENANCE] add partner integration framework (5132)
* [MAINTENANCE] `DataContextVariableKey` for use in Stores (5255)
* [MAINTENANCE] Clarification of events in test with multiple checkpoint validations (5257)
* [MAINTENANCE] Misc updates to improve security and automation of the weekly release process (5244)
* [MAINTENANCE] show more test output and minor fixes (5239)
* [MAINTENANCE] Add proper unit tests for Column Histogram metric and use Column Value Partitioner in OnboardingDataAssistant (5267)
* [MAINTENANCE] Updates contributor docs to reflect updated linting guidance (4909)
* [MAINTENANCE] Remove condition from `autoupdate` GitHub action (5270)
* [MAINTENANCE] Improve code readability in the processing section of "MapMetricColumnDomainBuilder". (5279)

* [FEATURE] `OnboardingDataAssistant` plots for `expect_table_row_count_to_be_between` non-sequential batches (5212)
* [FEATURE] Limit sampling for spark and pandas (5201)
* [FEATURE] Groundwork for DataContext Refactor (5203)
* [FEATURE] Implement ability to change rule variable values through DataAssistant run() method arguments at runtime (5218)
* [FEATURE] Plot numeric column domains in `OnboardingDataAssistant` (5189)
* [BUGFIX] Repair "CLI Suite --Profile" Operation (5230)
* [DOCS] Remove leading underscore from sampling docs (5214)
* [MAINTENANCE] suppressing type hints in ill-defined situations (5213)
* [MAINTENANCE] Change CategoricalColumnDomainBuilder property name from "limit_mode" to "cardinality_limit_mode". (5215)
* [MAINTENANCE] Update Note in BigQuery Docs (5197)
* [MAINTENANCE] Sampling cleanup refactor (use BatchSpec in sampling methods) (5217)
* [MAINTENANCE] Globally increase Azure timeouts to 120 mins (5222)
* [MAINTENANCE] Comment out kl_divergence for build_gallery (5196)
* [MAINTENANCE] Fix docstring on expectation (5204) (thanks andyjessen)
* [MAINTENANCE] Improve NaN handling in numeric ParameterBuilder implementations (5226)
* [MAINTENANCE] Update type hint and docstring linter thresholds (5228)

* [FEATURE] Add Rule for TEXT semantic domains within the Onboarding Assistant (5144)
* [FEATURE] Helper method to determine whether Expectation is self-initializing (5159)
* [FEATURE] OnboardingDataAssistantResult plotting feature parity with VolumeDataAssistantResult (5145)
* [FEATURE] Example Notebook for self-initializing `Expectations` (5169)
* [FEATURE] DataAssistant: Enable passing directives to run() method using runtime_environment argument (5187)
* [FEATURE] Adding DataAssistantResult.get_expectation_suite(expectation_suite_name) method (5191)
* [FEATURE] Cronjob to automatically create release PR (5181)
* [BUGFIX] Insure TABLE Domain Metrics Do Not Get Column Key From Column Type Rule Domain Builder (5166)
* [BUGFIX] Update name for stdev expectation in `OnboardingDataAssistant` backend (5193)
* [BUGFIX] OnboardingDataAssistant and Underlying Metrics: Add Defensive Programming Into Metric Implementations So As To Avoid Warnings About Incompatible Data (5195)
* [BUGFIX] Insure that Histogram Metric in Pandas operates on numerical columns that do not have NULL values (5199)
* [BUGFIX] RuleBasedProfiler: Ensure that run() method runtime environment directives are handled correctly when existing setting is None (by default) (5202)
* [BUGFIX] In aggregate metrics, Spark Implementation already gets Column type as argument -- no need for F.col() as the operand is not a string. (5207)
* [DOCS] Update ToC with category links (5155)
* [DOCS] update on availability and parameters of conditional expectations (5150)
* [MAINTENANCE] Helper method for RBP Notebook tests that does clean-up (5171)
* [MAINTENANCE] Increase timeout for longer stages in Azure pipelines (5175)
* [MAINTENANCE] Rule-Based Profiler -- In ParameterBuilder insure that metrics are validated for conversion to numpy array (to avoid deprecation warnings) (5173)
* [MAINTENANCE] Increase timeout in packaging & installation pipeline (5178)
* [MAINTENANCE] OnboardingDataAssistant handle multiple expectations per domain (5170)
* [MAINTENANCE] Update timeout in pipelines to fit Azure syntax (5180)
* [MAINTENANCE] Error message when `Validator` is instantiated with Incorrect `BatchRequest` (5172)
* [MAINTENANCE] Don't include infinity in rendered string for diagnostics (5190)
* [MAINTENANCE] Mark Great Expectations Cloud tests and add stage to CI/CD (5186)
* [MAINTENANCE] Trigger expectation gallery build with scheduled CI/CD runs (5192)
* [MAINTENANCE] `expectation_gallery` Azure pipeline (5194)
* [MAINTENANCE] General cleanup/refactor of `DataAssistantResult` (5198)

* [FEATURE] `NumericMetricRangeMultiBatchParameterBuilder` kernel density estimation (5084)
* [FEATURE] Splitters and limit sample work on AWS Athena (5024)
* [FEATURE] `ColumnValuesLengthMin` and `ColumnValuesLengthMax` metrics (5107)
* [FEATURE] Use `batch_identifiers` in plot tooltips (5091)
* [FEATURE] Updated `DataAssistantResult` plotting API (5117)
* [FEATURE] Onboarding DataAssistant: Numeric Rules and Relevant Metrics (5120)
* [FEATURE] DateTime Rule for OnboardingDataAssistant (5121)
* [FEATURE] Categorical Rule is added to OnboardingDataAssistant (5134)
* [FEATURE] OnboardingDataAssistant: Introduce MeanTableColumnsSetMatchMultiBatchParameterBuilder (to enable expect_table_columns_to_match_set) (5135)
* [FEATURE] Giving the "expect_table_columns_to_match_set" Expectation Self-Initializing Capabilities. (5136)
* [FEATURE] For OnboardingDataAssistant: Implement a TABLE Domain level rule to output "expect_table_columns_to_match_set" (5137)
* [FEATURE] Enable self-initializing `ExpectColumnValueLengthsToBeBetween` (4985)
* [FEATURE] `DataAssistant` plotting for non-sequential batches (5126)
* [BUGFIX] Insure that Batch IDs are accessible in the order in which they were loaded in Validator (5112)
* [BUGFIX] Update `DataAssistant` notebook for new plotting API (5118)
* [BUGFIX] For DataAssistants, added try-except for Notebook tests (5124)
* [BUGFIX] CategoricalColumnDomainBuilder needs to accept limit_mode with dictionary type (5127)
* [BUGFIX] Use `external_sqldialect` mark to skip during lightweight runs (5139)
* [BUGFIX] Use RANDOM_STATE in fixture to make tests deterministic (5142)
* [BUGFIX] Read deployment_version instead of using versioneer in deprecation tests (5147)
* [MAINTENANCE] DataAssistant: Refactoring Access to common ParameterBuilder instances (5108)
* [MAINTENANCE] Refactor of`MetricTypes` and `AttributedResolvedMetrics` (5100)
* [MAINTENANCE] Remove references to show_cta_footer except in schemas.py (5111)
* [MAINTENANCE] Adding unit tests for sqlalchemy limit sampler part 1 (5109)
* [MAINTENANCE] Don't re-raise connection errors in CI (5115)
* [MAINTENANCE] Sqlite specific tests for splitting and sampling (5119)
* [MAINTENANCE] Add Trino dialect in SqlAlchemyDataset (5085) (thanks ms32035)
* [MAINTENANCE] Move upper bound on sqlalchemy to <2.0.0. (5140)
* [MAINTENANCE] Update primary pipeline to cut releases with tags (5128)
* [MAINTENANCE] Improve handling of "expect_column_unique_values_count_to_be_between" in VolumeDataAssistant (5146)
* [MAINTENANCE] Simplify DataAssistant Operation to not Depend on Self-Initializing Expectations (5148)
* [MAINTENANCE] Improvements to Trino support (5152)
* [MAINTENANCE] Update how_to_configure_a_new_checkpoint_using_test_yaml_config.md (5157)
* [MAINTENANCE] Speed up the site builder (5125) (thanks tanelk)
* [MAINTENANCE] remove account id deprecation notice (5158)

* [FEATURE] Add subset operation to Domain class (5049)
* [FEATURE] In DataAssistant: Use Domain instead of domain_type as key for Metrics Parameter Builders (5057)
* [FEATURE] Self-initializing `ExpectColumnStddevToBeBetween` (5065)
* [FEATURE] Enum used by DateSplitter able to be represented as YAML (5073)
* [FEATURE] Implementation of auto-complete for DataAssistant class names in Jupyter notebooks (5077)
* [FEATURE] Provide display ("friendly") names for batch identifiers (5086)
* [FEATURE] Onboarding DataAssistant -- Initial Rule Implementations (Data Aspects) (5101)
* [FEATURE] OnboardingDataAssistant: Implement Nullity/Non-nullity Rules and Associated Metrics (5104)
* [BUGFIX] `self_check()` now also checks for `aws_config_file` (5040)
* [BUGFIX] `multi_batch_rule_based_profiler` test up to date with RBP changes (5066)
* [BUGFIX] Splitting Support at Asset level (5026)
* [BUGFIX] Make self-initialization in expect_column_values_to_be_between truly multi batch (5068)
* [BUGFIX] databricks engine create temporary view (4994) (thanks gvillafanetapia)
* [BUGFIX] Patch broken Expectation gallery script (5090)
* [BUGFIX] Sampling support at asset level (5092)
* [DOCS] Update process and configurations in OpenLineage Action guide. (5039)
* [DOCS] Update process and config examples in Opsgenie guide (5037)
* [DOCS] Correct name of `openlineage-integration-common` package (5041) (thanks mobuchowski)
* [DOCS] Remove reference to validation operator process from how to trigger slack notifications guide (5034)
* [DOCS] Update process and configuration examples in email Action guide. (5036)
* [DOCS] Update Docusaurus version (5063)
* [MAINTENANCE] Saved output of usage stats schema script in repo (5053)
* [MAINTENANCE] Apply Altair custom themes to return objects (5044)
* [MAINTENANCE] Introducing RuleBasedProfilerResult -- neither expectation suite name nor expectation suite must be passed to RuleBasedProfiler.run() (5061)
* [MAINTENANCE] Refactor `DataAssistant` plotting to leverage utility dataclasses (5022)
* [MAINTENANCE] Check that a passed string is parseable as an integer (mssql limit param) (5071)
* [MAINTENANCE] Clean up mssql limit sampling code path and comments (5074)
* [MAINTENANCE] Make saving bootstraps histogram for NumericMetricRangeMultiBatchParameterBuilder optional (absent by default) (5075)
* [MAINTENANCE] Make self-initializing expectations return estimated kwargs with auto-generation timestamp and Great Expectation version (5076)
* [MAINTENANCE] Adding a unit test for batch_id mapping to batch display names (5087)
* [MAINTENANCE] `pypandoc` version constraint added (`< 1.8`) (5093)
* [MAINTENANCE] Utilize Rule objects in Profiler construction in DataAssistant (5089)
* [MAINTENANCE] Turn off metric calculation progress bars in `RuleBasedProfiler` and `DataAssistant` workflows (5080)
* [MAINTENANCE] A small refactor of ParamerBuilder management used in DataAssistant classes (5102)
* [MAINTENANCE] Convenience method refactor for Onboarding DataAssistant (5103)

* [FEATURE] Enable self-initializing `ExpectColumnMeanToBeBetween` (4986)
* [FEATURE] Enable self-initializing `ExpectColumnMedianToBeBetween` (4987)
* [FEATURE] Enable self-initializing `ExpectColumnSumToBeBetween` (4988)
* [FEATURE] New MetricSingleBatchParameterBuilder for specifically single-Batch Rule-Based Profiler scenarios (5003)
* [FEATURE] Enable Pandas DataFrame and Series as MetricValues Output of Metric ParameterBuilder Classes (5008)
* [FEATURE] Notebook for `VolumeDataAssistant` Example (5010)
* [FEATURE] Histogram/Partition Single-Batch ParameterBuilder (5011)
* [FEATURE] Update `DataAssistantResult.plot()` return value to emit `PlotResult` wrapper dataclass (4962)
* [FEATURE] Limit samplers work with supported sqlalchemy backends (5014)
* [FEATURE] trino support (5021)
* [BUGFIX] RBP Profiling Dataset ProgressBar Fix (4999)
* [BUGFIX] Fix DataAssistantResult serialization issue (5020)
* [DOCS] Update slack notification guide to not use validation operators. (4978)
* [MAINTENANCE] Update `autoupdate` GitHub action (5001)
* [MAINTENANCE] Move `DataAssistant` registry capabilities into `DataAssistantRegistry` to enable user aliasing (4991)
* [MAINTENANCE] Fix continuous partition example (4939) (thanks andyjessen)
* [MAINTENANCE] Preliminary refactors for data samplers. (4996)
* [MAINTENANCE] Clean up unused imports and enforce through `flake8` in CI/CD (5005)
* [MAINTENANCE] ParameterBuilder tests should maximally utilize polymorphism (5007)
* [MAINTENANCE] Clean up type hints in CLI (5006)
* [MAINTENANCE] Making ParameterBuilder metric computations robust to failures through logging and exception handling (5009)
* [MAINTENANCE] Condense column-level `vconcat` plots into one interactive plot (5002)
* [MAINTENANCE] Update version of `black` in pre-commit config (5019)
* [MAINTENANCE] Improve tooltips and formatting for distinct column values chart in VolumeDataAssistantResult (5017)
* [MAINTENANCE] Enhance configuring serialization for DotDict type classes (5023)
* [MAINTENANCE] Pyarrow upper bound (5028)