Great-expectations

* [BUGFIX] Data Assistant plotting with zero expectations produced (5934)
* [BUGFIX] Don't include abstract Expectation classes in _retrieve_expectations_from_module (5947)
* [BUGFIX] Ensure that ParameterBuilder implementations in Rule Based Profiler properly handle SQL DECIMAL type (5896)
* [BUGFIX] Making an all-NULL column handling in RuleBasedProfiler more robust (5937)
* [BUGFIX] Prevent "division by zero" errors in Rule-Based Profiler calculations when Batch has zero rows (5960)
* [BUGFIX] Spark column.distinct_values no longer returns entire table distinct values (5969)
* [BUGFIX] prefix and suffix asset names are only relevant for InferredSqlAlchemyDataConnector (5950)
* [DOCS] DOC-368 spelling correction (5912)
* [FEATURE] Allowing `schema` to be passed in as `batch_spec_passthrough` in Spark (5900)
* [FEATURE] DataAssistants Example Notebook - Spark (5919)
* [FEATURE] Improve slack error condition (5818 thank you, Itai Sevitt)
* [FEATURE] SparkDFExecutionEngine able to use schema 5917
* [MAINTENANCE] Certify InferredAssetSqlDataConnector and ConfiguredAssetSqlDataConnector (5847)
* [MAINTENANCE] Add missing import for ConfigurationIdentifier (5943)
* [MAINTENANCE] Add x-fails to flaky Cloud tests for purposes of 0.15.22 (5964)
* [MAINTENANCE] Bump `Marshmallow` upper bound to work with Airflow operator (5952)
* [MAINTENANCE] Cleanup up some new datasource sql data connector tests. (5918)
* [MAINTENANCE] Mark DBFS tests with `pytest.mark.integration` (5931)
* [MAINTENANCE] Mark all tests within `tests/data_context/stores` dir (5913)
* [MAINTENANCE] Mark all tests within `tests/validator` (5926)
* [MAINTENANCE] Mark tests within `tests/rule_based_profiler` (5930)
* [MAINTENANCE] More unit tests for `Stores` (5953)
* [MAINTENANCE] Move `Store` test utils from source code to tests (5932)
* [MAINTENANCE] Remove xfails from passing tests in preparation for 0.15.21 release (5908)
* [MAINTENANCE] Reset globals modified in tests (5936)
* [MAINTENANCE] Run comprehensive tests in a random order (5942)
* [MAINTENANCE] Run spark and onboarding data assistant test in their own jobs. (5951)
* [MAINTENANCE] Unit tests for `ConfigurationStore` (5948)
* [MAINTENANCE] Unit tests for `ValidationGraph` and related classes (5954)
* [MAINTENANCE] Unit tests for `data_context/store` (5923)
* [MAINTENANCE] Update to OnboardingDataAssistant Notebook - Sql (5939)
* [MAINTENANCE] Use DataContext to ignore progress bars (5959)
* [MAINTENANCE] Use datasource config in add_datasource support methods (5901)
* [MAINTENANCE] Cleanup to allow docker test target to run tests in random order (5915)

* [FEATURE] Add `include_rendered_content` to `get_expectation_suite` and `get_validation_result` (5853)
* [FEATURE] Add tags as an optional setting for the OpsGenieAlertAction (5855) (thanks stevewb1993)
* [BUGFIX] Ensure that `delete_expectation_suite` returns proper boolean result (5878)
* [BUGFIX] many small bugfixes (5881)
* [BUGFIX] Fix typo in default value of "ignore_row_if" kwarg for MulticolumnMapExpectation (5860) (thanks mkopec87)
* [BUGFIX] Patch issue with `checkpoint_identifier` within `Checkpoint.run` workflow (5894)
* [BUGFIX] Ensure that `DataContext.add_checkpoint()` updates existing objects in GX Cloud (5895)
* [DOCS] DOC-364 how to configure a spark datasource (5840)
* [MAINTENANCE] Unit Tests Pipeline step (5838)
* [MAINTENANCE] Unit tests to ensure coverage over `Datasource` caching in `DataContext` (5839)
* [MAINTENANCE] Add entries to release schedule (5833)
* [MAINTENANCE] Properly label `DataAssistant` tests with `pytest.mark.integration` (5845)
* [MAINTENANCE] Add additional unit tests around `Datasource` caching (5844)
* [MAINTENANCE] Mark miscellaneous tests with `pytest.mark.unit` (5846)
* [MAINTENANCE] `datasource`, `data_context`, `core` typing, lint fixes (5824)
* [MAINTENANCE] add --ignore-suppress and --ignore-only-for to build_gallery.py with bugfixes (5802)
* [MAINTENANCE] Remove pyparsing pin for <3.0 (5849)
* [MAINTENANCE] Finer type exclude (5848)
* [MAINTENANCE] use `id` instead `id_` (5775)
* [MAINTENANCE] Add data connector names in datasource config (5778)
* [MAINTENANCE] init tests for dict and json serializers (5854)
* [MAINTENANCE] Remove Partitioning and Quantiles metrics computations from DateTime Rule of OnboardingDataAssistant (5862)
* [MAINTENANCE] Update `ExpectationSuite` CRUD on `DataContext` to recognize Cloud ids (5836)
* [MAINTENANCE] Handle Pandas warnings in Data Assistant plots (5863)
* [MAINTENANCE] Misc cleanup of `test_expectation_suite_crud.py` (5868)
* [MAINTENANCE] Remove vendored `marshmallow__shade` (5866)
* [MAINTENANCE] don't force using the stand alone mock (5871)
* [MAINTENANCE] Update expectation_gallery pipeline (5874)
* [MAINTENANCE] run unit-tests on a target package (5869)
* [MAINTENANCE] add `pytest-timeout` (5857)
* [MAINTENANCE] Label tests in `tests/core` with `pytest.mark.unit` and `pytest.mark.integration` (5879)
* [MAINTENANCE] new invoke test flags (5880)
* [MAINTENANCE] JSON Serialize RowCondition and MetricBundle computation result to enable IDDict.to_id() for SparkDFExecutionEngine (5883)
* [MAINTENANCE] increase the `pytest-timeout` timeout value during unit-testing step (5884)
* [MAINTENANCE] Add `pytest.mark.slow` throughout test suite (5882)
* [MAINTENANCE] Add test_expectation_suite_send_usage_message (5886)
* [MAINTENANCE] Mark existing tests as unit or integration (5890)
* [MAINTENANCE] Convert integration tests to unit (5891)
* [MAINTENANCE] Update distinct metric dependencies and implementations (5811)
* [MAINTENANCE] Add slow pytest marker to config and sort them alphabetically. (5892)
* [MAINTENANCE] Adding serialization tests for Spark (5897)
* [MAINTENANCE] Improve existing expectation suite unit tests (phase 1) (5898)
* [MAINTENANCE] `SqlAlchemyExecutionEngine` case for SQL Alchemy `Select` and `TextualSelect` due to `SADeprecationWarning` (5902)

* [FEATURE] `query.pair_column` Metric (5743)
* [FEATURE] Enhance execution time measurement utility, and save `DomainBuilder` execution time per Rule of Rule-Based Profiler (5796)
* [FEATURE] Support single-batch mode in MetricMultiBatchParameterBuilder (5808)
* [FEATURE] Inline `ExpectationSuite` Rendering (5726)
* [FEATURE] Better error for missing expectation (5750) (thanks tylertrussell)
* [FEATURE] DataAssistants Example Notebook - Pandas (5820)
* [BUGFIX] Ensure name not persisted (5813)
* [DOCS] Change the selectable to a list (5780) (thanks itaise)
* [DOCS] Fix how to create custom table expectation (5807) (thanks itaise)
* [DOCS] DOC-363 how to configure a pandas datasource (5779)
* [MAINTENANCE] Remove xfail markers on cloud tests (5793)
* [MAINTENANCE] build-gallery enhancements (5616)
* [MAINTENANCE] Refactor `save_profiler` to remove explicit `name` and `ge_cloud_id` args (5792)
* [MAINTENANCE] Add v2_api flag for v2_api specific tests (5803)
* [MAINTENANCE] Clean up `ge_cloud_id` reference from `DataContext` `ExpectationSuite` CRUD (5791)
* [MAINTENANCE] Refactor convert_dictionary_to_parameter_node (5805)
* [MAINTENANCE] Remove `ge_cloud_id` from `DataContext.add_profiler()` signature (5804)
* [MAINTENANCE] Remove "copy.deepcopy()" calls from ValidationGraph (5809)
* [MAINTENANCE] Add vectorized is_between for common numpy dtypes (5711)
* [MAINTENANCE] Make partitioning directives of PartitionParameterBuilder configurable (5810)
* [MAINTENANCE] Write E2E Cloud test for `RuleBasedProfiler` creation and retrieval (5815)
* [MAINTENANCE] Change recursion to iteration for function in parameter_container.py (5817)
* [MAINTENANCE] add `pytest-mock` & `pytest-icdiff` plugins (5819)
* [MAINTENANCE] Surface cloud errors (5797)
* [MAINTENANCE] Clean up build_parameter_container_for_variables (5823)
* [MAINTENANCE] Bugfix/snowflake temp table schema name (5814)
* [MAINTENANCE] Update `list_` methods on `DataContext` to emit names along with object ids (5826)
* [MAINTENANCE] xfail Cloud E2E tests due to schema issue with `DataContextVariables` (5828)
* [MAINTENANCE] Clean up xfails in preparation for 0.15.20 release (5835)
* [MAINTENANCE] Add back xfails for E2E Cloud tests that fail on env var retrieval in Docker (5837)

* [FEATURE] `DataAssistantResult` plot multiple metrics per expectation (5556)
* [FEATURE] Enable passing "exact_estimation" boolean at `DataAssistant.run()` level (default value is True) (5744)
* [FEATURE] Example notebook for Onboarding DataAssistant - `postgres` (5776)
* [BUGFIX] dir update for data_assistant_result (5751)
* [BUGFIX] Fix docs_integration pipeline (5734)
* [BUGFIX] Patch flaky E2E Cloud test with randomized suite names (5752)
* [BUGFIX] Fix RegexPatternStringParameterBuilder to use legal character repetition. Remove median, mean, and standard deviation features from OnboardingDataAssistant "datetime_columns_rule" definition. (5757)
* [BUGFIX] Move `SuiteValidationResult.meta` validation id propogation before `ValidationOperator._run_action` (5760)
* [BUGFIX] Update "column.partition" Metric to handle DateTime Arithmetic Properly (5764)
* [BUGFIX] JSON-serialize RowCondition and enable IDDict to support comparison operations (5765)
* [BUGFIX] Insure all estimators properly handle datetime-float conversion (5774)
* [BUGFIX] Return appropriate subquery type to Query Metrics for SA version (5783)
* [DOCS] added guide how to use gx with emr serverless (5623) (thanks bvolodarskiy)
* [DOCS] DOC-362: how to choose between working with a single or multiple batches of data (5745)
* [MAINTENANCE] Temporarily xfail E2E Cloud tests due to Azure env var issues (5787)
* [MAINTENANCE] Add ids to `DataConnectorConfig` (5740)
* [MAINTENANCE] Rename GX Cloud "contract" resource to "checkpoint" (5748)
* [MAINTENANCE] Rename GX Cloud "suite_validation_result" resource to "validation_result" (5749)
* [MAINTENANCE] Store Refactor - cloud store return types & http-errors (5730)
* [MAINTENANCE] profile_numeric_columns_diff_expectation (5741) (thanks stevensecreti)
* [MAINTENANCE] Clean up type hints around class constructors (5738)
* [MAINTENANCE] invoke docker (5703)
* [MAINTENANCE] Add plist to build docker test image daily. (5754)
* [MAINTENANCE] opt-out type-checking (5713)
* [MAINTENANCE] Enable Algolia UI (5753)
* [MAINTENANCE] Linting & initial typing for data context (5756)
* [MAINTENANCE] Update `oneshot` estimator to `quantiles` estimator (5737)
* [MAINTENANCE] Update Auto-Initializing Expectations to use `exact` estimator by default (5759)
* [MAINTENANCE] Send a Gx-Version header set to __version__ in requests to cloud (5758)
* [MAINTENANCE] invoke docker --detach and more typing (5770)
* [MAINTENANCE] In ParameterBuilder implementations, enhance handling of numpy.ndarray metric values, whose elements are or can be converted into datetime.datetime type. (5771)
* [MAINTENANCE] Config/Schema round_tripping (5697)
* [MAINTENANCE] Add experimental label to MetricStore Doc (5782)
* [MAINTENANCE] Remove `GeCloudIdentifier` creation in `Checkpoint.run()` (5784)

* [FEATURE] Example notebooks for multi-batch Spark (5683)
* [FEATURE] Introduce top-level `default_validation_id` in `CheckpointConfig` (5693)
* [FEATURE] Pass down validation ids to `ExpectationSuiteValidationResult.meta` within `Checkpoint.run()` (5725)
* [FEATURE] Refactor data assistant runner to compute formal parameters for data assistant run method signatures (5727)
* [BUGFIX] Restored sqlite database for tests (5742)
* [BUGFIX] Fixing a typo in variable name for default profiler for auto-initializing expectation "expect_column_mean_to_be_between" (5687)
* [BUGFIX] Remove `resource_type` from call to `StoreBackend.build_key` (5690)
* [BUGFIX] Update how_to_use_great_expectations_in_aws_glue.md (5685) (thanks bvolodarskiy)
* [BUGFIX] Updated how_to_use_great_expectations_in_aws_glue.md again (5696) (thanks bvolodarskiy)
* [BUGFIX] Update how_to_use_great_expectations_in_aws_glue.md (5722) (thanks bvolodarskiy)
* [BUGFIX] Update aws_glue_deployment_patterns.py (5721) (thanks bvolodarskiy)
* [DOCS] added guide how to use great expectations with aws glue (5536) (thanks bvolodarskiy)
* [DOCS] Document the ZenML integration for Great Expectations (5672) (thanks stefannica)
* [DOCS] Converts broken ZenML md refs to Technical Tags (5714)
* [DOCS] How to create a Custom Query Expectation (5460)
* [MAINTENANCE] Pin makefun package to version range for support assurance (5746)
* [MAINTENANCE] s3 link for logo (5731)
* [MAINTENANCE] Assign `resource_type` in `InlineStoreBackend` constructor (5671)
* [MAINTENANCE] Add mysql client to Dockerfile.tests (5681)
* [MAINTENANCE] `RuleBasedProfiler` corner case configuration changes (5631)
* [MAINTENANCE] Update teams.yml (5684)
* [MAINTENANCE] Utilize `e2e` mark on E2E Cloud tests (5691)
* [MAINTENANCE] pyproject.tooml build-system typo (5692)
* [MAINTENANCE] expand flake8 coverage (5676)
* [MAINTENANCE] Ensure Cloud E2E tests are isolated to `gx-cloud-e2e` stage of CI (5695)
* [MAINTENANCE] Add usage stats and initial database docker tests to CI (5682)
* [MAINTENANCE] Add `e2e` mark to `pyproject.toml` (5699)
* [MAINTENANCE] Update docker readme to mount your repo over the builtin one. (5701)
* [MAINTENANCE] Combine packages `rule_based_profiler` and `rule_based_profiler.types` (5680)
* [MAINTENANCE] ExpectColumnValuesToBeInSetSparkOptimized (5702)
* [MAINTENANCE] expect_column_pair_values_to_have_difference_of_custom_perc… (5661) (thanks exteli)
* [MAINTENANCE] Remove non-docker version of CI tests that are now running in docker. (5700)
* [MAINTENANCE] Add back `integration` mark to tests in `test_datasource_crud.py` (5708)
* [MAINTENANCE] DEVREL-2289/Stale/Triage (5694)
* [MAINTENANCE] revert expansive flake8 pre-commit checking - flake8 5.0.4 (5706)
* [MAINTENANCE] Bugfix for `cloud-db-integration-pipeline` (5704)
* [MAINTENANCE] Remove pytest-azurepipelines (5716)
* [MAINTENANCE] Remove deprecation warning from `DataConnector`-level `batch_identifiers` for `RuntimeDataConnector` (5717)
* [MAINTENANCE] Refactor `AbstractConfig` to make `name` and `id_` consistent attrs (5698)
* [MAINTENANCE] Move CLI tests to docker (5719)
* [MAINTENANCE] Leverage `DataContextVariables` in `DataContext` hierarchy to automatically determine how to persist changes (5715)
* [MAINTENANCE] Refactor `InMemoryStoreBackend` out of `store_backend.py` (5679)
* [MAINTENANCE] Move compatibility matrix tests to docker (5728)
* [MAINTENANCE] Adds additional file extensions for Parquet assets (5729)
* [MAINTENANCE] MultiBatch SqlExample notebook Update. (5718)
* [MAINTENANCE] Introduce NumericRangeEstimator class hierarchy and encapsulate existing estimator implementations (5735)

* [FEATURE] Improve estimation histogram computation in NumericMetricRangeMultiBatchParameterBuilder to include both counts and bin edges (5628)
* [FEATURE] Enable retrieve by name for datasource with cloud store backend (5640)
* [FEATURE] Update `DataContext.add_checkpoint()` to ensure validations within `CheckpointConfig` contain ids (5638)
* [FEATURE] Add `expect_column_values_to_be_valid_crc32` (5580) (thanks sp1thas)
* [FEATURE] Enable showing expectation suite by domain and by expectation_type -- from DataAssistantResult (5673)
* [BUGFIX] Patch flaky E2E GX Cloud tests (5629)
* [BUGFIX] Pass `--cloud` flag to `dgtest-cloud-overrides` section of Azure YAML (5632)
* [BUGFIX] Remove datasource from config on delete (5636)
* [BUGFIX] Patch issue with usage stats sync not respecting usage stats opt-out (5644)
* [BUGFIX] SlackRenderer / EmailRenderer links to deprecated doc (5648)
* [BUGFIX] Fix table.head metric issue when using BQ without temp tables (5630)
* [BUGFIX] Quick bugfix on all profile numeric column diff bounds expectations (5651) (thanks stevensecreti)
* [BUGFIX] Patch bug with `id` vs `id_` in Cloud integration tests (5677)
* [DOCS] Fix a typo in batch_request_parameters variable (5612) (thanks StasDeep)
* [MAINTENANCE] CloudDataContext add_datasource test (5626)
* [MAINTENANCE] Update stale.yml (5602)
* [MAINTENANCE] Add `id` to `CheckpointValidationConfig` (5603)
* [MAINTENANCE] Better error message for RuntimeDataConnector for BatchIdentifiers (5635)
* [MAINTENANCE] type-checking round 2 (5576)
* [MAINTENANCE] minor cleanup of old comments (5641)
* [MAINTENANCE] add `--clear-cache` flag for `invoke type-check` (5639)
* [MAINTENANCE] Install `dgtest` test runner utilizing Git URL in CI (5645)
* [MAINTENANCE] Make comparisons of aggregate values date aware (5642)
* [MAINTENANCE] Add E2E Cloud test for `DataContext.add_checkpoint()` (5653)
* [MAINTENANCE] Use docker to run tests in the Azure CI pipeline. (5646)
* [MAINTENANCE] add new invoke tasks to `tasks.py` and create new file `usage_stats_utils.py` (5593)
* [MAINTENANCE] Don't include 'test-pipeline' in extras_require dict (5659)
* [MAINTENANCE] move tool config to pyproject.toml (5649)
* [MAINTENANCE] Refactor docker test CI steps into jobs. (5665)
* [MAINTENANCE] Only run Cloud E2E tests in primary pipeline (5670)
* [MAINTENANCE] Improve DateTime Conversion Candling in Comparison Metrics & Expectations and Provide a Clean Object Model for Metrics Computation Bundling (5656)
* [MAINTENANCE] Ensure that `id_` fields in Marshmallow schema serialize as `id` (5660)
* [MAINTENANCE] data_context initial type checking (5662)