Great-expectations

* [FEATURE] Script to validate docs snippets line number refs (4377)
* [FEATURE] GitHub action to auto label `core-team` (4382)
* [FEATURE] `add_rule()` method for RuleBasedProfilers and tests (4358)
* [FEATURE] Enable the passing of an existing suite to `RuleBasedProfiler.run()` (4386)
* [FEATURE] Impose Ordering on Marshmallow Schema validated Rule-Based Profiler Configuration fields (4388)
* [FEATURE] Use more granular requirements-dev-xxx.txt files (4327)
* [FEATURE] Rule-Based Profiler: Implement Utilities for getting all available parameter node names and objects resident in memory (4442)
* [BUGFIX] Minor Serialization Correction for MeanUnexpectedMapMetricMultiBatchParameterBuilder (4385)
* [BUGFIX] Fix CategoricalColumnDomainBuilder to be compliant with serialization / instantiation interfaces (4395)
* [BUGFIX] Fix bug around `get_parent` usage stats utility in `test_yaml_config` (4410)
* [BUGFIX] Adding `--spark` flag back to `azure-pipelines.yml` compatibility_matrix stage. (4418)
* [BUGFIX] Remove remaining usage of --no-spark and --no-postgresql flags for pytest (4425)
* [BUGFIX] Insure Proper Indexing of Metric Computation Results in ParameterBuilder (4426)
* [BUGFIX] Include requirements-dev-contrib.txt in dev-install-matrix.yml for lightweight (4430)
* [BUGFIX] Remove `pytest-azurepiplines` usage from `test_cli` stages in Azure pipelines (4432)
* [BUGFIX] Updates or deletes broken and deprecated example notebooks (4404)
* [BUGFIX] Add any dependencies we import directly, but don't have as explicit requirements (4447)
* [BUGFIX] Removes potentially sensitive webhook URLs from logging (4440)
* [BUGFIX] Fix packaging test (4452)
* [DOCS] Fix typo in how_to_create_custom_metrics (4379)
* [DOCS] Add `snippet` tag to gcs data docs (4383)
* [DOCS] adjust lines for py reference (4390)
* [DOCS] technical tags for connecting to data: core skills docs (4403)
* [DOCS] technical term tags for connect to data database documents (4413)
* [DOCS] Technical term tags for documentation under Connect to data: Filesystem (4411)
* [DOCS] Technical term tags for setup pages (4392)
* [DOCS] Technical term tags for Connect to Data: Advanced docs. (4406)
* [DOCS] Technical tags: Connect to data:In memory docs (4405)
* [DOCS] Add misc `snippet` tags to existing documentation (4397)
* [DOCS] technical terms create expectations: core skills (4435)
* [DOCS] Creates Custom Table Expectation How-To (4399)
* [HACKATHON] ExpectTableLinearFeatureImportancesToBe (4400)
* [MAINTENANCE] Group MAP_SERIES and MAP_CONDITION_SERIES with VALUE-type metrics (3286)
* [MAINTENANCE] minor imports cleanup (4381)
* [MAINTENANCE] Change schedule for `packaging_and_installation` pipeline to run at off-hours (4384)
* [MAINTENANCE] Implicitly anonymize object based on __module__ (4387)
* [MAINTENANCE] Preparatory cleanup refactoring of get_compute_domain (4371)
* [MAINTENANCE] RBP -- make parameter builder configurations for self initializing expectations consistent with ParameterBuilder class interfaces (4398)
* [MAINTENANCE] Refactor `ge_class` attr out of Anonymizer and related child classes (4393)
* [MAINTENANCE] Removing Custom Expectation Renderer docs from sidebar (4401)
* [MAINTENANCE] Enable "rule_based_profiler.run()" Method to Accept Batch Data Arguments Directly (4409)
* [MAINTENANCE] Refactor out unnecessary Anonymizer child classes (4408)
* [MAINTENANCE] Replace "sampling_method" with "estimator" in Rule-Based Profiler code (4420)
* [MAINTENANCE] Add docstrings and type hints to `Anonymizer` (4419)
* [MAINTENANCE] Continue chipping away at warnings (4422)
* [MAINTENANCE] Rule-Based Profiler: Standardize on Include/Exclude Column Names List (4424)
* [MAINTENANCE] Set upper bound on number of allowed warnings in snippet validation script (4434)
* [MAINTENANCE] Clean up of `RegexPatternStringParameterBuilder` tests to use unittests (4436)

* [FEATURE] ParameterBuilder for Computing Average Unexpected Values Fractions for any Map Metric (4340)
* [FEATURE] Improve bootstrap quantile method accuracy (4270)
* [FEATURE] Decorate RuleBasedProfiler.run() with usage statistics (4321)
* [FEATURE] MapMetricColumnDomainBuilder for Rule-Based Profiler (4353)
* [FEATURE] Enable expect_column_min/_max_to_be_between expectations to be self-initializing (4363)
* [FEATURE] Azure pipeline to perform nightly CI/CD runs around packaging/installation (4274)
* [BUGFIX] Fix `IndexError` around data asset pagination from CLI (4346)
* [BUGFIX] Upper bound pyathena to <2.5.0 (4350)
* [BUGFIX] Fixes PyAthena type checking for core expectations & tests (4359)
* [BUGFIX] BatchRequest serialization (CLOUD-743) (4352)
* [BUGFIX] Update the favicon on docs site (4376)
* [BUGFIX] Fix issue with datetime objects in expecatation args (2652) (thanks jstammers)
* [DOCS] Universal map TOC update (4292)
* [DOCS] add Config section (4355)
* [DOCS] Deployment Patterns to Reference Architectures (4344)
* [DOCS] Fixes tutorial link in reference architecture prereqs component (4360)
* [DOCS] Tag technical terms in getting started tutorial (4354)
* [DOCS] Update overview pages to link to updated tutorial pages. (4378)
* [HACKATHON] ExpectColumnValuesToBeValidUUID (4322)
* [HACKATHON] add expectation core (4357)
* [HACKATHON] ExpectColumnAverageToBeWithinRangeOfGivenPoint (4356)
* [MAINTENANCE] rule based profiler minor clean up of ValueSetParameterBuilder (4332)
* [MAINTENANCE] Adding tests that exercise single and multi-batch BatchRequests (4330)
* [MAINTENANCE] Formalize ParameterBuilder contract API usage in ValueSetParameterBuilder (4333)
* [MAINTENANCE] Rule-Based Profiler: Create helpers directory; use column domain generation convenience method (4335)
* [MAINTENANCE] Deduplicate table domain kwargs splitting (4338)
* [MAINTENANCE] Update Azure CI/CD cron schedule to run more frequently (4345)
* [MAINTENANCE] Optimize CategoricalColumnDomainBuilder to compute metrics in a single method call (4348)
* [MAINTENANCE] Reduce tries to 2 for probabilistic tests (4351)
* [MAINTENANCE] Refactor Checkpoint toolkit (4342)
* [MAINTENANCE] Refactor all uses of `format` in favor of f-strings (4347)
* [MAINTENANCE] Update great_expectations_contrib CLI tool to use existing diagnostic classes (4316)
* [MAINTENANCE] Setting stage for removal of `--no-postgresql` and `--no-spark` flags from `pytest`. Enable `--postgresql` and `--spark` (4309)
* [MAINTENANCE] convert unexpected_list contents to hashable type (4336)
* [MAINTENANCE] add operator and func handling to stores urns (4334)
* [MAINTENANCE] Refactor ParameterBuilder classes to extend parent class where possible; also, minor cleanup (4375)

* [FEATURE] Enable Simultaneous Execution of all Metric Computations for ParameterBuilder implementations in Rule-Based Profiler (4282)
* [FEATURE] Update print_diagnostic_checklist with an option to show any failed tests (4288)
* [FEATURE] Self-Initializing Expectations (implemented for three example expectations). (4258)
* [FEATURE] ValueSetMultiBatchParameterBuilder and CategoricalColumnDomainBuilder (4269)
* [FEATURE] Remove changelog-bot GitHub Action (4297)
* [FEATURE] Add requirements-dev-lite.txt and update tests/docs (4273)
* [FEATURE] Enable All ParameterBuilder and DomainBuilder classes to accept batch_list generically (4302)
* [FEATURE] Enable Probabilistic Tests To Retry upon Assertion Failure (4308)
* [FEATURE] Update usage stats schema to account for RBP's run() payload (4266)
* [FEATURE] ProfilerRunAnonymizer (4264)
* [FEATURE] Enable Expectation "expect_column_values_to_be_in_set" to be Self-Initializing (4318)
* [BUGFIX] Add redirect for removed Spark EMR page (4280)
* [BUGFIX] `ConfiguredAssetSqlDataConnector` now correctly handles `schema` and `prefix`/`suffix` (4268)
* [BUGFIX] Fixes Expectation Diagnostics failing on multi-line docstrings with leading linebreaks (4286)
* [BUGFIX] Respect test backends (4287)
* [BUGFIX] Skip test__generate_expectations_tests__xxx tests when sqlalchemy isn't there (4300)
* [BUGFIX] test_backends integration test fix and supporting docs code ref fixes (4306)
* [BUGFIX] Update `deep_filter_properties_iterable` to ensure that empty values are cleaned (4298)
* [BUGFIX] Fixes validate_configuration checking in diagnostics (4307)
* [BUGFIX] Update test output that should be returned from generate_diagnostic_checklist (4317)
* [BUGFIX] Standardizes imports in expectation templates and examples (4320)
* [BUGFIX] Only validate row_condition if not None (4329)
* [BUGFIX] Fix PEP273 Windows issue (4328)
* [DOCS] Fixes misc. verbiage & typos in new Custom Expectation docs (4283)
* [DOCS] fix formatting in configuration details block of Getting Started (4289) (thanks afeld)
* [DOCS] Fixes imports and code refs to expectation templates (4314)
* [DOCS] Update creating_custom_expectations/overview.md (4278) (thanks binarytom)
* [CONTRIB] CapitalOne Dataprofiler expectations (4174) (thanks taylorfturner)
* [HACKATHON] ExpectColumnValuesToBeLatLonCoordinatesInRangeOfGivenPoint (4284)
* [HACKATHON] ExpectColumnValuesToBeValidDegreeDecimalCoordinates (4319)
* [MAINTENANCE] Refactor parameter setting for simpler ParameterBuilder interface (4299)
* [MAINTENANCE] SimpleDateTimeFormatStringParameterBuilder and general RBP example config updates (4304)
* [MAINTENANCE] Make adherence to Marshmallow Schema more robust (4325)
* [MAINTENANCE] Refactor rule based profiler to keep objects/utilities within intended scope (4331)
* [MAINTENANCE] Dependabot version upgrades (4253, 4231, 4058, 4041, 3916, 3886, 3583, 2856, 3370, 3216, 2935, 2855, 3302, 4008, 4252)

* [FEATURE] Add `run_profiler_on_data` method to DataContext (4190)
* [FEATURE] `RegexPatternStringParameterBuilder` for `RuleBasedProfiler` (4167)
* [FEATURE] experimental column map expectation checking for vectors (3102) (thanks manyshapes)
* [FEATURE] Pre-requisites in Rule-Based Profiler for Self-Estimating Expectations (4242)
* [FEATURE] Add optional parameter `condition` to DefaultExpectationConfigurationBuilder (4246)
* [BUGFIX] Ensure that test result for `RegexPatternStringParameterBuilder` is deterministic (4240)
* [BUGFIX] Remove duplicate RegexPatternStringParameterBuilder test (4241)
* [BUGFIX] Improve pandas version checking in test_expectations[_cfe].py files (4248)
* [BUGFIX] Ensure `test_script_runner.py` actually raises AssertionErrors correctly (4239)
* [BUGFIX] Check for pandas>=024 not pandas>=24 (4263)
* [BUGFIX] Add support for SqlAlchemyQueryStore connection_string credentials (4224) (thanks davidvanrooij)
* [BUGFIX] Remove assertion (4271)
* [DOCS] Hackathon Contribution Docs (3897)
* [MAINTENANCE] Rule-Based Profiler: Fix Circular Imports; Configuration Schema Fixes; Enhanced Unit Tests; Pre-Requisites/Refactoring for Self-Estimating Expectations (4234)
* [MAINTENANCE] Reformat contrib expectation with black (4244)
* [MAINTENANCE] Resolve cyclic import issue with usage stats (4251)
* [MAINTENANCE] Additional refactor to clean up cyclic imports in usage stats (4256)
* [MAINTENANCE] Rule-Based Profiler prerequisite: fix quantiles profiler configuration and add comments (4255)
* [MAINTENANCE] Introspect Batch Request Dictionary for its kind and instantiate accordingly (4259)
* [MAINTENANCE] Minor clean up in style of an RBP test fixture; making variables access more robust (4261)
* [MAINTENANCE] define empty sqla_bigquery object (4249)

* [FEATURE] Support Multi-Dimensional Metric Computations Generically for Multi-Batch Parameter Builders (4206)
* [FEATURE] Add support for sqlalchemy-bigquery while falling back on pybigquery (4182)
* [BUGFIX] Update validate_configuration for core Expectations that don't return True (4216)
* [DOCS] Fixes two references to the Getting Started tutorial (4189)
* [DOCS] Deepnote Deployment Pattern Guide (4169)
* [DOCS] Allow Data Docs to be rendered in night mode (4130)
* [DOCS] Fix datepicker filter on data docs (4217)
* [DOCS] Deepnote Deployment Pattern Image Fixes (4229)
* [MAINTENANCE] Refactor RuleBasedProfiler toolkit pattern (4191)
* [MAINTENANCE] Revert `dependency_graph` pipeline changes to ensure `usage_stats` runs in parallel (4198)
* [MAINTENANCE] Refactor relative imports (4195)
* [MAINTENANCE] Remove temp file that was accidently committed (4201)
* [MAINTENANCE] Update default candidate strings SimpleDateFormatString parameter builder (4193)
* [MAINTENANCE] minor type hints clean up (4214)
* [MAINTENANCE] RBP testing framework changes (4184)
* [MAINTENANCE] add conditional check for 'expect_column_values_to_be_in_type_list' (4200)
* [MAINTENANCE] Allow users to pass in any set of polygon points in expectation for point to be within region (2520) (thanks ryanlindeborg)
* [MAINTENANCE] Better support Hive, better support BigQuery. (2624) (thanks jacobpgallagher)
* [MAINTENANCE] move process_evaluation_parameters into conditional (4109)
* [MAINTENANCE] Type hint usage stats (4226)

* [FEATURE] Create profiler from DataContext (4070)
* [FEATURE] Add read_sas function (3972) (thanks andyjessen)
* [FEATURE] Run profiler from DataContext (4141)
* [FEATURE] Instantiate Rule-Based Profiler Using Typed Configuration Object (4150)
* [FEATURE] Provide ability to instantiate Checkpoint using CheckpointConfig typed object (4166)
* [FEATURE] Misc cleanup around CLI `suite` command and related utilities (4158)
* [FEATURE] Add scheduled runs for primary Azure pipeline (4117)
* [FEATURE] Promote dependency graph test strategy to production (4124)
* [BUGFIX] minor updates to test definition json files (4123)
* [BUGFIX] Fix typo for metric name in expect_column_values_to_be_edtf_parseable (4140)
* [BUGFIX] Ensure that CheckpointResult object can be pickled (4157)
* [BUGFIX] Custom notebook templates (2619) (thanks luke321321)
* [BUGFIX] Include public fields in property_names (4159)
* [DOCS] Reenable docs-under-test for RuleBasedProfiler (4149)
* [DOCS] Provided details for using GE_HOME in commandline. (4164)
* [MAINTENANCE] Return Rule-Based Profiler base.py to its dedicated config subdirectory (4125)
* [MAINTENANCE] enable filter properties dict to handle both inclusion and exclusion lists (4127)
* [MAINTENANCE] Remove unused Great Expectations imports (4135)
* [MAINTENANCE] Update trigger for scheduled Azure runs (4134)
* [MAINTENANCE] Maintenance/upgrade black (4136)
* [MAINTENANCE] Alter `great_expectations` pipeline trigger to be more consistent (4138)
* [MAINTENANCE] Remove remaining unused imports (4137)
* [MAINTENANCE] Remove `class_name` as mandatory field from `RuleBasedProfiler` (4139)
* [MAINTENANCE] Ensure `AWSAthena` does not create temporary table as part of processing Batch by default, which is currently not supported (4103)
* [MAINTENANCE] Remove unused `Exception as e` instances (4143)
* [MAINTENANCE] Standardize DictDot Method Behaviors Formally for Consistent Usage Patterns in Subclasses (4131)
* [MAINTENANCE] Remove unused f-strings (4142)
* [MAINTENANCE] Minor Validator code clean up -- for better code clarity (4147)
* [MAINTENANCE] Refactoring of `test_script_runner.py`. Integration and Docs tests (4145)
* [MAINTENANCE] Remove `compatability` stage from `dependency-graph` pipeline (4161)
* [MAINTENANCE] CLOUD-618: GE Cloud "account" to "organization" rename (4146)