0.15.37 - YANKED

• [FEATURE] Support to include ID/PK in validation result for each row - SQL (#6448)
• [FEATURE] Build process and example API docs (part 1) (#6474)
• [FEATURE] Add temp_table_schema_name support for BigQuery (#6303) (thanks @BobbyRyterski)
• [FEATURE] Decorators for API docs (part 2) (#6497)
• [FEATURE] Decorators for API docs (part 3) (#6504)
• [BUGFIX] Support slack channel name with webhook also (#6481) (thanks @Kozehh)
• [BUGFIX] Airflow operator package conflict for jsonschema (#6495)
• [BUGFIX] Validator uses proper arguments to show progress bar at Metrics resolution-level (#6510) (thanks @tommy-watts-depop)
• [DOCS] Schedule Algolia Crawler daily at midnight (#6323)
• [DOCS] fix(gh-6512): fix rendering of Batch definition (#6513) (thanks @JoelGritter)
• [MAINTENANCE] Add pretty representations for zep pydantic models (#6472)
• [MAINTENANCE] Misc updates to PR template (#6479)
• [MAINTENANCE] Minor cleanup for better code readability (#6478)
• [MAINTENANCE] Move zep method from datasource to data asset. (#6477)
• [MAINTENANCE] Staging for build gallery (#6480)
• [MAINTENANCE] Reformat core expectation docstrings (#6423)
• [MAINTENANCE] Move "Domain" to "great_expectations/core" to avoid circular imports; also add MetricConfiguration tests; and other clean up. (#6484)
• [MAINTENANCE] Query the database for datetime column splitter defaults (#6482)
• [MAINTENANCE] Placing metrics test db under try-except (#6489)
• [MAINTENANCE] Clean up tests for more formal Batch and Validator instantiation (#6491)
• [MAINTENANCE] Rename ge to gx across the codebase (#6487)
• [MAINTENANCE] Upgrade CodeSee workflow to version 2 (#6498) (thanks @codesee-maps[bot])
• [MAINTENANCE] Rename GE to GX across codebase (GREAT-1352) (#6494)
• [MAINTENANCE] Resolve mypy issues in cli/docs.py (#6500)
• [MAINTENANCE] Increase timeout to 15 minutes for the 2 jobs in manual-staging-json-to-prod pipeline (#6509)
• [MAINTENANCE] Update Data Assistant plot color scheme and fonts (#6496)
• [MAINTENANCE] Update RendererConfiguration to pydantic model (#6452)
• [MAINTENANCE] Message for how to install Great Expectations in Cloud Composer by pinning packages (#6492)
• [MAINTENANCE] Leverage RendererConfiguration in existing prescriptive templates (1 of 3) (#6460)
• [MAINTENANCE] Clean up teams.yml (#6511)
• [MAINTENANCE] Make Generated Integration Tests More Robust Using BatchDefinition and InMemoryDataContext In Validator and ExecutionEngine Instantiation (#6505)
• [MAINTENANCE] DO NOT MERGE UNTIL DEC 8: [MAINTENANCE] Brand changes in docs (#6427)
• [MAINTENANCE] fixed typo in nav (#6518)
• [MAINTENANCE] Clean up GX Cloud environment variable usage (GREAT-1352) (#6501)
• [MAINTENANCE] Update Data Assistant plot images (#6521)
• [CONTRIB] Add uniqueness expectation (#6473) (thanks @itaise)

0.15.36

• [BUGFIX] Contrib Expectation tracebacks (#6471)
• [BUGFIX] Add additional error checking to ExpectationAnonymizer (#6467)
• [MAINTENANCE] Add docstring for context.sources.add_postgres (#6459)
• [MAINTENANCE] fixing type hints in metrics utils module (#6469)
• [MAINTENANCE] Moving tutorials to great-expectations repo (#6464)

0.15.35

• [FEATURE] add multiple input metric (#6373) (thanks @CarstenFrommhold)
• [FEATURE] add multiple column metric (#6372) (thanks @CarstenFrommhold)
• [FEATURE]: DataProfilerUnstructuredDataAssistant Integration (#6400) (thanks @micdavis)
• [FEATURE] add new metric - query template values (#5994) (thanks @itaise)
• [FEATURE] ZEP Config serialize as YAML (#6398)
• [BUGFIX] Patch issue with call to ExpectationAnonymizer to ensure DataContext init events are captured (#6458)
• [BUGFIX] Support Table and Column Names Case Non-Sensitivity Relationship Between Snowflake, Oracle, DB2, etc. DBMSs (Upper Case) and SQLAlchemy (Lower Case) Representations (#6450)
• [BUGFIX] Metrics return value no longer returns None for unexpected_index_list - Sql and Spark (#6392)
• [BUGFIX] Fix for mssql tests that depend on datetime to string conversion (#6449)
• [BUGFIX] issue-4295-fix-issue (#6164) (thanks @YevgeniyaLee)
• [BUGFIX] updated capitalone setup.py file (#6410) (thanks @micdavis)
• [BUGFIX] Patch key-generation issue with DataContext.save_profiler() (#6405)
• [DOCS] add configuration of anonymous_usage_statistics for documentation (#6293) (thanks @milithino)
• [DOCS] add boto3 explanations on document (#6407) (thanks @tiruka)
• [MAINTENANCE] [CONTRIB] Multicolumns sum equal to single column (#6446) (thanks @asafla)
• [MAINTENANCE] [CONTRIB] add expectation - check gaps in SCD tables (#6433) (thanks @itaise)
• [MAINTENANCE] [CONTRIB] Add no days missing expectation (#6432) (thanks @itaise)
• [MAINTENANCE] [CONTRIB] Feature/add two tables expectation (#6429) (thanks @itaise)
• [MAINTENANCE] [CONTRIB] Add number of unique values expectation (#6425) (thanks @itaise)
• [MAINTENANCE] Add sorters to zep postgres datasource. (#6456)
• [MAINTENANCE] Bump ubuntu version in CI (#6457)
• [MAINTENANCE] Remove anticipatory multi-language support from renderers (#6426)
• [MAINTENANCE] Remove yaml user_flow_scripts (#6454)
• [MAINTENANCE] Additional sqlite database fixture for taxi_data - All 2020 data in single table (#6455)
• [MAINTENANCE] Clean Up Variable Names In Test Modules, Type Hints, and Minor Refactoring For Better Code Elegance/Readability (#6444)
• [MAINTENANCE] Update and Simplify Pandas tests for MapMetrics (#6443)
• [MAINTENANCE] Add metadata to experimental datasource Batch class (#6442)
• [MAINTENANCE] Small refactor (#6422)
• [MAINTENANCE] Sorting batch IDs and typehints clean up (#6421)
• [MAINTENANCE] Clean Up Type Hints and Minor Refactoring For Better Code Elegance/Readability (#6418)
• [MAINTENANCE] Implement RendererConfiguration (#6412)
• [MAINTENANCE] Cleanup For Better Code Elegance/Readability (#6406)
• [MAINTENANCE] ZEP - GxConfig cleanup (#6404)
• [MAINTENANCE] Migrate remaining methods from BaseDataContext (#6403)
• [MAINTENANCE] Migrate additional CRUD methods from BaseDataContext to AbstractDataContext (#6395)
• [MAINTENANCE] ZEP add yaml methods to all experimental models (#6401)
• [MAINTENANCE] Remove call to verify_library_dependent_modules for pybigquery (#6394)
• [MAINTENANCE] Make "IDDict.to_id()" serialization more efficient. (#6389)

0.15.34

• [BUGFIX] Ensure packaging_and_installation CI tests against latest tag (#6386)
• [BUGFIX] Fixed missing comma in pydantic constraints (#6391) (thanks @awburgess)
• [BUGFIX] fix pydantic dev req file entries (#6396)
• [DOCS] DOC-379 bring spark datasource configuration example scripts under test (#6362)
• [MAINTENANCE] Handle both ExpectationConfiguration and ExpectationValidationResult in default Atomic renderers and cleanup include_column_name (#6380)
• [MAINTENANCE] Add type annotations to all existing atomic renderer signatures (#6385)
• [MAINTENANCE] move zep -> experimental package (#6378)
• [MAINTENANCE] Migrate additional methods from BaseDataContext to other parts of context hierarchy (#6388)

0.15.33

• [FEATURE] POC ZEP Config Loading (#6320)
• [BUGFIX] Fix issue with misaligned indentation in docs snippets (#6339)
• [BUGFIX] Use requirements.txt file when installing linting/static check dependencies in CI (#6368)
• [BUGFIX] Patch nested snippet indentation issues within remark-named-snippets plugin (#6376)
• [BUGFIX] Ensure packaging_and_installation CI tests against latest tag (#6386)
• [DOCS] DOC-308 update CLI command in docs when working with RBPs instead of Data Assistants (#6222)
• [DOCS] DOC-366 updates to docs in support of branding updates (#5766)
• [DOCS] Add yarn snippet-check command (#6351)
• [MAINTENANCE] Add missing one-line docstrings and try to make the others consistent (#6340)
• [MAINTENANCE] Refactor variable aggregation/substitution logic into ConfigurationProvider hierarchy (#6321)
• [MAINTENANCE] In ExecutionEngine: Make variable names and usage more descriptive of their purpose. (#6342)
• [MAINTENANCE] Move Cloud-specific enums to cloud_constants.py (#6349)
• [MAINTENANCE] Refactor out termcolor dependency (#6348)
• [MAINTENANCE] Zep PostgresDatasource returns a list of batches. (#6341)
• [MAINTENANCE] Refactor usage_stats_opt_out method in DataContext (#5339)
• [MAINTENANCE] Fix computed metrics type hint in ExecutionEngine.resolve_metrics() method (#6347)
• [MAINTENANCE] Subject: Support to include ID/PK in validation result for each row t… (#5876) (thanks @abekfenn)
• [MAINTENANCE] Pin mypy to 0.990 (#6361)
• [MAINTENANCE] Misc cleanup of GX Cloud helpers (#6352)
• [MAINTENANCE] Update column_reflection_fallback to also use schema name for Trino (#6350)
• [MAINTENANCE] Bump version of mypy in contrib CLI (#6370)
• [MAINTENANCE] Move config variable substitution logic into ConfigurationProvider (#6345)
• [MAINTENANCE] Removes comment in code that was causing confusion to some users. (#6366)
• [MAINTENANCE] minor metrics typing (#6374)
• [MAINTENANCE] Make ConfigurationProvider and ConfigurationSubstitutor private (#6375)
• [MAINTENANCE] Rename GeCloudStoreBackend to GXCloudStoreBackend (#6377)
• [MAINTENANCE] Cleanup Metrics and ExecutionEngine methods (#6371)
• [MAINTENANCE] F/great 1314/integrate zep in core (#6358)
• [MAINTENANCE] Loosen pydantic version requirement (#6384)

0.15.32

• [BUGFIX] Patch broken CloudNotificationAction tests (#6327)
• [BUGFIX] add create_temp_table flag to ExecutionEngineConfigSchema (#6331) (thanks @tommy-watts-depop)
• [BUGFIX] MapMetrics now return partial_unexpected values for SUMMARY format (#6334)
• [DOCS] Re-writes "how to implement custom notifications" as "How to get Data Docs URLs for use in custom Validation Actions" (#6281)
• [DOCS] Removes deprecated expectation notebook exploration doc (#6298)
• [DOCS] Removes a number of unused & deprecated docs (#6300)
• [DOCS] Prioritizes Onboarding Data Assistant in ToC (#6302)
• [DOCS] Add ZenML into integration table in Readme (#6144) (thanks @dnth)
• [DOCS] add pypi release badge (#6324)
• [MAINTENANCE] Remove unneeded BaseDataContext.get_batch_list (#6291)
• [MAINTENANCE] Clean up implicit Optional errors flagged by mypy (#6319)
• [MAINTENANCE] Add manual prod flags to core Expectations (#6278)
• [MAINTENANCE] Fallback to isnot method if is_not is not available (old sqlalchemy) (#6318)
• [MAINTENANCE] Add ZEP postgres datasource. (#6274)
• [MAINTENANCE] Delete "metric_dependencies" from MetricConfiguration constructor arguments (#6305)
• [MAINTENANCE] Clean up DataContext (#6304)
• [MAINTENANCE] Deprecate save_changes flag on Datasource CRUD (#6258)
• [MAINTENANCE] Deprecate great_expectations.render.types package (#6315)
• [MAINTENANCE] Update range of allowable sqlalchemy versions (#6328)
• [MAINTENANCE] Fixing checkpoint types (#6325)
• [MAINTENANCE] Fix column_reflection_fallback for Trino and minor logging/testing improvements (#6218)
• [MAINTENANCE] Change the number of expected Expectations in the 'quick check' stage of build_gallery pipeline (#6333)

0.15.31

• [BUGFIX] Include all requirement files in the sdist (#6292) (thanks @xhochy)
• [DOCS] Updates outdated batch_request snippet in Terms (#6283)
• [DOCS] Update Conditional Expectations doc w/ current availability (#6279)
• [DOCS] Remove outdated Data Discovery page and all references (#6288)
• [DOCS] Remove reference/evaluation_parameters page and all references (#6294)
• [DOCS] Removing deprecated Custom Metrics doc (#6282)
• [DOCS] Re-writes "how to implement custom notifications" as "How to get Data Docs URLs for use in custom Validation Actions" (#6281)
• [DOCS] Removes deprecated expectation notebook exploration doc (#6298)
• [MAINTENANCE] Move RuleState into rule directory. (#6284)

0.15.30

• [FEATURE] Add zep datasources to data context. (#6255)
• [BUGFIX] Iterate through GeCloudIdentifiers to find the suite ID from the name (#6243)
• [BUGFIX] Update default base url for cloud API (#6176)
• [BUGFIX] Pin termcolor to below 2.1.0 due to breaking changes in lib's TTY parsing logic (#6257)
• [BUGFIX] InferredAssetSqlDataConnector include_schema_name introspection of identical table names in different schemas (#6166)
• [BUGFIX] Fixdocs-integration tests, and temporarily pin sqlalchemy (#6268)
• [BUGFIX] Fix serialization for contrib packages (#6266)
• [BUGFIX] Ensure that Datasource credentials are not persisted to Cloud/disk (#6254)
• [DOCS] Updates package contribution references (#5885)
• [MAINTENANCE] Maintenance/great 1103/great 1318/alexsherstinsky/validation graph/refactor validation graph usage 2022 10 20 248 (#6228)
• [MAINTENANCE] Refactor instances of noqa: F821 Flake8 directive (#6220)
• [MAINTENANCE] Logo URI ref in data_docs (#6246)
• [MAINTENANCE] fix typos in docstrings (#6247)
• [MAINTENANCE] Isolate Trino/MSSQL/MySQL tests in dev CI (#6231)
• [MAINTENANCE] Split up compatability and comprehensive stages in dev CI to improve performance (#6245)
• [MAINTENANCE] ZEP POC - Asset Type Registration (#6194)
• [MAINTENANCE] Add Trino CLI support and bump Trino version (#6215) (thanks @hovaesco)
• [MAINTENANCE] Delete unneeded Rule attribute property (#6264)
• [MAINTENANCE] Small clean-up of Marshmallow warnings (missing parameter changed to load_default as of 3.13) (#6213)
• [MAINTENANCE] Move .png files out of project root (#6249)
• [MAINTENANCE] Cleanup expectation.py attributes (#6265)
• [MAINTENANCE] Further parallelize test runs in dev CI (#6267)
• [MAINTENANCE] GCP Integration Pipeline fix (#6259)
• [MAINTENANCE] mypy warn_unused_ignores (#6270)
• [MAINTENANCE] ZEP - Datasource base class (#6263)
• [MAINTENANCE] Reverting marshmallow version bump (#6271)
• [MAINTENANCE] type hints cleanup in Rule-Based Profiler (#6272)
• [MAINTENANCE] Remove unused f-strings (#6248)
• [MAINTENANCE] Make ParameterBuilder.resolve_evaluation_dependencies() into instance (rather than utility) method (#6273)
• [MAINTENANCE] Test definition for ExpectColumnValueZScoresToBeLessThan (#6229)
• [MAINTENANCE] Make RuleState constructor argument ordering consistent with standard pattern. (#6275)
• [MAINTENANCE] [REQUEST] Please allow Rachel to unblock blockers (#6253)

0.15.29

• [FEATURE] Add support to AWS Glue Data Catalog (#5123) (thanks @lccasagrande)
• [FEATURE] / Added pairwise expectation 'expect_column_pair_values_to_be_in_set' (#6097) (thanks @Arnavkar)
• [BUGFIX] Adjust condition in RenderedAtomicValueSchema.clean_null_attrs (#6168)
• [BUGFIX] Add py to dev dependencies to circumvent compatability issues with pytest==7.2.0 (#6202)
• [BUGFIX] Fix test_package_dependencies.py to include py lib (#6204)
• [BUGFIX] Fix logic in ExpectationDiagnostics._check_renderer_methods method (#6208)
• [BUGFIX] Patch issue with empty config variables file raising TypeError (#6216)
• [BUGFIX] Release patch for Azure env vars (#6233)
• [BUGFIX] Cloud Data Context should overwrite existing suites based on ge_cloud_id instead of name (#6234)
• [BUGFIX] Add env vars to Pytest min versions Azure stage (#6239)
• [DOCS] doc-297: update the create Expectations overview page for Data Assistants (#6212)
• [DOCS] DOC-378: bring example scripts for pandas configuration guide under test (#6141)
• [MAINTENANCE] Add unit test for MetricsCalculator.get_metric() Method -- as an example template (#6179)
• [MAINTENANCE] ZEP MetaDatasource POC (#6178)
• [MAINTENANCE] Update scope_check in Azure CI to trigger on changed .py source code files (#6185)
• [MAINTENANCE] Move test_yaml_config to a separate class (#5487)
• [MAINTENANCE] Changed profiler to Data Assistant in CLI, docs, and tests (#6189)
• [MAINTENANCE] Update default GE_USAGE_STATISTICS_URL in test docker image. (#6192)
• [MAINTENANCE] Re-add a renamed test definition file (#6182)
• [MAINTENANCE] Refactor method parse_evaluation_parameter (#6191)
• [MAINTENANCE] Migrate methods from BaseDataContext to AbstractDataContext (#6188)
• [MAINTENANCE] Rename cfe to v3_api (#6190)
• [MAINTENANCE] Test Trino doc examples with test_script_runner.py (#6198)
• [MAINTENANCE] Cleanup of Regex ParameterBuilder (#6196)
• [MAINTENANCE] Apply static type checking to expectation.py (#6173)
• [MAINTENANCE] Remove version matrix from dev CI pipeline to improve performance (#6203)
• [MAINTENANCE] Rename CloudMigrator.retry_unsuccessful_validations (#6206)
• [MAINTENANCE] Add validate_configuration method to expect_table_row_count_to_equal_other_table (#6209)
• [MAINTENANCE] Replace deprecated iteritems with items (#6205)
• [MAINTENANCE] Add instructions for setting up the test_ci database (#6211)
• [MAINTENANCE] Add E2E tests for Cloud-backed Datasource CRUD (#6186)
• [MAINTENANCE] Execution Engine linting & partial typing (#6210)
• [MAINTENANCE] Test definition for ExpectColumnValuesToBeJsonParsable, including a fix for Spark (#6207)
• [MAINTENANCE] Port over usage statistics enabled methods from BaseDataContext to AbstractDataContext (#6201)
• [MAINTENANCE] Remove temporary dependency on py (#6217)
• [MAINTENANCE] Adding type hints to DataAssistant implementations (#6224)
• [MAINTENANCE] Remove AWS config file dependencies and use existing env vars in CI/CD (#6227)
• [MAINTENANCE] Make UsageStatsEvents a StrEnum (#6225)
• [MAINTENANCE] Move all requirements-dev*.txt files to separate dir (#6223)
• [MAINTENANCE] Maintenance/great 1103/great 1318/alexsherstinsky/validation graph/refactor validation graph usage 2022 10 20 248 (#6228)

0.15.28

• [FEATURE] Initial zep datasource protocol. (#6153)
• [FEATURE] Introduce BatchManager to manage Batch objects used by Validator and BatchData used by ExecutionEngine (#6156)
• [FEATURE] Add support for Vertica dialect (#6145) (thanks @viplazylmht)
• [FEATURE] Introduce MetricsCalculator and Refactor Redundant Code out of Validator (#6165)
• [BUGFIX] SQLAlchemy selectable Bug fix (#6159) (thanks @tommy-watts-depop)
• [BUGFIX] Parameterize usage stats endpoint in test dockerfile. (#6169)
• [BUGFIX] B/great 1305/usage stats endpoint (#6170)
• [BUGFIX] Ensure that spaces are recognized in named snippets (#6172)
• [DOCS] Clarify wording for interactive mode in databricks (#6154)
• [DOCS] fix source activate command (#6161) (thanks @JGrzywacz)
• [DOCS] Update version in runtime.txt to fix breaking Netlify builds (#6181)
• [DOCS] Clean up snippets and line number validation in docs (#6142)
• [MAINTENANCE] Add Enums for renderer types (#6112)
• [MAINTENANCE] Minor cleanup in preparation for Validator refactoring into separate concerns (#6155)
• [MAINTENANCE] add the internal GE_DATA_CONTEXT_ID env var to the docker file (#6122)
• [MAINTENANCE] Rollback setting GE_DATA_CONTEXT_ID in docker image. (#6163)
• [MAINTENANCE] disable ge_cloud_mode when specified, detect misconfiguration (#6162)
• [MAINTENANCE] Re-add missing Expectations to gallery and include package names (#6171)
• [MAINTENANCE] Use from __future__ import annotations to clean up type hints (#6127)
• [MAINTENANCE] Make sure that quick stage check returns 0 if there are no problems (#6177)
• [MAINTENANCE] Remove SQL for expect_column_discrete_entropy_to_be_between (#6180)