Skip to main content
Version: 0.17.23

Changelog

Deprecation policy​

  • Deprecation warnings and the supporting code are maintained for two minor versions. For example, v0.12 deprecations will only be removed as part of a v0.15 release.
    • This means we have three supported minor versions in the release at any time. For example: in v0.15 we support v0.15, v0.14, and v0.13. When v0.16 ships we will support v0.16, v0.15, and v0.14 and will remove support for v0.13.
  • Deprecation warnings include (in the warning message) the version that they were introduced. For example: "deprecated as of v0.13"
  • Deprecation warnings are accompanied by a moniker (as a code comment) indicating when they were deprecated. For example: # deprecated-v0.13
  • Changes to methods and parameters due to deprecation are also noted in the relevant docstrings.

0.17.23​

  • [FEATURE] Unexpected index list with/without values - New parameter in result_format (#8785) (thanks @MMoussabbih)
  • [DOCS] Update Cloud Docs to Include Docker Methodology (#8820)
  • [DOCS] Updated language & code refs for Databricks Getting Started (#8751)
  • [DOCS] Remove all mentions of profilers in public docs (#8825)
  • [DOCS] Create New Content for Column Descriptive Metrics in GX Cloud (#8814)
  • [DOCS] Document GX Cloud Data Assistant Functionality (#8829)
  • [DOCS] Update set_up_gx_cloud.md (#8832)
  • [DOCS] Update Manage Expectation Suites in GX Cloud Docs (#8842)
  • [DOCS] Remove Troubleshooting Entry from GX Cloud TOC (#8846)
  • [MAINTENANCE] Column Descriptive Metrics: Don't add empty string for type (#8830)
  • [MAINTENANCE] Add cloud api via docker compose for testing (#8803)
  • [MAINTENANCE] Remove public_api decorators from RBP (#8812)
  • [MAINTENANCE] mypy 1.6 (#8837)
  • [MAINTENANCE] Delete legacy BasicSuiteBuilderProfiler (#8808)
  • [MAINTENANCE] Run ci-is-on-main-repo in merge queue. (#8839)
  • [MAINTENANCE] Add pact contract testing with GX Cloud (#8831)
  • [MAINTENANCE] Allow re-publishing Pact on same commit (#8851)
  • [CONTRIB] Also run CI when a PR becomes Ready for Review (#8833)

0.17.22​

  • [BUGFIX] Column Descriptive Metrics: Skip finding semantic type info for UNKNOWN columns (#8815)
  • [BUGFIX] Column Descriptive Metrics: Convert table name to lowercase for snowflake (#8817)
  • [BUGFIX] Improve datasource crud (#8773)
  • [BUGFIX] Fix Snowflake 'connection_string' TestConnectionError (#8816)
  • [BUGFIX] Fix missing config_provider (#8822)
  • [DOCS] Minor Syntax Update (#8806)
  • [DOCS] Update docs to reference new gx/ dir instead of great_expectations/ (#8717)
  • [MAINTENANCE] Remove ge_cloud_mode from Store (#8747)
  • [MAINTENANCE] Bump urllib3 from 1.26.5 to 1.26.17 in /docs_rtd (#8802)
  • [MAINTENANCE] Delete legacy JsonSchemaProfiler (#8807)
  • [MAINTENANCE] Column Descriptive Metrics: Default to UNKNOWN if type is not found (#8810)
  • [MAINTENANCE] Column Descriptive Metrics: Empty string instead of UNKNOWN if table column type introspection fails (#8819)
  • [MAINTENANCE] Delete outdated context fixtures (#8809)
  • [MAINTENANCE] Bump gitpython from 3.1.35 to 3.1.37 in /docs_rtd (#8818)
  • [MAINTENANCE] Fix docs-snippets CI step (#8827)
  • [CONTRIB] Updates to MulticolumnValuesSumValuesEqualToSingleColumn (#8798) (thanks @calvingdu)
  • [CONTRIB] New MulticolumnValuesProductEqualToSingleColumn Expectation (#8799) (thanks @calvingdu)

0.17.21​

  • [FEATURE] DataDocs Renderer for ExpectMulticolumnSumToEqual and LikePattern Expectations (#8739)
  • [FEATURE] Allow optional expectation_suite_name to be passed to RunDataAssistantEvent (#8693)
  • [BUGFIX] Column Descriptive Metrics: Single connection (#8758)
  • [DOCS] Updated link for Prefect integration (#8749)
  • [DOCS] Fixed broken links in footer to match marketing page (#8748)
  • [DOCS] Remove examples of YAML configuration for Checkpoints in docs (#8704)
  • [DOCS] Remove YAML Configuration Option from Manage Checkpoints and Other Documentation (#8637)
  • [DOCS] Create Snowflake Quickstart for GX Cloud (#8756)
  • [DOCS] Create GX Cloud Agent Installation Topic (#8760)
  • [DOCS] Update Section Link in GX Cloud TOC (#8772)
  • [DOCS] Update Cloud Snowflake install instructions (#8776)
  • [DOCS] Add GX Cloud Content (#8775)
  • [DOCS] Update Link on Landing Page (#8794)
  • [DOCS] Minor Update to Code Syntax in Quickstart (#8800)
  • [DOCS] Consistent pip install instructions (#8801)
  • [DOCS] Add Mermaid plugin to Docusaurus (#8793)
  • [MAINTENANCE] Column Descriptive Metrics: Add metric exceptions (#8754)
  • [MAINTENANCE] Update CODEOWNERS js rule to include front end community of practice (#8763)
  • [MAINTENANCE] Fix CI - DictDot typing issue (#8765)
  • [MAINTENANCE] Stop using extras to install test dependencies (#8767)
  • [MAINTENANCE] Skip full marker test on merge_group (#8766)
  • [MAINTENANCE] Update Fabric MeasureAsset.groupby_columns signature (#8764)
  • [MAINTENANCE] Add great_expectations_cloud as a dependency (#8762)
  • [MAINTENANCE] Bump Cloud dependency to 0.0.3.dev3 (#8774)
  • [MAINTENANCE] Fix merge group worker usage (#8778)
  • [MAINTENANCE] SQL column identifier testing - ensure expectations fail when expected (#8757)
  • [MAINTENANCE] Use checkoutV3 (#8777)
  • [MAINTENANCE] Expectations typings (#8784)
  • [MAINTENANCE] Removing gallery parameter parse_strings_as_datetimes (#8786)
  • [MAINTENANCE] Prevent block-style datasource creation with Cloud-backed contexts (#8791)
  • [MAINTENANCE] Raise error if constructing FDS with individual args through base context API (#8792)
  • [MAINTENANCE] Remove SimpleCheckpoint from public API docs (#8770)
  • [MAINTENANCE] disallow-untyped-decorators (#8788)
  • [CONTRIB] Set merge_queue in CI pipeline and turn off auto-update (#8730)
  • [CONTRIB] Update notify_on_failure to not run on merge_group events (#8768)
  • [CONTRIB] Adding simple tests for CloudDataStore add_expectation_suite (#8743)
  • [CONTRIB] Adding tests for S3 Validation and Expectation Store prefix (#8761)

0.17.20 - YANKED​

0.17.19​

  • [FEATURE] Microsoft FabricPowerBIDatasource (#8605)
  • [BUGFIX] Ensure renderers use parent class renderers instead of using non-implemented override methods (#8745)
  • [BUGFIX] Column Descriptive Metrics: Support numpy metrics (#8746)
  • [BUGFIX] Column Descriptive Metrics: Add id to excluded list (#8750)
  • [DOCS] Update README.md to include newsletter and a typo fix. (#8721)
  • [MAINTENANCE] Improve test coverage around GXCloudStoreBackend.gx_cloud_response_json_to_object_dict (#8744)
  • [MAINTENANCE] Improve DatasourceDict performance (#8711)

0.17.18​

  • [BUGFIX] Patch faulty GXCloudStoreBackend.has_key logic (#8741)
  • [MAINTENANCE] Additional examples of row_condition for Spark and SQL (#8713)
  • [MAINTENANCE] ruff .0.290 (#8726)

0.17.17​

  • [BUGFIX] Resolve issue around listing keys with empty state in GXCloudStoreBackend (#8728)
  • [DOCS] Clarify How to Use Custom Expectations Without a Filesystem (#8700)
  • [DOCS] Update Result Format Topic (#8674)

0.17.16​

  • [FEATURE] update data assistant run to take in validator (#8560)
  • [FEATURE] Add DataAssetStore (#8601)
  • [BUGFIX] Missing DataFrame for in-memory Data Assets using GX Cloud (#8682)
  • [BUGFIX] Fix FDS auto-complete for Conda installs (#8698)
  • [BUGFIX] Assets with persisted data don't get added to in-memory cache (#8699)
  • [BUGFIX] Use one inspector for the same engine/execution_engine (#8534)
  • [BUGFIX] add try except to redshift regexp resolver (#8707) (thanks @itaise)
  • [BUGFIX] Patch docs_integration tests failures resulting from context root dir rename (#8720)
  • [BUGFIX] Snowflake column name case sensitivity (#8719)
  • [DOCS] Relocate Use Great Expectations with Google Cloud Platform and BigQuery (#8696)
  • [MAINTENANCE] only build-docs on doc-changes (#8685)
  • [MAINTENANCE] Azure Blob Stores TupleStoreBackend now supports credential string (#8683)
  • [MAINTENANCE] Column Descriptive Metrics: Add column types metric (#8687)
  • [MAINTENANCE] Column Descriptive Metrics: Add Null Count (#8692)
  • [MAINTENANCE] Bump gitpython from 3.1.33 to 3.1.35 in /docs_rtd (#8686)
  • [MAINTENANCE] Comprehensive SQL column identifier tests (#8673)
  • [MAINTENANCE] Add test case for trino datatypes in onboarding assitant (#8507)
  • [MAINTENANCE] Add get_all method to Store and StoreBackend APIs (#8702)
  • [MAINTENANCE] Change default context root to gx/ over great_expectations/ (#8423)
  • [MAINTENANCE] Parameterize severity in PagerdutyAction (#8714) (thanks @Sonchaegeon)
  • [MAINTENANCE] Column Descriptive Metrics: Make the retriever more resilient to metric failures (#8712)

0.17.15​

  • [BUGFIX] Databricks tests skipped for Forks (#8662)
  • [BUGFIX] Fix backslashes in url path under Windows (#8663) (thanks @MarcelBeining)
  • [BUGFIX] Fix validation for QueryAsset with create_temp_table: False (#8611) (thanks @moatazelmohtaseb)
  • [DOCS] Remove .py suffix from URL for module pages (#8649)
  • [DOCS] Add redirects for module API docs (#8665)
  • [DOCS] Fix Orphaned Pages in Prerequisites Blocks (#8666)
  • [MAINTENANCE] Column Descriptive Metrics: Implement cloud data store (#8656)
  • [MAINTENANCE] Update team members (#8654)
  • [MAINTENANCE] Update GitPython (#8661)
  • [MAINTENANCE] Column Descriptive Metrics: Return id from Data Store (#8667)
  • [MAINTENANCE] Column Descriptive Metrics: ColumnDescriptiveMetricsAction tests (#8668)
  • [MAINTENANCE] Column Descriptive Metrics: Add tests and cleanup (#8669)
  • [MAINTENANCE] Column Descriptive Metrics: Fix cloud data store - use pydantic (#8677)
  • [MAINTENANCE] Run doc-checks on every PR. (#8678)
  • [MAINTENANCE] Column Descriptive Metrics - Additional Table and Column Metrics (#8679)
  • [MAINTENANCE] Column Descriptive Metrics: Additional metrics mean median (#8680)
  • [MAINTENANCE] Pydantic 2.0 support (#8604)
  • [CONTRIB] fixing null eq safe for SQLAlchemy and rendering (#8617) (thanks @karthigaiselvanm)

0.17.14​

  • [BUGFIX] Use correct syntax for creating temporary views for DatabricksSQL datasources (#8655)
  • [BUGFIX] Missing CloudDataContext when loading from config (#8659)
  • [BUGFIX] Raise warning if data_connector cannot be built on config load (#8658)
  • [DOCS] Add New Topic for Identifying Failed Table Rows (#8554)
  • [DOCS] Update Request Data from a Data Asset (#8642)
  • [MAINTENANCE] typing - expect_column - to_exist and to_not_be_null (#8652)
  • [MAINTENANCE] Column Descriptive Metrics: Synchronize domain models (#8648)
  • [MAINTENANCE] Column Descriptive Metrics: Add test for MetricRepository (#8650)

0.17.13​

  • [FEATURE] Scripts for Identify Failed Rows (ID/PK) Doc (#8606)
  • [FEATURE] Ensure FDS asset gets updated with new cloud id on add (#8610)
  • [BUGFIX] Fix bug in Query template values metric when it gets int values (#8614)
  • [BUGFIX] Fix bad checkpoint runtime config merge (#8626)
  • [BUGFIX] Ensure that oss_id updates conf file rather than overwriting (#8634)
  • [BUGFIX] Ensure cloud tests don't run for public Forks (#8627)
  • [BUGFIX] Query Compatibility With Trino (#8600) (thanks @HadasManor)
  • [BUGFIX] Always run docs-snippets action on release tag. (#8651)
  • [DOCS] Remove Unused Topics and Update YAML Examples (#8581)
  • [DOCS] Add Limit Validation Results in Data Docs Topic (#8571)
  • [DOCS] Fix Quickstart typo (#8625)
  • [DOCS] Quick Fix (#8628)
  • [DOCS] Remove Instances of SimpleCheckpoint in snippets (#8622)
  • [DOCS] Update Connect to SQL database source data (#8635)
  • [DOCS] Remove Instances of SimpleCheckpoint (#8565)
  • [DOCS] add @public_api to PandasDatasource methods and assets (#8620)
  • [MAINTENANCE] Update Docusaurus to 2.4.1 and ensure Algolia search works (#8549)
  • [MAINTENANCE] add py311 min versions tests (#8621)
  • [MAINTENANCE] Move get_context out of utils (#8623)
  • [MAINTENANCE] Remove reference to CLI in generated GX YAML (#8624)
  • [MAINTENANCE] enable RUF rules (#8561)
  • [MAINTENANCE] Fix Azure CI packaging step (#8629)
  • [MAINTENANCE] Ignore pandas warning emitted through altair codepath (#8641)
  • [MAINTENANCE] Delete ExpectationExplorer (#8643)
  • [MAINTENANCE] Kill datasource cache in non-Cloud envs (#8608)
  • [MAINTENANCE] databricks_sql integration tests (#8563)
  • [MAINTENANCE] Fix or ignore warnings appearing in python 3.11 (#8645)
  • [MAINTENANCE] Remove deprecated sqlalchemy-databricks connector (#8644)
  • [MAINTENANCE] Add ruff rule to disallow use of os.environ outside of config files (#8588)
  • [MAINTENANCE] metrics typing (#8633)
  • [MAINTENANCE] Delete misc batch kwarg generators (#8640)

0.17.12​

  • [FEATURE] Use the explicit column delimiters if passed in by user. (#8459)
  • [FEATURE] ID/PK - Update Jupyter Notebooks for FDS (#8580)
  • [BUGFIX] Fix incorrect type of SqlAlchemyExecutionEngine constructor's arg (#8487) (thanks @YoitoFes)
  • [BUGFIX] Fix faulty logic around writing to .gitignore in context root dir (#8597)
  • [BUGFIX] Update Docs test after DataContext Deprecation (#8599)
  • [BUGFIX] Fix DraftDatasourceConfigAction connection string substitution (#8613)
  • [DOCS] Update Data Assistant and Edit an Expectation Suite Topics (#8564)
  • [MAINTENANCE] Delete deprecated get_batch (#8574)
  • [MAINTENANCE] Delete deprecated add_batch_kwargs_generator (#8573)
  • [MAINTENANCE] Add typing stubs to requirements-types.txt (#8501)
  • [MAINTENANCE] mypy 1.5 (#8586)
  • [MAINTENANCE] Enable explicit-override mypy rule (#8589)
  • [MAINTENANCE] Consistently use datasources property on context (#8596)
  • [MAINTENANCE] Deprecate BaseDataContext and DataContext (#8584)
  • [MAINTENANCE] Update metrics data model to use generic value type (#8575)
  • [MAINTENANCE] Update the CTA in the Data Docs footer (#8603)
  • [MAINTENANCE] Clean-up: Renaming "self-initializing" to "auto-initializing" (#8609)
  • [MAINTENANCE] Adding support for project_root_dir to get_context (#8388)
  • [MAINTENANCE] Simplify CI YAML conditional for 0.17.12 release (#8612)
  • [MAINTENANCE] Add mode param to get_context (#8593)

0.17.11​

  • [FEATURE] Make SQLDatasource.assets field a tagged-union (#8532)
  • [BUGFIX] DatabricksSQL TableAsset quoted identifiers (#8523)
  • [BUGFIX] Fixed persist to be considered for spark fluent datasource (#8512) (thanks @jmcorreia)
  • [BUGFIX] Revert Docusaurus to 2.0.0-beta21 (#8546)
  • [BUGFIX] add_splitter_on_column_value (#8498)
  • [BUGFIX] Fix persist is not being reflected for Spark Legacy Datasource (#8544) (thanks @jmcorreia)
  • [BUGFIX] Snowflake column identifiers (#8526)
  • [BUGFIX] Use a randomized schema name when running snowflake tests to support concurrency (#8559)
  • [BUGFIX] Skip Snowflake FDS tests for User Forks (#8567)
  • [BUGFIX] Fix Agent error types (#8558)
  • [BUGFIX] Query Template not always String (#8570)
  • [BUGFIX] Fix link update for versioned docs when there are multiple links on the same line (#8568)
  • [DOCS] Update URL to blog post for anonymous stats (#7014)
  • [DOCS] Updates Quickstart guide (#8321)
  • [DOCS] Relocate Compare Two Tables with the Onboarding Data Assistant (#8539)
  • [DOCS] Update to exact_match parameter: expect_table_columns_to_match_set (#8521) (thanks @calvingdu)
  • [DOCS] Update Spark Code Examples in Connect to In-memory Source Data (#8520)
  • [DOCS] Update MetricProviders Conceptual Topic (#8538)
  • [MAINTENANCE] Retire docs-integration tests that are already running in GitHub Actions (#8525)
  • [MAINTENANCE] Remove Cross-Table comparison from Docs-Integration, which is already being run (#8531)
  • [MAINTENANCE] Github Actions - Better handling of tests that cannot be run in Forks (#8530)
  • [MAINTENANCE] Fix marker key (#8541)
  • [MAINTENANCE] Fix conditional in CI (#8542)
  • [MAINTENANCE] Ignore distutils warning (#8543)
  • [MAINTENANCE] Bump gitpython from 3.1.30 to 3.1.32 in /docs_rtd (#8540)
  • [MAINTENANCE] Fix docs-snippets ci job (#8545)
  • [MAINTENANCE] Update Docusaurus to 2.4.1 (#8508)
  • [MAINTENANCE] ruff 0.0.282 (#8505)
  • [MAINTENANCE] Add concurrency criteria to Github Actions CI/CD (#8550)
  • [MAINTENANCE] Update docs snippets stage in ci.yml for scheduled and triggered runs (#8547)
  • [MAINTENANCE] Bump tornado from 6.3.2 to 6.3.3 in /docs_rtd (#8551)
  • [MAINTENANCE] ruff 0.0.284 (#8552)
  • [MAINTENANCE] Allow duplicate keys in checkpoint configuration with the same values (#8555)
  • [MAINTENANCE] airflow220-min-versions (#8557)
  • [CONTRIB] Updating Special Characters Expectation (#8382) (thanks @calvingdu)
  • [CONTRIB] expect_multicolumn_values_to_be_equal (#8553) (thanks @karthigaiselvanm)
  • [CONTRIB] fix query template values metric (#8562) (thanks @itaise)

0.17.9​

  • [BUGFIX] PR title checker's code should handle apostrophes (#8513)
  • [BUGFIX] Patch add_or_update_expectation_suite with Cloud-backed contexts (#8522)
  • [DOCS] Update Code Example for Viewing a Full Checkpoint Configuration (#8492)
  • [DOCS] Add New Topic for Connecting to In-Memory Source Data Using Spark (#8445)
  • [DOCS] Remove Unused Documentation Style Guide Topic (#8496)
  • [DOCS] Update Links and Content in the Data Context Topic (#8489)
  • [DOCS] Update Connect to filesystem source data (#8483)
  • [DOCS] Add step to install azure-storage-blob when using azure storage blobs… (#8156)
  • [DOCS] add python version badge to README (#7040)
  • [DOCS] standardizes references to supported Python versions (#8474)
  • [MAINTENANCE] Remove core team attributions from changelog (#8493)
  • [MAINTENANCE] Remove azure-pipeline.yml after migrating to Github Actions (#8494)
  • [MAINTENANCE] Notify on build-n-publish failure. (#8495)
  • [MAINTENANCE] Send slack notification on release (#8497)
  • [MAINTENANCE] Removed unused github action. (#8499)
  • [MAINTENANCE] Change default testing level from WARNING to INFO (#8506)
  • [MAINTENANCE] Flaky decorator added for docs-integration tests that access Cloud resources (#8510)
  • [MAINTENANCE] Mob typing: update list of deprecated, never to be typed files. (#8514)
  • [MAINTENANCE] Better testing for FDS quoted identifier logic (#8509)
  • [MAINTENANCE] Remove Click upper bound constraint. (#8515)
  • [MAINTENANCE] Docs Pipeline Clean up (#8468)
  • [MAINTENANCE] Update flaky test (#8527)

0.17.8​

  • [FEATURE] Add Agent action to list table names in SQL Datasources (#8177)
  • [FEATURE] Add Test Draft Config Workflow to Agent (#8410)
  • [FEATURE] add run checkpoint action to agent (#8449)
  • [FEATURE] DataAssistantResult should include exceptions from rules (#8429)
  • [BUGFIX] Cleanup aws_postgres reference environment (#8439)
  • [BUGFIX] Use consistent name between compose and cli command (#8440)
  • [BUGFIX] Scaffolding .gitignore should not require writeable file system (#8362) (thanks @ivanstillfront)
  • [BUGFIX] Remove unused, overwritten pytest marker. (#8441)
  • [BUGFIX] get_validator throws AttributeError: 'CloudDataContext' object has no attribute 'ge_cloud_mode' (#8433)
  • [BUGFIX] PP-282: fixing update_datasource method bug (#8464)
  • [BUGFIX] Add performance marker to pyproject.toml (#8480)
  • [BUGFIX] Fix Postgres, Trino quoted identifier issues (#8442)
  • [DOCS] Correct Typo (#8451)
  • [DOCS] Admonition and Landing Page Updates (#8432)
  • [DOCS] Remove Expectation Implementations by Backend Topic (#8437)
  • [DOCS] Source Data and Datasource Format Update (#8435)
  • [DOCS] Update the API Reference Landing Page (#8472)
  • [DOCS] Fix Grid Autosizing (#8475)
  • [DOCS] Update Use Great Expectations with Amazon Web Services using Athena (#8406)
  • [DOCS] Fixed typos in Execution Engine glossary entry (#8086)
  • [DOCS] add public_api decorator to TableAsset and QueryAsset (#8470)
  • [MAINTENANCE] Default snippet-check to non verbose mode (#8448)
  • [MAINTENANCE] Move test_dependency_versions to github actions (#8427)
  • [MAINTENANCE] Add pytest-xdist and use by default. (#8436)
  • [MAINTENANCE] Add sleep to allow services to come up before we run tests (#8454)
  • [MAINTENANCE] add test services for mssql, mysql, and trino (#8447)
  • [MAINTENANCE] Removed sqlalchemy_version_compatibility from required test markers. (#8456)
  • [MAINTENANCE] Linting for previously excluded cli, expectations and rule_based_profiler tests (#8422)
  • [MAINTENANCE] Run cloud e2e tests. (#8443)
  • [MAINTENANCE] Start testing clickhouse in github actions. (#8452)
  • [MAINTENANCE] Github Actions - Spark tests (#8460)
  • [MAINTENANCE] Remove external_sqldialect marker as test coverage marker. (#8458)
  • [MAINTENANCE] Pytest Github Action - BigQuery and Postgres (#8417)
  • [MAINTENANCE] Run marker-tests after unit-tests and static-analysis (#8465)
  • [MAINTENANCE] Run all_backend tests along with specific service tests. (#8467)
  • [MAINTENANCE] AWS Glue script using Context Manager to catch FutureWarning (#8466)
  • [MAINTENANCE] Remove old required tests which have been replaced. (#8462)
  • [MAINTENANCE] Run all python versions on scheduled run (#8463)
  • [MAINTENANCE] min-versions wait for unit-tests, static-analysis (#8471)
  • [MAINTENANCE] Remove Azure Dev CI steps (#8473)
  • [MAINTENANCE] Enable B009 Bugbear get-attr-with-constant rule (#8434)
  • [MAINTENANCE] Update ListTableNamesAction to use GxAgentEnvVars (#8450)
  • [MAINTENANCE] Add check that each test only has one required marker. (#8477)
  • [MAINTENANCE] Add test case for run_name_template using env_var (#8461)
  • [MAINTENANCE] Delete azure-pipelines-dev.yml (#8476)
  • [MAINTENANCE] Test out releaser github action (#8478)
  • [MAINTENANCE] Add missing marker to pyproject.toml (#8481)
  • [MAINTENANCE] Slack notifications if non-pr ci github action pipeline fails (#8485)
  • [MAINTENANCE] Run additional matrix steps on any non-pull_request event (#8486)
  • [MAINTENANCE] GX-Release Process update to use GitHub Actions (#8484)

0.17.7​

  • [FEATURE] Add Agent support for Missingness Data Assistant (#8336)
  • [FEATURE] Allow a rule to fail within DataAssistant and still run other rules (#8393)
  • [BUGFIX] fixing minor bug in sqlalchemy_execution_engine.py (#8374) (thanks @SaeedFarahani)
  • [BUGFIX] ensure_json_serializable accounts for pydantic.BaseModel (#8431)
  • [BUGFIX] Table.head() follow-up for Python versions (#8426)
  • [DOCS] Update docs on expectation docstrings (#8405)
  • [DOCS] corrects default value for result_format in documentation (#8419)
  • [DOCS] Remove Custom Expectations Overview Topic (#8391)
  • [DOCS] Update contributing code readme with required markers information. (#8414)
  • [DOCS] Fix markdown link in install_gx.md (#8416) (thanks @jmorakuebler)
  • [DOCS] Docs TOC Reorg (#8421)
  • [DOCS] Fix snippet reference in how_to_use_great_expectations_with_sql.md (#8430) (thanks @jmorakuebler)
  • [MAINTENANCE] Experimental column descriptive metrics repository (#8335)
  • [MAINTENANCE] Mark remaining datasource tests. (#8399)
  • [MAINTENANCE] Pytest Mark - Metrics Folder (#8400)
  • [MAINTENANCE] Add marks to missing expectations tests. (#8401)
  • [MAINTENANCE] Add test for marker coverage and remove integration marker. (#8394)
  • [MAINTENANCE] Add ci test for test marker coverage (#8402)
  • [MAINTENANCE] mypy 1.4.1 (#8226)
  • [MAINTENANCE] snowflake regex (#8403)
  • [MAINTENANCE] Resolve misc typing issues in metrics code (#8411)
  • [MAINTENANCE] Bump certifi from 2022.12.7 to 2023.7.22 in /docs_rtd (#8415)
  • [MAINTENANCE] conditional snowflake-connector-python version bump (#8412)
  • [MAINTENANCE] Refactor Table.head() for sqlalchemy (#8234)
  • [MAINTENANCE] List required markers when verify marker test fails. (#8413)
  • [MAINTENANCE] Bump version of autoupdate GH action (#8425)
  • [MAINTENANCE] Bump Ubuntu version in autoupdate GH action (#8428)
  • [MAINTENANCE] Update error message around context.add_checkpoint when neither name nor checkpoint are provided (#8313)
  • [MAINTENANCE] move Azure docs and public API steps to Github Actions (#8408)
  • [MAINTENANCE] Use constants for GX directory and YAML references (#8420)
  • [MAINTENANCE] Clean up Databricks SQL FDS impl and docs (#8424)
  • [CONTRIB] Pyspark Implementation for expect_column_values_to_be_valid_currency_code (#8418) (thanks @calvingdu)
  • [CONTRIB] Adding docs for missingness data assistant (#8379)

0.17.6​

  • [FEATURE] Register MissingnessDataAssistant (#8337)
  • [BUGFIX] Ensure that Fluent Datasources support database table names in lowercase for Oracle, DB2, and Snowflake (#8327)
  • [BUGFIX] Ensure that GX supports database column names in lowercase and mixcase for Oracle, DB2, and Snowflake (#8345)
  • [BUGFIX] Handle ValueError in agent action (#8369)
  • [BUGFIX] Ensure that SQLAlchemy is installed for SQL Data Source and TableAsset Fluent Data Source Module (#8361)
  • [BUGFIX] DataAssistantResult should not error on get_expectation_suite without name (#8370)
  • [BUGFIX] Exclude appropriate SnowflakeDatasource fields when creating an execution engine (#8371)
  • [DOCS] Improvements on how_to_edit_expectationsuite guide (#8096) (thanks @Ismar11)
  • [DOCS] Update Slack Link to Point to Discourse (#7840)
  • [DOCS] Adds a consolidated overview of using GX as a conceptual guide (#8045)
  • [DOCS] Updated the Execution Engine terms page (#8309)
  • [DOCS] Add docs around Snowflake FDS (#8340)
  • [DOCS] Update link in Data Asset Glossary Topic (#8349)
  • [DOCS] updated docs to remove SimpleCheckpoint (#8352)
  • [DOCS] Remove Outdated SQLAlchemy 2.0 Admonitions (#8357)
  • [DOCS] Update Links to Get started with Great Expectations and Databricks (#8350)
  • [DOCS] Add MetricProviders Conceptual Content (#8175)
  • [DOCS] Add Information for Adding Custom Parameters to Custom Expectations (#8172)
  • [DOCS] Remove index.md Files and Add Redirects (#8332)
  • [MAINTENANCE] Remove trace_docs_deps script in CI (#8305)
  • [MAINTENANCE] GH Actions pytest marker test matrix (#8277)
  • [MAINTENANCE] Pytest Mark - Render folder (#8301)
  • [MAINTENANCE] Fix docs pipeline check changes (#8315)
  • [MAINTENANCE] Add test markers to tests/datasource/fluent/XXX/X.py (#8316)
  • [MAINTENANCE] Pytest Mark - Profiling (#8318)
  • [MAINTENANCE] invoke deps task (#8311)
  • [MAINTENANCE] Fix requirements and CONTRIBUTING_CODE doc (#8312)
  • [MAINTENANCE] gitignore for GCP credentials (#8323)
  • [MAINTENANCE] Pytest Mark - DataContext Part 2 (#8317)
  • [MAINTENANCE] Pytest Mark - ExecutionEngine (#8324)
  • [MAINTENANCE] Pytest Mark - Integration and Expectations (#8319)
  • [MAINTENANCE] Minimum version of numpy bumped to 1.20.3 (#8326)
  • [MAINTENANCE] Disable Airflow provider tests in CI due to external test failures (#8342)
  • [MAINTENANCE] Bump minimum version of numpy==1.21.6 for Python 3.9 (#8341)
  • [MAINTENANCE] Update algolia index (#8273)
  • [MAINTENANCE] Pytest Mark - DataConnector (#8338)
  • [MAINTENANCE] Replace many repetitive slow integration tests for ParameterBuilder components with a few fast unit tests (#8302)
  • [MAINTENANCE] Finish marking fluent datasource tests. (#8347)
  • [MAINTENANCE] Bump word-wrap from 1.2.3 to 1.2.4 in /docs/docusaurus (#8346)
  • [MAINTENANCE] Add test markers to datasource/batch_kwarg_generator tests. (#8348)
  • [MAINTENANCE] Re-mark slow tests. (#8356)
  • [MAINTENANCE] Update standard node package (#8339)
  • [MAINTENANCE] Making tests for column names insensitivity for Oracle, DB2, and Snowflake easier to read (#8358)
  • [MAINTENANCE] Add detect-private-key pre-commit hook (#8363)
  • [MAINTENANCE] Pytest Mark - Top-level test/ (#8359)
  • [MAINTENANCE] Unpin upper bound on Click dependency (#8360)
  • [MAINTENANCE] Revert Click pin removal (#8367)
  • [MAINTENANCE] Bump pygments from 2.7.4 to 2.15.0 in /docs_rtd (#8368)
  • [MAINTENANCE] Fix non-AssertErrors for Expectations during build-gallery process (#8353)
  • [MAINTENANCE] Mark datasource top level tests (#8365)
  • [MAINTENANCE] add invoke ci-tests and invoke service (#8322)
  • [CONTRIB] Create custom expectation for Chi Square Test (#8314)
  • [CONTRIB] Contributed expect_column_to_have_no_months_missing (#8307) (thanks @HadasManor)
  • [CONTRIB] Add KS test custom expectation (#8344)

0.17.5​

  • [FEATURE] Airflow reference environment (#8257)
  • [FEATURE] Missingness DataAssistant initial implementation (#8268)
  • [FEATURE] DatabricksSQL FDS (#8184)
  • [FEATURE] single batch missingness data assistant (#8278)
  • [DOCS] Replaces outdated integration guides with redirects to versioned documentation (#8173)
  • [MAINTENANCE] Remove unreferenced docs integration tests (#8228)
  • [MAINTENANCE] Remove duplicate custom checks in PR pipeline (#8265)
  • [MAINTENANCE] Use updated search api key (#8269)
  • [MAINTENANCE] DataAssistantDispatcher should not reach into DataAssistant (#8262)
  • [MAINTENANCE] GH action static analysis and unittest setup (#8272)
  • [MAINTENANCE] remove algolia index action (#8264)
  • [MAINTENANCE] Bump semver from 5.7.1 to 5.7.2 (#8274)
  • [MAINTENANCE] Improvement to contributor documentation (#8043) (thanks @christian-bromann)
  • [MAINTENANCE] Implement unit tests for BatchFilter.parse_batch_slice logic (#8280)
  • [MAINTENANCE] Run GH Action CI job every 3 hours (#8281)
  • [MAINTENANCE] Ensure all tests in tests/checkpoint are marked (#8282)
  • [MAINTENANCE] Pytest Mark - Validator and utils (#8275)
  • [MAINTENANCE] Add marker cli to all cli tests. (#8286)
  • [MAINTENANCE] Reduce maximum allowed unittest duration (#8283)
  • [MAINTENANCE] Add tests for Batch slicing for SparkFilePathDatasource (#8285)
  • [MAINTENANCE] Pytest Mark - RuleBasedProfiler and others (#8288)
  • [MAINTENANCE] Pin jsonschema (#8290)
  • [MAINTENANCE] Remove two slow DataAssistant integration tests (#8287)
  • [MAINTENANCE] Add data docs container to airflow env (#8284)
  • [MAINTENANCE] xfail Cloud E2E test (#8292)
  • [MAINTENANCE] Remove --verbose pytest default (#8298)
  • [MAINTENANCE] Update marker on slow test from unit to filesystem. (#8296)
  • [MAINTENANCE] Typing Improvements - render/util (#8279)
  • [MAINTENANCE] Add pytest marks to tests/actions (#8299)
  • [MAINTENANCE] Mark tests in tests/core/usage_statistics (#8295)
  • [MAINTENANCE] Mark tests in /tests/data_asset (#8300)
  • [MAINTENANCE] Add markers to tests/core (#8297)
  • [MAINTENANCE] Apply pytest markers to root dir tests/data_context tests (#8293)
  • [MAINTENANCE] Run Github ci action on push (#8303)
  • [MAINTENANCE] Dont use check_for_docs_deps_changes (#8304)
  • [MAINTENANCE] Increase timeout for flaky tests (#8306)

0.17.4​

  • [MAINTENANCE] Protect develop with no-commit-to-branch pre-commit hook (#8254)
  • [MAINTENANCE] Change Pydantic models to utilize by_alias=True (#8252)
  • [MAINTENANCE] Support individual connection args for Snowflake FDS (#8183)
  • [MAINTENANCE] Replace dynamic datasource deletion with single delete method (#8189)
  • [MAINTENANCE] Disable usage statistics when in Cloud-backed environments (#8248)

0.17.3​

  • [FEATURE] Examples of using different store backends in reference environments (#8211)
  • [FEATURE] Add checker to ensure snippets are being used (#8178)
  • [FEATURE] Host data docs for the postgres reference environment (#8221)
  • [FEATURE] Add checker to ensure test files have fixture definition (#8186)
  • [FEATURE] make backend_dependencies required and not optional for doc integration tests (#8216)
  • [FEATURE] View data docs inside snowflake and bigquery reference environments (#8231)
  • [FEATURE] Reference Environment - AWS RDS (#8222)
  • [BUGFIX] Fix yarn install and condition on CI pipeline (#8217)
  • [BUGFIX] Ensure DataAssistantResult.plot_expectations_and_metrics does not raise exceptions when no Metrics or Expectations are available to plot (#8238)
  • [DOCS] update result_format configuration documentation (#8209)
  • [DOCS] Update Install GX (#8206)
  • [DOCS] minor updates to the readme files (#8245)
  • [MAINTENANCE] Arranging call arguments to build_batch_request() utility method to be in consistent order (#8224)
  • [MAINTENANCE] Use python static file server (#8229)
  • [MAINTENANCE] Fix race condition in integration tests using context manager (#8223)
  • [MAINTENANCE] Remove a line ignoring warnings about iteritems (#8227)
  • [MAINTENANCE] Correcting typographical error in test method naming. (#8233)
  • [MAINTENANCE] Reference environment consistency - installed version (#8237)
  • [MAINTENANCE] Reference environment consistency - unpin python version (#8239)
  • [MAINTENANCE] Use data docs container for cloud blob stores (#8240)
  • [MAINTENANCE] Reference Environments: Match the new quickstart (#8242)
  • [MAINTENANCE] Reference Environment - AWS Credentials Clean up (#8230)
  • [MAINTENANCE] Filter altair/jsonschema Deprecation warning (#8244)
  • [MAINTENANCE] Filter jsonschema.RefResolver, ErrorTree warnings in tests (#8246)
  • [MAINTENANCE] Temporarily upper bound Click due to mypy typing issues (#8247)
  • [MAINTENANCE] Update test_deprecation.py in advance of 0.17.3 release (#8251)
  • [MAINTENANCE] enable typechecking in validator.py (#8204)
  • [MAINTENANCE] Refactor validations in Checkpoint to use CheckpointValidationConfig (#8225)

0.17.2​

  • [FEATURE] AWS S3 reference environment (#8166)
  • [FEATURE] Snowflake FDS (#8157)
  • [FEATURE] Fix Bigquery/GCS integration tests (#8149)
  • [FEATURE] Python 3.11 support (#8174)
  • [FEATURE] Fix azure docs tests (#8171)
  • [FEATURE] Reference Environment - BigQuery (#8176)
  • [FEATURE] Reference Environment - Google Cloud Storage (#8197)
  • [FEATURE] Enable updating active stores and CRUD for data docs sites (#8194)
  • [FEATURE] Use PythonScript task type for custom docs ci checks (#8208)
  • [FEATURE] Reference Environment: Azure Blob Storage (#8212)
  • [FEATURE] ExpectDaySumToBeCloseToEquivalentWeekDayMean: User can give weeks_back as argument (#8139) (thanks @HadasManor)
  • [BUGFIX] Allow for create_temp_table to be False when creating a SqlAlchemyBatchData object (#8160)
  • [BUGFIX] Raise more informative error on failure of getting an expectation suite by name (#8170)
  • [BUGFIX] Enable Pandas Column Aggregate Metrics To Support Decimal Numeric Types (#8195)
  • [BUGFIX] Relax numpy version requirements for python 3.10 (#8199)
  • [BUGFIX] Patch additional pytest.deprecated_call around adding datasource with Cloud (#8219)
  • [BUGFIX] Fix yarn install and condition on CI pipeline (#8217)
  • [DOCS] Create New Landing Pages (#7993)
  • [DOCS] Add table listing supported evaluation parameter expressions to the docs (#8124)
  • [DOCS] Reorganize Checkpoint Section (#8182)
  • [DOCS] Getting Started with GX (#8143)
  • [DOCS] Sidebar updates for Getting Started (#8196)
  • [DOCS] Get Started Section Revisions (#8202)
  • [DOCS] Remove Connect to a source data system from TOC (#8193)
  • [MAINTENANCE] Raise error on unsupported versions of python. (#8158)
  • [MAINTENANCE] Reference Environment - Update Snowflake Notebook to Specify Python 3.10 (#8167)
  • [MAINTENANCE] Refactor reference environment CLI for consistency (#8169)
  • [MAINTENANCE] DX-565 remove allow_cross_type_comparison from column_pair_values.a_greater_than_b (#8025)
  • [MAINTENANCE] Python 3.11 SQLAlchemy import time fix (#8180)
  • [MAINTENANCE] Rich comments and docstrings for DataAssistant related modules. (#8185)
  • [MAINTENANCE] Fix Python 3.11 Docker excessive pip backtracking (#8187)
  • [MAINTENANCE] Start cleaning up outdated deprecation warnings (#8135)
  • [MAINTENANCE] Replace Non-Existent Expectation Name With Correct Existing Expectation Name (#8191)
  • [MAINTENANCE] Deal with Python 3.11 deprecations (#8192)
  • [MAINTENANCE] Placing S3, Trino Imports Under Compatibility Pattern (#8198)
  • [MAINTENANCE] Deprecate adding legacy datasources in Cloud-backed environments (#8190)
  • [MAINTENANCE] Add pytest.deprecated_call to misc usages of add_datasource in tests (#8207)
  • [MAINTENANCE] Placing AWS RedShift Imports Under Compatibility Pattern (#8205)
  • [MAINTENANCE] Placing Snowflake Imports Under Compatibility Pattern (#8210)
  • [MAINTENANCE] Placing AWS Athena Imports Under Compatibility Pattern (#8213)
  • [MAINTENANCE] Update notebook link to non-legacy docs (#8215)
  • [MAINTENANCE] Placing BigQuery Imports Under Compatibility Pattern (#8214)
  • [MAINTENANCE] Fix Python 3.11 async expectations tests (#8203)

0.17.1​

  • [FEATURE] Fix spark docs tests (#8131)
  • [FEATURE] Reference Environment - Snowflake (#8148)
  • [FEATURE] Fluent Data Source ABS, GCS, and S3 recursive file discovery (#8118) (thanks @toivomattila)
  • [BUGFIX] Fix config substitution for substrings (#8145)
  • [BUGFIX] Fix 'great_expectations[cloud]' extra install (#8151)
  • [BUGFIX] Persist SQLDatasource splitters on creation (#8164)
  • [DOCS] Enable docs versioning for 0.16.16 (#8125)
  • [DOCS] Update set_based_column_map_expectation.py (#8142)
  • [DOCS] Fix broken links and reenable link checking (#8146)
  • [DOCS] Add version info to markdown links for earlier versions (#8155)
  • [MAINTENANCE] update location of link in data docs footer (#8130)
  • [MAINTENANCE] invoke show-automerges (#8127)
  • [MAINTENANCE] Lint assets dir (#8123)
  • [MAINTENANCE] test/integration linting (#8132)
  • [MAINTENANCE] minimal Anonymizer type-checking (#8106)
  • [MAINTENANCE] Use Available Enums Instead of Strings for Metric Name Extensions (#8137)
  • [MAINTENANCE] Add env var to avoid out of memory error when building docs (#8144)
  • [MAINTENANCE] Update single cloud onboarding script to use fluent datasources (#8114)
  • [MAINTENANCE] Add --bash command for postgres reference env (#8154)
  • [MAINTENANCE] Add default table_name to TableAsset if omitted (#8152)
  • [CONTRIB] expect_queried_column_pair_values_to_be_both_filled_or_null (#7949) (thanks @eden-o)

0.17.0​

  • [FEATURE] Agent prints stack trace on error (#8092)
  • [FEATURE] Clickhouse Integration (#7719) (thanks @Plozano94)
  • [FEATURE] Pandas 2.0.0 and Sqlalchemy 2.0.0 compatibility (#7633)
  • [FEATURE] Better pandas query (#8101)
  • [FEATURE] Add Pandas FWFAsset - fixed width file (#8119)
  • [BUGFIX] Fix conditional for pyspark compatibility (#8108)
  • [BUGFIX] respect result format bool only for validators and checkpoints (#8111)
  • [BUGFIX] Robust Handling Of Column Types And Empty DataFrames For DataBricks/Spark Environment (#8115)
  • [BUGFIX] Fix GXCloudStoreBackend updates by name (#8116)
  • [BUGFIX] Patch bad mock in GCS test (#8128)
  • [DOCS] Update Quickstart guide to be Cloud-compatible (#8036)
  • [DOCS] Temporarily hardcode quickstart snippet due to substitution error (#8091)
  • [DOCS] Update prefect gx tutorial (#8009) (thanks @discdiver)
  • [DOCS] Fix line breaks in quickstart (#8098)
  • [DOCS] Remove Remaining CLI Admonitions (#8070)
  • [DOCS] Remove examples of specifying a test_backends list of dicts (#7816)
  • [MAINTENANCE] Add tests for file and Cloud-backed quickstart workflows (#8037)
  • [MAINTENANCE] Update anonymous usage statistics payloads with hashed MAC address (#8078)
  • [MAINTENANCE] Check if PR is a fork in some docs_integration stages (#8090)
  • [MAINTENANCE] Update how_to_host_and_share_data_docs_on_gcs (#8067)
  • [MAINTENANCE] Add persistent OSS user identifier to anonymized usage statistics payloads (#8089)
  • [MAINTENANCE] Update MSSQL docker container and instructions for Apple Silicon Macs (#8093)
  • [MAINTENANCE] Remove hardcoded Data Source._EXCLUDED_EXEC_ENG_ARGS (#8100)
  • [MAINTENANCE] Update print_diagnostic_checklist (#8018)
  • [MAINTENANCE] Type hint cleanup in usage statistics (#8105)
  • [MAINTENANCE] remove unused noqa comments (#8107)
  • [MAINTENANCE] Remove the mysql-mac-m1 and starburst directories from assets/docker (#8104)
  • [MAINTENANCE] Typing Data Assistant Result (#8110)
  • [MAINTENANCE] Ensure that new usage statistics schema changes are backwards compatible (#8109)
  • [MAINTENANCE] Cleanup generate_expectation_tests (#8019)
  • [MAINTENANCE] Update build_in_memory_runtime_context to accept which datasources to include (#8017)
  • [MAINTENANCE] Pandas and SqlAlchemy 2.0 follow-up (#8112)
  • [MAINTENANCE] Misc/docs integration uncommented (#8076)
  • [MAINTENANCE] Fixes for test_dependency_versions pipeline (#8122)

0.16.16​

  • [FEATURE] Update mySQL docker compose to specify platform (#8046)
  • [FEATURE] Update GX Cloud on job status (#8047)
  • [FEATURE] DX-441 put how_to_connect_to_in_memory_data_using_pandas un… (#8057)
  • [BUGFIX] Set SQLALCHEMY_WARN_20 in Dockerfile (#7931)
  • [BUGFIX] Ensure CloudDataContext Add Checkpoint flow returns Checkpoint with cloud-updated values (#8062)
  • [BUGFIX] Erroneous Code Duplication and Lack of Type Hints in Expectation Parent Class (#8066)
  • [BUGFIX] Fix broken Cloud tests around Checkpoint (#8083)
  • [BUGFIX] fix issue-7954 (#7963) (thanks @jkingdon-ms)
  • [BUGFIX] Fix Update Checkpoint for Cloud (#8084)
  • [BUGFIX] Mock correct method in test (#8087)
  • [DOCS] Cloud - Getting started uses Fluent Datasources (#8035)
  • [DOCS] Update Links in How to use auto-initializing Expectations (#8054)
  • [DOCS] Update How to create Expectations Interactively in Python (#8052)
  • [DOCS] Add guidance for "DataFrameAsset.build_batch_request()" in "https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/fluent/in_memory/how_to_connect_to_in_memory_data_using_pandas". (#8069)
  • [DOCS] Update set_based_column_map_expectation_template.py (#8068)
  • [DOCS] Remove mention of CLI in evaluation_parameters terminology page. (#8075)
  • [MAINTENANCE] Ruff rule DTZ - prevent naive datetimes (#8050)
  • [MAINTENANCE] Pandas 1.5 schema updates (#8039)
  • [MAINTENANCE] Fix CI tests_schemas unit test (#8055)
  • [MAINTENANCE] Fix CI round 2 (#8056)
  • [MAINTENANCE] Minor stylistic clean up of "DataAssistant.build_metric_multi_batch_parameter_builder()" method usage (#8059)
  • [MAINTENANCE] Enable Ruff - pylint rules (#8058)
  • [MAINTENANCE] type-checking core/batch.py (#8024)
  • [MAINTENANCE] Improve code elegance and fix informational string (#8061)
  • [MAINTENANCE] Misc refactor of Store CRUD (#8064)
  • [MAINTENANCE] Fix pandas model schema differences across python versions (#8065)
  • [MAINTENANCE] Updating CLI messages to point to new docs (#8072)
  • [MAINTENANCE] Update GitHub templates for issues/PRs (#8073)
  • [MAINTENANCE] Update default action list in Checkpoint based on user environment (#8074)
  • [MAINTENANCE] Ruff 0.0.271 update (#8077)
  • [MAINTENANCE] Update PR template to reference invoke for linting (#8079)
  • [MAINTENANCE] Delete LegacyCheckpoint (#8082)
  • [MAINTENANCE] Add public_api to read_parquet (#8060)
  • [MAINTENANCE] Postgres starter reference environment (#8031)

0.16.15​

  • [FEATURE] Checker for correct Python code snippets in documentation. (#8000)
  • [FEATURE] Add scaffolding for gx-agent (#7837)
  • [FEATURE] Cloud - generate unique asset names for pandas_default assets (#8020)
  • [FEATURE] Connect to Cloud for agent config (#8006)
  • [FEATURE] Add AbstractDataContext.view_validation_result (#8033)
  • [FEATURE] Add Onboarding Data Assistant agent action (#7882)
  • [FEATURE] put 'How to connect to postgresql data' under test (#7988)
  • [BUGFIX] Remove perpetually failing test -- in preparation for release. (#8040)
  • [BUGFIX] meta_notes rendered inline can fail schema validation for a valid string-only configuration (#8044)
  • [BUGFIX] Ensure That DataFrame for Fluent Data Source Pandas/Spark DataFrame Data Assets is specified only in one API method (#8032)
  • [DOCS] Add Windows Support Admonition (#7991)
  • [DOCS] Update how_to_edit_an_existing_expectationsuite.md (#8007)
  • [DOCS] Adds redirects for removed UserConfigurableProfiler documentation (#8026)
  • [DOCS] Create New Expectation Classes Conceptual Guide (#8004)
  • [DOCS] Check simple spelling and word order error using ChatGPT-based program (#8029)
  • [DOCS] Update Quickstart to Reflect User Feedback (#8027)
  • [DOCS] Cloud - Getting started uses Fluent Datasources (#8035)
  • [MAINTENANCE] Update teams.yml (#8011)
  • [MAINTENANCE] Add sensible default values to Checkpoint APIs (#7992)
  • [MAINTENANCE] Removing xfails that we're added to get release out. (#8014)
  • [MAINTENANCE] Remove reference to Superconductive from CITATION.cff (#8016)
  • [MAINTENANCE] Deleting References to UserConfigurableProfiler Documentation (#7983)
  • [MAINTENANCE] mypy 1.3 + azure deps in type-checking step (#8012)
  • [MAINTENANCE] Bump tornado from 6.1.0 to 6.3.2 in /docs_rtd (#8003)
  • [MAINTENANCE] Add support for Validator in Checkpoint CRUD (#7999)
  • [MAINTENANCE] Remove unused .dockerignore (#8030)
  • [MAINTENANCE] Fluent Data Source Update: Credentials Doc update (#7968)
  • [MAINTENANCE] Persist connection for backends that need a connection to keep temporary tables alive (#7607)

0.16.14​

0.16.13​

  • [FEATURE] Spark file reader support for fluent datasources (#7844)
  • [FEATURE] Spark directory asset types (#7873)
  • [FEATURE] Add Spark DeltaAsset type (#7872)
  • [FEATURE] Add DirectoryDeltaAsset (#7877)
  • [FEATURE] Implementing Python code snippets under test for "https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/fluent/data_assets/how_to_organize_batches_in_a_file_based_data_asset" (#7907)
  • [FEATURE] Implementing Python code snippets under test for "https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/fluent/data_assets/how_to_organize_batches_in_a_sql_based_data_asset" (#7909)
  • [FEATURE] Implementing Python code snippets under test for "https://docs.greatexpectations.io/docs/guides/connecting_to_your_data/fluent/filesystem/how_to_connect_to_one_or_more_files_using_pandas" (#7922)
  • [FEATURE] DataProfilerStructuredDataAssistant Float Rule (#7842) (thanks @micdavis)
  • [BUGFIX] Fix inability to extend SimpleCheckpoint -- and several additional enhancements and clean up (#7879)
  • [BUGFIX] Delete ExpectationSuite by name in GX Cloud (#7881)
  • [BUGFIX] optional dataframe on datasources (#7862)
  • [BUGFIX] Fix sparkDF cannot compute mean for DecimalType (#7867)
  • [BUGFIX] Fix Cloud FDS add_or_update_* methods (#7908)
  • [BUGFIX] fix PandasAzureBlobStorageDatasource config substitution (#7914)
  • [BUGFIX] Fix remaining FDS config substitution issues (#7917)
  • [DOCS] removes remaining Block-config Data Source guides (#7870)
  • [DOCS] Update "How to use Great Expectations with Databricks" (#7762)
  • [DOCS] CLI Edits (#7865)
  • [DOCS] More doc updates to remove the CLI (#7874)
  • [DOCS] Create New Templates for How-To, Tutorial, Conceptual, and Reference Documentation (#7855)
  • [DOCS] Add Links to Tutorial Templates in the README (#7884)
  • [DOCS] removes block-config docs for source data systems in the cloud (#7871)
  • [DOCS] Continuing CLI Update (#7876)
  • [DOCS] Removes the SQL block config guides. (#7886)
  • [DOCS] Remove jq dependency for building docs (#7893)
  • [DOCS] Less verbose logging during docs build (#7894)
  • [DOCS] Corrections to Document "How to request data from a Data Asset" with proper FDS implementation and integration test. (#7896)
  • [DOCS] Remove or Modify References to the CLI (#7875)
  • [DOCS] Updated contribution docs (#7880)
  • [DOCS] Glossary Update (#7900)
  • [DOCS] Removes filesystem and core block config docs (#7913)
  • [DOCS] FDS Deployment Pattern Redshift (#7868)
  • [DOCS] Document and simplify local docs build (#7892)
  • [DOCS] How to Edit Existing ExpectationSuite (#7859)
  • [DOCS] CLI Clean-up (#7904)
  • [MAINTENANCE] FDS Documentation - Creating ExpectationSuite with Domain Knowledge (#7852)
  • [MAINTENANCE] Refactor directory data asset (#7878)
  • [MAINTENANCE] partial checkpoint type checking (#6914)
  • [MAINTENANCE] type-checking checkpoint/actions.py (#7899)
  • [MAINTENANCE] Trigger docs_integration on develop (#7902)
  • [MAINTENANCE] Finish type-checking checkpoint (#7901)
  • [MAINTENANCE] Update How to set up GX to work with data in Azure Blob Storage (#7910)
  • [MAINTENANCE] CloudDataContext ExpectationsStore can only request one Suite at a time (#7905)
  • [MAINTENANCE] Removing engine-specific tests that assert generic behavior (#7918)
  • [MAINTENANCE] Add docs/*.py to GXChanged for linting (#7924)
  • [MAINTENANCE] Fixes Glue tests on vanilla pytest (#7925)

0.16.12​

  • [FEATURE] Plumbing of validation_result_url from cloud response (#7809)
  • [FEATURE] Splitters work with Spark Fluent Datasources (#7832)
  • [FEATURE] Update get_context to scaffold project structure for file-backed usecases (#7693)
  • [BUGFIX] Azure Package Presence/Absence Tests Strengthening (#7818)
  • [BUGFIX] Handle "persist" directive in "SparkDFExecutionEngine" properly. (#7830)
  • [BUGFIX] Adding support for Fluent Batch Requests to context.get_validator (#7808)
  • [BUGFIX] FDS - Deletes not immediately reflected in great_expectations.yml (#7843)
  • [BUGFIX] batching_regex tags are now correctly rendered in docs (#7845)
  • [BUGFIX] Fix link checker and add to mypy type checking (#7857)
  • [BUGFIX] expect_day_count_to_be_close_to_equivalent_week_day_mean (#7782) (thanks @HadasManor)
  • [BUGFIX] Docs-Tests: Connection.connect() was causing Snowflake and BigQuery Tests to Fail (#7863)
  • [DOCS] Prerequisites Cleanup (#7811)
  • [DOCS] Update docs for how_to_initialize_a_filesystem_data_context_in_python (#7831)
  • [DOCS] Updating Checkpoint terms page (#7722)
  • [DOCS] Update how to create a checkpoint with Test YAML config (#7835)
  • [DOCS] Removing datasource centric test_yaml_config doc (#7836)
  • [DOCS] Creating a Checkpoint from an In-Memory Dataframe (#7701)
  • [DOCS] Review and Revise Great Expectations Quickstart (#7727)
  • [MAINTENANCE] FDS - Datasources can rebuild their own asset data_connectors (#7826)
  • [MAINTENANCE] Enable Spark-S3 Integration tests on Azure CI/CD (#7819)
  • [MAINTENANCE] Clean up: Remove duplicated fixture and utilize deeper filtering mechanism for configuration assertions. (#7825)
  • [MAINTENANCE] Enable S3/Spark Connecting To Your Data tests (#7828)
  • [MAINTENANCE] New PR template (#7710)
  • [MAINTENANCE] ruff .0.262 -> .0.265 (#7829)
  • [MAINTENANCE] Boto import pattern established (#7796)
  • [MAINTENANCE] Prevent TCH001 warnings for pydantic model annotations (#7846)
  • [MAINTENANCE] Pin altair (#7849)
  • [MAINTENANCE] Adding docs link checker to invoke (#7841)
  • [MAINTENANCE] Clean up version checker message formatting (#7838)
  • [MAINTENANCE] Bump nbconvert version (#7847)
  • [MAINTENANCE] Return empty set instead of None (#7797)
  • [MAINTENANCE] Improve misconfigured sampler error message (#7858)
  • [MAINTENANCE] Fixing path formatting for DataConnector of Fluent SparkAzureBlobStorageDatasource and correction of the SQLAlchemy compatibility usage in TableHead metric (#7860)
  • [MAINTENANCE] S3 Spark Integration Guide - Rendering Fix (#7864)

0.16.11​

  • [FEATURE] Add tests for Checkpoint utilizing SQLAlchemy style Fluent Datasources. (#7759)
  • [FEATURE] Spark parquet reader support for fluent datasources (#7754)
  • [FEATURE] Add tests for SimpleCheckpoint utilizing Fluent Datasources with Pandas, Spark, and SQLAlchemy test cases. (#7778)
  • [FEATURE] Spark read directory of files as a single batch for CSV (#7777)
  • [FEATURE] Enable passing "spark_config" through to "SparkDFExecutionEngine" constructor as arguments to "add_spark*()" Fluent Datasources methods. (#7810)
  • [BUGFIX] Patch faulty version checker logic (#7783)
  • [BUGFIX] Fix FDS Sqlite config round tripping (#7791)
  • [BUGFIX] Correct import errors in Azure Blob Storage tests and make Azure Glob Storage and Google Cloud Storage tests more elegant. (#7795)
  • [BUGFIX] Add pytest decorator to fixture (#7803)
  • [BUGFIX] fix class name (#7734) (thanks @tb102122)
  • [BUGFIX] Repair handling of regular expressions partitioning for cloud file storage environments utilizing prefix directive. (#7798)
  • [BUGFIX] AWS Docs reference clash (#7817)
  • [BUGFIX] Cloud - Fix FDS Asset has no attribute _data_connector (#7813)
  • [BUGFIX] Upper bound pyathena due to breaking API in V3 (#7821)
  • [DOCS] FDS Deployment Pattern - Google Cloud: BigQuery and GCS (#7741)
  • [DOCS] Remove temporary pin for ipython (#7784)
  • [DOCS] Add CLI Admonition (#7765)
  • [DOCS] Link Update (#7788)
  • [DOCS] Remove Redundant Introduction Headings (#7747)
  • [DOCS] Remove Prerequisites from Admonitions (#7786)
  • [DOCS] Link Updates (#7781)
  • [DOCS] FDS Deployment Pattern - AWS: Spark and S3 (#7775)
  • [MAINTENANCE] Add check to CloudDataContext to ensure using latest PyPI version (#7753)
  • [MAINTENANCE] Cache the latest great_expectations version (#7785)
  • [MAINTENANCE] Enable flake8-bugbear rules (#7776)
  • [MAINTENANCE] Cleanup of Fluent BatchRequest type and immutability constraints (#7769)
  • [MAINTENANCE] CLI warnings for suite new command (#7787)
  • [MAINTENANCE] Update pip instal extras and use AWS_ env vars (#7793)
  • [MAINTENANCE] Test DirectoryCSVAsset with both str and pathlib.Path (#7801)
  • [MAINTENANCE] Lint test/data_context (#7767)
  • [MAINTENANCE] FDS Documentation Update - S3 Pandas reference fixes (#7789)
  • [MAINTENANCE] Update all pytest calls in CI to show reason skipped (#7806)
  • [MAINTENANCE] Dont run runme_script_runner_tests stage on forks (#7807)
  • [MAINTENANCE] Lint tests/checkpoint & tests/execution_engine (#7804)
  • [MAINTENANCE] docs-integration re-start (#7735)
  • [MAINTENANCE] Remove runme fixtures/stages and enable docs-integration to run automatically (#7812)
  • [MAINTENANCE] Fix linting error. (#7820)
  • [MAINTENANCE] Fix pin count. (#7823)

0.16.10​

  • [FEATURE] Add tests for Checkpoint utilizing Pandas and Spark style Fluent Datasources. (#7740)
  • [FEATURE] Fluent BatchRequest slicing (#7706)
  • [BUGFIX] Patch Expectation registry issue introduced in 0.16.9 (#7771)
  • [DOCS] Remove, relocate, consolidate, and edit Contributing content (#7669)
  • [DOCS] Temporarily pin ipython for python 3.8 before building api docs (#7764)
  • [DOCS] Update Links in Configure Topics (#7760)
  • [DOCS] Link Updates (#7768)
  • [MAINTENANCE] FDS Deployment Guide - Pandas S3 fix reference (#7755)
  • [MAINTENANCE] IPython Python 3.8 upper bound (#7763)
  • [MAINTENANCE] breakup mypy ci steps (#7761)
  • [MAINTENANCE] fix async type-check step (#7772)
  • [MAINTENANCE] Bump Python version in static_type_check stage of async CI (#7773)

0.16.9​

  • [FEATURE] Implementing Fluent Datasources Support for Checkpoint (#7697)
  • [FEATURE] FDS persist DataAsset to YAML file immediately on creation (#7705)
  • [FEATURE] Cloud support FDS deletes (#7682)
  • [FEATURE] Persist Cloud DataAssets on creation (#7748)
  • [FEATURE] Add tests for Checkpoint utilizing Pandas and Spark style Fluent Datasources. (#7740)
  • [BUGFIX] Render Correct Fonts in Data Assistant Plot graphs (#7676)
  • [BUGFIX] fix rendering data asset name in microsoft teams notification (#7675)
  • [BUGFIX] Register core Expectations JIT in Validator workflows (#7683)
  • [BUGFIX] Data Context Data Source CRUD support for Fluent Datasources (#7660)
  • [BUGFIX] Replace renamed fixture (#7711)
  • [BUGFIX] Add missing pyspark reference (#7684) (thanks @willfeltman)
  • [DOCS] Add fluent datasources and yaml configuration warning message (#7673)
  • [DOCS] D/ /fluent connect to data overview (#7671)
  • [DOCS] Update fluent In Progress Cautionary Note (#7681)
  • [DOCS] Remove version reference (#7644)
  • [DOCS] Removing in-progress from docs confirmed as up-to-date (#7686)
  • [DOCS] Updated Data Source terms page (#7692)
  • [DOCS] Removing json schema profiler documentation (#7694)
  • [DOCS] Removing CLI-based suite edit workflow (#7689)
  • [DOCS] Updated onboarding data assistant docs test script to Fluent-style (#7695)
  • [DOCS] Update for fluent datasources: Expectations that span multiple batches evaluation params (#7668)
  • [DOCS] Add fluent docs and test create and edit expectations with profiler (#7696)
  • [DOCS] Quick docstring update for list_datasources (#7699)
  • [DOCS] Retiring the CLI (#7700)
  • [DOCS] Updating the Rule-Based Profiler doc to Fluent (#7698)
  • [DOCS] Update Batch Request glossary entry. (#7716)
  • [DOCS] Removed guide for no YML, redirect to EphemeralDataContext (#7702)
  • [DOCS] Update for fluent datasources: Dynamically load evaluation params from a database (#7717)
  • [DOCS] Update batch glossary docs. (#7726)
  • [DOCS] Update for fluent datasources: Create a new Checkpoint (#7729)
  • [DOCS] Temporarily revert update_expectation_suite call in GX Cloud quickstart (#7736)
  • [DOCS] Light update to How to add validations data or suites to a Checkpoint (#7703)
  • [DOCS] Updating cross-table comparison guide with Fluent Datasources (#7691)
  • [DOCS] Better output from invoke public-api report (#7730)
  • [DOCS] Removed unneeded calls to update datasource in docs. (#7739)
  • [DOCS] FDS Deployment Pattern - AWS S3 Pandas (#7718)
  • [DOCS] Update pypyi page urls (#7752)
  • [MAINTENANCE] Correcting minor typographical errors and type hints issues in Checkpoint and Test Checkpoint Modules (#7665)
  • [MAINTENANCE] Only attempt docs-integration pipeline when manually triggered (#7674)
  • [MAINTENANCE] Clean up Checkpoint test method names and usage of batch_request_dict fixture (#7670)
  • [MAINTENANCE] Correct typo in Checkpoint test method fixture (#7677)
  • [MAINTENANCE] Enable remaining CloudDataContext ExpectationSuite CRUD (#7646)
  • [MAINTENANCE] list_datasources should return FDS configs as well (#7667)
  • [MAINTENANCE] Exit with error when attempting to delete a fluent style datasource using the CLI (#7687)
  • [MAINTENANCE] Add warning to datasource list command if fluent datasources are detected (#7690)
  • [MAINTENANCE] ruff update 0.0.262 (#7707)
  • [MAINTENANCE] Adding black to invoke lint (#7715)
  • [MAINTENANCE] Use same version of mypy in contrib tool (#7724)
  • [MAINTENANCE] Update a Fluent Data Source related fixture name to better reflect its capabilities (#7725)
  • [MAINTENANCE] Add CLI warnings when adding a checkpoint with fluent datasources (#7685)
  • [MAINTENANCE] Iterate over the regex_pattern characters too in (#7720)
  • [MAINTENANCE] Minor stylistic cleanup (#7732)
  • [MAINTENANCE] fix get available data assets names for fds (#7723)
  • [MAINTENANCE] add warning messages when using CLI to edit an expectaiton suite if fluent datasources are present (#7714)
  • [MAINTENANCE] add warning to datasource new CLI command (#7709)
  • [MAINTENANCE] Add split/join logic to build_gallery process (#7572)
  • [MAINTENANCE] Use invoke public-api in main CI pipeline (#7746)
  • [MAINTENANCE] Add remaining public_api decorators for core fluent datasources (#7749)
  • [MAINTENANCE] FDS update schemas - fixes CI (#7751)
  • [MAINTENANCE] FDS Deployment Guide - Pandas S3 fix reference (#7755)

0.16.8​

  • [FEATURE] add Fluent Datasources to CloudDataContext (#7570)
  • [BUGFIX] fix marshmallow schema for SQLAlchemy connect_args passthrough (#7614)
  • [BUGFIX] MapCondition Memory Inefficiencies in Spark (#7626)
  • [BUGFIX] Fix capitalone_dataprofiler_expectations imports (#7658)
  • [BUGFIX] CloudDataContext creates great_expectations.yml when adding a Fluent datasource (#7657)
  • [BUGFIX] Correct GX configuration structure that incorporates both V3 and Fluent Datasources (#7661)
  • [BUGFIX] Patch broken include_rendered_content test in advance of 0.16.8 release (#7663)
  • [DOCS] Corrects Step Numbering in How to instantiate a specific Filesystem Data Context (#7612)
  • [DOCS] Corrects Heading Issue in How to host and share Data Docs on Azure Blob Storage (#7620)
  • [DOCS] Update overview.md (#7627)
  • [DOCS] Updates the "Interactive Mode" guide for creating Expectations (#7624)
  • [DOCS] Updates the language in the banner linking the legacy site to the current docs. (#7636)
  • [DOCS] Improve expect_column_values_to_be_of_type docstring (#7632)
  • [DOCS] Corrects a typo found in the navigation section of the legacy docs (#7643)
  • [DOCS] Add lakeFS to list of data version control tools (#7642) (thanks @rmoff)
  • [DOCS] Standardize language around GX Cloud access tokens (#7621)
  • [DOCS] Added IAM user and IAM assume role doc (#7634) (thanks @Reactor11)
  • [DOCS] update to location of cloud callout in the OSS Quickstart (#7616)
  • [MAINTENANCE] Update teams.yml (#7623)
  • [MAINTENANCE] Utilize NotImported for SQLAlchemy, Google Cloud Services, Azure Blob Storage, and Spark import usage (#7617)
  • [MAINTENANCE] Remove stray cloud test marker. (#7639)
  • [MAINTENANCE] Upgrade mypy to 1.2.0 (#7645)
  • [MAINTENANCE] Static type checking with python 3.8 (#7637)
  • [MAINTENANCE] Static type checking with python 3.8 followup (#7647)
  • [MAINTENANCE] The 'sklearn' PyPI package is deprecated, use 'scikit-learn' (#7651)
  • [MAINTENANCE] numpy.typing only available after v1.20 (#7654)
  • [MAINTENANCE] Update NotImported mechanism to use scoped compatibility modules (#7635)
  • [MAINTENANCE] Uncap altair version, and bump minimum version to 4.2.1. Also uncap urllib3 version, and bump minimum version to 1.26 (#7650)

0.16.7​

  • [FEATURE] Added AssumeRole Feature (#7547) (thanks @Reactor11)
  • [BUGFIX] Fix Fluent Spark DataConnectors on config load (#7560)
  • [BUGFIX] dataset_name made optional parameter for Expectations (#7603)
  • [BUGFIX] Misc gallery bugfixes (#7611)
  • [BUGFIX] Remove spark from bic Expectations since it never worked for them (#7619)
  • [DOCS] Use current minor version number in drop down instead of "Current" (#7581)
  • [DOCS] Adds deprecation policy to changelog page (#7585)
  • [DOCS] Use the actual version after release (#7583)
  • [DOCS] Update some docs_rtd requirements so the venv can be created successfully (#7580)
  • [DOCS] Add Cloud quickstart (#7441)
  • [DOCS] Updates how the GX Cloud Beta is referenced in the Quickstart guide. (#7594)
  • [DOCS] Corrects typo in code block within in-memory Pandas guide (#7600)
  • [DOCS] Updates to Contributing through GitHub (#7601)
  • [DOCS] Correct expectation documentation for expect_column_max_to_be_between (#7597)
  • [DOCS] Add scripts under test for "How to create and edit Expectations with instant feedback from a sample Batch of data" (#7615)
  • [DOCS] Corrects Step Numbering in How to instantiate a specific Filesystem Data Context (#7612)
  • [DOCS] Corrects Heading Issue in How to host and share Data Docs on Azure Blob Storage (#7620)
  • [MAINTENANCE] Warning non integer slice on row for SQLAlchemy 2.0 Compatibility (#7501)
  • [MAINTENANCE] Warning MetaData.bind argument deprecated for SQLAlchemy 2.0 Compatibility (#7502)
  • [MAINTENANCE] Capitalize "If" in rendering of conditional Expectations (#7588)
  • [MAINTENANCE] Remove pip pins in CI and in contributing_setup.md (#7587)
  • [MAINTENANCE] Remove ignore of warning deprecated api features detected sqlalchemy 2 (#7584)
  • [MAINTENANCE] Fix sqlalchemy 2.0 incompatible warnings (#7589)
  • [MAINTENANCE] Increase minimum scipy version package to 1.6.0 to take advantage of available capabilities. (#7591)
  • [MAINTENANCE] Remove s3fs dependency and upper bound for boto3 (#7598)
  • [MAINTENANCE] Move Fluent Datasources Sorters into TYPE_CHECKING block (#7602)
  • [MAINTENANCE] Bump terser from 5.10.0 to 5.16.8 in /docs/docusaurus (#7486) (thanks @dependabot[bot])
  • [MAINTENANCE] Bump cookiecutter from 1.7.3 to 2.1.1 in /contrib/cli (#7510) (thanks @dependabot[bot])
  • [MAINTENANCE] Polish and ratchet requirements pins and upper bounds (#7604)
  • [MAINTENANCE] small documentation updates (#7606)
  • [MAINTENANCE] SqlAlchemy 2 Compatibility - engine.execute() (#7469)
  • [MAINTENANCE] Deprecate ColumnExpectation in favor of ColumnAggregateExpectation (#7609)
  • [MAINTENANCE] Deprecate TableExpectation in favor of BatchExpectation (#7610)
  • [MAINTENANCE] Explicitly test relevant modules in Sqlalchemy compatibility pipeline (#7613)
  • [MAINTENANCE] Fluent Datasources: Eliminate redundant Data Source name and DataAsset name from dictionary and JSON configuration (#7573)
  • [CONTRIB] add check to calculate difference between 2 dates in month (#7576) (thanks @tb102122)
  • [CONTRIB] Expect Column Values to be Valid UUID - Added SqlAlchemyExecutionEngine support (#7592) (thanks @asafla)

0.16.6​

  • [FEATURE] Fluent DataAsset batch_metadata config variables (#7513)
  • [FEATURE] Add batch metadata to spark add_*_asset methods (#7534)
  • [BUGFIX] Fluent Data Source load from config fixes for remaining Pandas Datasources (#7442)
  • [BUGFIX] Address pandas==2.0.0 test failures (#7553)
  • [BUGFIX] Render prescriptive ExpectationConfigurations with evaluation parameters inline (#7552)
  • [BUGFIX] Release Pipeline Fix (#7575)
  • [DOCS] Update GX version in _data.jsx component (#7549)
  • [DOCS] Adds guides on using Ephemeral Data Contexts and updates Quickstart Next Steps (#7500)
  • [DOCS] Fixes broken code block and incorrectly numbered steps in "How to organize Batches in a SQL-based Data Asset" (#7533)
  • [DOCS] Update nav to match gx.io site (#7557)
  • [DOCS] Corrects step numbers in "How to organize Batches in a file-based Data Asset" (#7559)
  • [DOCS] Delete SLACK_GUIDELINES.md (#7566)
  • [DOCS] Update syntax highlighting of code blocks in GX Cloud Getting Started guide (#7563)
  • [DOCS] Fix code snippets for earlier versions (#7554)
  • [DOCS] Fix typo in docs (#7568)
  • [DOCS] Moar typo fix (#7569)
  • [DOCS] removes the original getting started tutorial pages and redirects to the quickstart guide (#7548)
  • [DOCS] Fix integral typo (#7578)
  • [DOCS] Prepare earlier versions using develop (#7567)
  • [DOCS] Use orange in docs logs (#7579)
  • [DOCS] Add GX Cloud Onboarding Script (#7517)
  • [MAINTENANCE] release prep for 0.16.5 (#7545)
  • [MAINTENANCE] Test Pandas 2.0 prerelease in CI/CD (#7343)
  • [MAINTENANCE] Add noqa directives for existing sqlalchemy imports (#7564)
  • [MAINTENANCE] Add ruff rule for sqlalchemy imports (#7562)
  • [MAINTENANCE] adding a footer to data docs with a link to the cloud page (#7532)
  • [MAINTENANCE] Harden tests for CloudDataContext always include_rendered_content (#7558)
  • [MAINTENANCE] FluentDatasources - Quickstart Snippets converted to Named Snippets (#7550)
  • [MAINTENANCE] Simplify GXCloudStoreBackend._has_key check (#7561)
  • [MAINTENANCE] Temporarily Pin pandas<2.0.0 for compatibility (#7571)
  • [MAINTENANCE] SqlAlchemy 2.0 Compatibility - branched connection + bind argument now required (#7529)
  • [MAINTENANCE] Add missing docstrings to fluent sql_datasource splitter methods. (#7577)

0.16.5​

  • [FEATURE] Add batch metadata to sql datasources. (#7499)
  • [BUGFIX] Fix issue running quickstart (#7539)
  • [DOCS] doc 508 Updates footer links on docs pages (#7521)
  • [DOCS] DSB-64 removes outdated v2/v3 references from the docs (#7519)
  • [DOCS] Update CODEOWNERS (#7528)
  • [DOCS] Quickstart code under test (#7542)
  • [MAINTENANCE] SqlAlchemy2 Compatibility - Row.keys() (#7520)
  • [MAINTENANCE] Refactoring of CapitalOne Metrics and Profiler-Based DataAssistant for Enhanced Code Elegance (#7522)
  • [MAINTENANCE] SqlAlchemy 2 Compatibility - Autoload Parameter deprecation (#7526)
  • [MAINTENANCE] Bump notebook from 6.4.1 to 6.4.12 in /docs_rtd (#7511)
  • [MAINTENANCE] Break out unit tests to own stage. (#7530)
  • [MAINTENANCE] Bump wheel from 0.37.1 to 0.38.1 in /contrib/cli (#7493)
  • [MAINTENANCE] Simplifying CapitalOne DataProfilerColumnDomainBuilder Using Default "profile_path" Argument (#7535)
  • [MAINTENANCE] : Clean up ununsed imports (#7537)
  • [MAINTENANCE] Fix Type-Checking steps (#7536)
  • [MAINTENANCE] Disable UserConfigurableProfiler tests relying on deprecated V2 functionality (#7541)
  • [MAINTENANCE] : replace ColumnMetricProvider with ColumnAggregateMetricProvider (#7538)
  • [MAINTENANCE] Exclude files from deprecation warning check (#7544)

0.16.4​

  • [FEATURE] Add package, contributors and metrics filter in Algolia script for expectation (#7000) (thanks @kod-er)
  • [FEATURE] BatchMetadata for all fluent DataAssets (#7392)
  • [FEATURE] Introducing CapitalOne DataProfilerColumnDomainBuilder as well as multiple improvements to CapitalOne codebase and testability. (#7498)
  • [BUGFIX] Repair SparkSession initialization behavior to disallow restarting, unless explicitly instructed through configuration (#7444)
  • [BUGFIX] Skip dialect specific tests if no flag passed or flag not available (#7443)
  • [BUGFIX] Ensure that MetricStore Records "data_asset_name" Properly (#7458)
  • [BUGFIX] Fix incorrect type hint and correct typographical errors in DomainBuilder docstrings and fill in missing docstrings (#7467)
  • [BUGFIX] Reset Metrics Registry in order to keep state of Metrics Registry test cases Runs mutually consistent (#7473)
  • [BUGFIX] Corrected typographical errors in two docstrings (#7506)
  • [BUGFIX] Typo in min versions install (#7516)
  • [DOCS] New ADR proposal for patch version support (#7451)
  • [DOCS] Remove outdated instructions for building documentation (#7457)
  • [DOCS] Updating the docs to gx_dev (#7455)
  • [DOCS] Fixes typo in code snippet for "How to organize Batches in a file-based Data Asset" guide (#7465)
  • [DOCS] Postgresql drivername fix for SQLAlchemy compatibility. Closes #7464 (#7466) (thanks @Itzblend)
  • [DOCS] Corrects code snippets (#7470)
  • [DOCS] Add a note about installing version of pyspark that matches Spark version (#7483)
  • [DOCS] adding cloud language to quickstart (#7484)
  • [DOCS] doc-409 Corrects links in databricks guide (#7485)
  • [DOCS] Doc-472 Corrects numbering of steps in guide (#7478)
  • [DOCS] DOC-474 Updates URL for usage statistics page (#7477)
  • [DOCS] Testing ADR (#7495)
  • [DOCS] corrects typo in GCS setup guide (#7514)
  • [MAINTENANCE] Case whens argument change for SQLAlchemy 2.0 compatibility (#7416)
  • [MAINTENANCE] mypy 1.1.1 update (#7452)
  • [MAINTENANCE] Remove v2 api CLI (#7440)
  • [MAINTENANCE] Bump http-cache-semantics from 4.1.0 to 4.1.1 in /docs/docusaurus (#7447)
  • [MAINTENANCE] Updating language per issue 3572 (#7456)
  • [MAINTENANCE] Remove v2 api expectations tests (#7439)
  • [MAINTENANCE] Move docs_link_checker.py and create new docs-specific pipeline (#7422)
  • [MAINTENANCE] select call style change for SQLAlchemy 2 compatibility (#7378)
  • [MAINTENANCE] Decruft map_metric_provider.py (#7460)
  • [MAINTENANCE] Add tests for _register_metric_functions in the MetricProvider class hierarchy. (#7459)
  • [MAINTENANCE] SqlAlchemy2 Compatibility - implicit autocommit (#7400)
  • [MAINTENANCE] Bump ua-parser-js from 0.7.31 to 0.7.34 in /docs/docusaurus (#7474)
  • [MAINTENANCE] Remove SQLAlchemyDataset/Data Source (#7471)
  • [MAINTENANCE] Bump json5 from 1.0.1 to 1.0.2 in /docs/docusaurus (#7475)
  • [MAINTENANCE] Bump @sideway/formula from 3.0.0 to 3.0.1 in /docs/docusaurus (#7487)
  • [MAINTENANCE] Bump ipython from 7.31.1 to 8.10.0 in /docs_rtd (#7491)
  • [MAINTENANCE] Bump cross-fetch from 3.1.4 to 3.1.5 in /docs/docusaurus (#7488)
  • [MAINTENANCE] Deprecated API features detected warning for SQLAlchemy 2.0 compatibility (#7490)
  • [MAINTENANCE] type-checking implementation files (#7454)
  • [MAINTENANCE] Small Refactor of ColumnDomainBuilder for code elegance and computational performance improvements (#7492)
  • [MAINTENANCE] Lower pydantic requirement to v1.9.2 or greater (#7482)
  • [MAINTENANCE] Connection.connect warning for SQLAlchemy 2.0 compatibility (#7489)
  • [MAINTENANCE] Pass PandasDatasource batch_metadata as kwargs to remove possibility of None on DataAsset model (#7503)
  • [MAINTENANCE] Make dataset_name a parameter for Expectations tests or create name from Expectation name, which ensures only limited number of tables created. (#7476)
  • [MAINTENANCE] Fix sqlalchemy warnings for pandas + sql fluent datasources (#7504)
  • [MAINTENANCE] Bump gitpython from 3.1.7 to 3.1.30 in /docs_rtd (#7494)
  • [MAINTENANCE] Bump certifi from 2020.6.20 to 2022.12.7 in /docs_rtd (#7497)
  • [MAINTENANCE] Bump jupyter-core from 4.6.3 to 4.11.2 in /docs_rtd (#7496)
  • [MAINTENANCE] Bump nbconvert from 5.6.1 to 6.5.1 in /docs_rtd (#7508)
  • [MAINTENANCE] Bump numpy from 1.21.0 to 1.22.0 in /docs_rtd (#7509)
  • [MAINTENANCE] Revert PR 7490 (#7515)
  • [MAINTENANCE] Use YAMLHandler in tests and docs (#7507)
  • [MAINTENANCE] Dedicated airflow 2.2.0 async test (#7518)
  • [MAINTENANCE] Remove airflow2 min depdency test. (#7524)
  • [CONTRIB] - Add new column expectation not be null and empty (#7449) (thanks @tmilitino)

0.16.3​

  • [BUGFIX] Fix LegacyRow import. (#7446)

0.16.2​

  • [FEATURE] Develop PandasDBFSDatasource (as part of Fluent Datasources) (#7372)
  • [FEATURE] Make SQL datasources add asset methods public. (#7387)
  • [FEATURE] Develop SparkDBFSDatasource (as part of Fluent Datasources) (#7380)
  • [FEATURE] add optional id to Fluent Datasources and DataAsset schemas (#7334)
  • [FEATURE] Fluent SQLDatasource accepts arbitrary kwargs (#7394)
  • [FEATURE] Fluent SQLDatasource create_temp_table (#7407)
  • [FEATURE] F/great 1463/add updates with datasource obj (#7401)
  • [FEATURE] Fluent SparkDataframeDatasource with DataframeDataAsset (#7425)
  • [BUGFIX] Add FluentBatchRequest early exit to convert_to_json_serializable (#7381)
  • [BUGFIX] Handle non-string fluent batch request options in convert_to_json_serializable (#7386)
  • [BUGFIX] Fix bug with case sensitive execution env (#7393)
  • [BUGFIX] Fixing typographical errors and argument omissions (#7398)
  • [BUGFIX] Remove Query ID from exception for query.template_values metric (#7373) (thanks @itaise)
  • [BUGFIX] Fluent PandasFilesytemDatasources data_connector fixes (#7414)
  • [DOCS] Add back GX logo to README (#7391)
  • [DOCS] DOC-473: Adds shared components for fluent and state management updates (#7404)
  • [DOCS] DOC-473 Adds guide "How to set up GX to work with SQL databases" (#7409)
  • [DOCS] DOC-473 Adds guide "How to set up GX to work with data on GCS" (#7408)
  • [DOCS] Pending doc updates for Data Context state management and fluent Data Source configuration (#7301)
  • [DOCS] Put data_context.md code examples under test (#7417)
  • [MAINTENANCE] Make sure sqlalchemy 2.0 warnings are emitted when running pipelines (#7379)
  • [MAINTENANCE] Make sure all existing warnings are ignored in full CI pipeline (#7389)
  • [MAINTENANCE] Add PR title checker GitHub Action (#7365)
  • [MAINTENANCE] Re-enable warnings as errors (#7383)
  • [MAINTENANCE] Test against minimum SQLAlchemy versions (#7396)
  • [MAINTENANCE] : split up map_metric_provider.py (#7402)
  • [MAINTENANCE] Consolidate Cloud tutorials (#7395)
  • [MAINTENANCE] Change for connection.execute() for SQLAlchemy 2 compatibility (#7384)
  • [MAINTENANCE] Bump SQLAlchemy lower bound to 1.4.0 (#7413)
  • [MAINTENANCE] Validate ExpectationConfiguration before adding to suite (#7366)
  • [MAINTENANCE] Convert to python built in warning categories (#7415)
  • [MAINTENANCE] Move NotImported to optional_imports.py and start using it. (#7421)
  • [MAINTENANCE] Bump minimist from 1.2.5 to 1.2.8 in /docs/docusaurus (#7419)
  • [MAINTENANCE] PandasFilesystemDatasource stubs and Schema corrections (#7428)
  • [MAINTENANCE] Bump loader-utils from 2.0.2 to 2.0.4 in /docs/docusaurus (#7429)
  • [MAINTENANCE] Bump webpack from 5.74.0 to 5.76.3 in /docs/docusaurus (#7430)
  • [MAINTENANCE] Fix some failing tests when running pytest with no args locally (#7426)
  • [MAINTENANCE] only provide py.typed files for fully typed sub-packages (#7438)
  • [MAINTENANCE] Some fluent datasource methods should be private (#7437)
  • [CONTRIB] Adding support for date for the row condition parser (#7359) (thanks @maayaniti)
  • [CONTRIB] Limit results for two expectations (#7403) (thanks @itaise)
  • [CONTRIB][MAINTENANCE] Custom query expectation and editing query.template_values metric (#7390) (thanks @mantasmy)

0.16.1​

  • [FEATURE] Fluent CRUD operation stubs (#7347)
  • [FEATURE] Implement DataBricks (DBFS) DataConnector for Fluent Datasources needs (#7355)
  • [BUGFIX] BigQuery performance uses updated add_or_update_expectation_suite() method (#7325)
  • [BUGFIX] Ensure Correct JSON and Dictionary Dump Output of Serialized Fluent Objects (#7336)
  • [BUGFIX] Fluent Datasources - empty "assets" key on serialization (#7341)
  • [BUGFIX] Use Path().glob Instead of Path(). Issue #7239 (#7327) (thanks @richardohara)
  • [BUGFIX] Patch misc errors in advance of v0.16.1 release (#7371)
  • [BUGFIX] #ephemeral_data_asset broken data docs links (#7367)
  • [BUGFIX] Fluent batch_request_options ignore None values (#7368)
  • [BUGFIX] Add FluentBatchRequest early exit to convert_to_json_serializable (#7381)
  • [DOCS] Adding ADR (#7314)
  • [DOCS] Add Cloud onboarding tutorial (#7333)
  • [DOCS] Fix onboarding cloud tutorial (#7348)
  • [DOCS] SQL Alchemy 2 Warnigns (#7292)
  • [DOCS] Update Cloud Getting Started Guide (#7364)
  • [MAINTENANCE] In Fluent Datasources: Configuration Serialization Methods Do Not Need to be Public (#7332)
  • [MAINTENANCE] Add crud methods to context.sources (#7328)
  • [MAINTENANCE] Split out mysql and multi db docs integration tests into a separate job (#7331)
  • [MAINTENANCE][MAINTENANCE ] Include all .pyi files in package data (#7340)
  • [MAINTENANCE] Separate docs_integrations tests by backend (#7342)
  • [MAINTENANCE] Parallelize integration tests - move test definitions (#7345)
  • [MAINTENANCE] Update test around unneeded deprecation warning threshold (#7351)
  • [MAINTENANCE] Remove deprecated code from Validator (#7353)
  • [MAINTENANCE] ruff 0.0.255 (#7349)
  • [MAINTENANCE] add sqla deps to type-checking CI step (#7350)
  • [MAINTENANCE] Remove deprecated code around generator_asset (#7356)
  • [MAINTENANCE] Revert accidental changes pushed to develop (#7363)
  • [MAINTENANCE] D/sql alchemy 2 warnings (#7362)
  • [MAINTENANCE] Warnings are errors + Suppress warnings in preparation for supporting SQLAlchemy 2.x (#7352)
  • [MAINTENANCE] Clean up miscellaneous deprecated code (#7358)
  • [MAINTENANCE] Rename misc internal uses of ge_cloud_id (#7360)
  • [MAINTENANCE] Patch deprecation warning in EVR.__eq__ (#7374)
  • [MAINTENANCE] remove imprecise wording in the new datasource notebook (#7369)
  • [MAINTENANCE] Add additional warning ignores to pyproject.toml (#7375)
  • [MAINTENANCE] Enable snowflake V3 Expectations Tests (#7370)
  • [MAINTENANCE] Temporarily disable warnings as errors for v0.16.1 release (#7382)

0.16.0​

  • [FEATURE] Provide S3 access/operations to new PandasDatasource (#7197)
  • [FEATURE] F/great 1393/add more zep column splitters (#7203)
  • [FEATURE] Fluent datasources have separate asset registries (#7193)
  • [FEATURE] Improve Trino types support (#6588) (thanks @ms32035)
  • [FEATURE] F/great 1393/add sql multi col splitter (#7236)
  • [FEATURE] EphemeralDataContext.convert_to_file_context() (#7175)
  • [FEATURE] New Datasources: Support S3 access for SparkDatasource (#7232)
  • [FEATURE] Implementation of Microsoft Azure Blob Storage DataConnector (#7246)
  • [FEATURE] Implementation of Google Cloud Storage DataConnector (#7249)
  • [FEATURE] Develop PandasGoogleCloudStorageDatasource (as part of New Datasources) (#7253)
  • [FEATURE] Develop PandasAzureBlobStorageDatasource (as part of New Datasources) (#7254)
  • [FEATURE] Develop SparkGoogleCloudStorageDatasource SparkAzureBlobStorageDatasource (as part of New Datasources) (#7255)
  • [FEATURE] Enable creating Checkpoint and SimpleCheckpoint with Validator (#7275)
  • [FEATURE] Editor support for Fluent Datasources dynamic .add_<DS_TYPE>() methods (#7273)
  • [FEATURE] M/great 1708/move fluent datasources out of experimental (#7294)
  • [FEATURE] PandasDatasource in-memory DataFrameAsset (#7280)
  • [FEATURE] Fluent Datasources - ConfigStr config substitution support (#7309)
  • [BUGFIX] Ensure that Marshmallow UUIDs are converted to strings before usage (#7219)
  • [BUGFIX] docs-integration tests failing after CRUD updates (#7220)
  • [BUGFIX] Adding exception logging to store-related failures (#7202) (thanks @ciguaran)
  • [BUGFIX] Patch outdated Azure relative paths (#7247)
  • [BUGFIX] params_with_json_schema is undefined in ExpectSelectColumnValuesToBeUniqueWithinRecord._prescriptive_renderer (#7261)
  • [BUGFIX] Patch Cloud workflow for add_or_update_datasource (#7242)
  • [BUGFIX] Stop modifying input batch request when getting a batch list. (#7269)
  • [BUGFIX] Single dynamic pandas model failures don't result in all models failing when used (#7277)
  • [BUGFIX] Fix typographical error in type used in "isinstance()" comparison in BatchManager (was generating "must be formal [...] Batch" warning erroneously) (#7291)
  • [BUGFIX] Correct a typographical error in specific path-forming template name for SparkDatasource-Microsoft Azure Blob Storage combination (#7302)
  • [BUGFIX] Use timezone-aware datetimes in checkpoint run information by default. (#7244)
  • [BUGFIX] row_conditions now allow whitespace (#7313)
  • [BUGFIX] Scope PandasDatasource reader method types and serialization (1 of 2) (#7306)
  • [BUGFIX] AssertError Duing Great Expectations Installation (#7285) (thanks @richardohara)
  • [BUGFIX] Provide Error Checking for "expectation_suite_name" in Checkpoint Constructor and Run Methods (#7320)
  • [BUGFIX] Scope PandasDatasource reader method types and serialization (2 of 2) (#7318)
  • [BUGFIX] raise error if no identifier provided to get checkpoint/expectation suite (#7321)
  • [BUGFIX] Fluent Datasources: Ensure that Data Source and DataAsset Model Serialization Does Not Include "name" Field (#7323)
  • [DOCS] Versioning instructions and fix references for versioning (#7221)
  • [DOCS] Fix links to images in welcome page (#7222)
  • [DOCS] Add API docs build to versioning instructions (#7230)
  • [DOCS] Move readme_assets under docs/ (#7231)
  • [DOCS] Fix hyperlinks in docs (#7264)
  • [DOCS] Scan yaml examples for class names that should be part of the public API (#7267)
  • [DOCS] Update location to run yarn commands (#7276)
  • [DOCS] Fix reference to M1 Mac installation guide (#7279)
  • [DOCS] Remove additional warnings from API docs build. (#7282)
  • [DOCS] Fix blog links in parse_strings_as_datetimes warnings (#7288)
  • [DOCS] Fix unsupported chars in API docs (#7310)
  • [DOCS] Add instructions to cli for creating data assets (#7326)
  • [MAINTENANCE] No line number snippets checker (#7216)
  • [MAINTENANCE] Re-enable snippet checker (#7217)
  • [MAINTENANCE] Refactor New SparkDatasource in order to prepare for adding support for Cloud Files Storage environments (#7223)
  • [MAINTENANCE] Repo Cleanup: Move docs related files under docs dir (#7227)
  • [MAINTENANCE] Time series expectations (#7182)
  • [MAINTENANCE] Contrib time series generators (#7235)
  • [MAINTENANCE] ci & local type-checking parity - pyspark (#7237)
  • [MAINTENANCE] Fix CI dev pipeline - skip orphaned schema check on min pandas version (#7241)
  • [MAINTENANCE] Make a copy of azure pipeline definition files in new locations (#7233)
  • [MAINTENANCE] Complete migration of Azure CI/CD config to ci directory (#7245)
  • [MAINTENANCE] ruff v0.0.253 - enable PYI rules (#7243)
  • [MAINTENANCE] Optionally allow None values in RenderedAtomicContent (#7240)
  • [MAINTENANCE] PandasDatasource read_DataAsset methods return a Validator (#7226)
  • [MAINTENANCE] Rename default pandas ephemeral data asset (#7251)
  • [MAINTENANCE] Fix linting errors in contrib/ (#7259)
  • [MAINTENANCE] Keep repo root consistent (#7260)
  • [MAINTENANCE] Threshold for public API report (#7262)
  • [MAINTENANCE] Update the signature of Fluent datasource factory methods (#7266)
  • [MAINTENANCE] Move some scripts into ci folder (#7271)
  • [MAINTENANCE] _PandasDataAsset positional argument support (#7258)
  • [MAINTENANCE] Refactor to utilize common DataConnector instantiation and Connection Test Error Message templates for New FilePath Datasources (#7268)
  • [MAINTENANCE] Merge PandasDatasource read method signatures with associated _PandasDataAssets (#7272)
  • [MAINTENANCE] Use ruff linting on scripts folder (#7270)
  • [MAINTENANCE] Fix for docs build warnings (#7229)
  • [MAINTENANCE] Add maybe imports (#7274)
  • [MAINTENANCE] Proper mocking of AbstractDataContext for testing (#7281)
  • [MAINTENANCE] Warn if sqlalchemy version is >= 2.0.0 (#7283)
  • [MAINTENANCE] Remove Prefix "Batch" from "BatchSorter" and "BatchSortersDefinition" (in New Datasources) (#7284)
  • [MAINTENANCE] Call the correct sqlalchemy method to eliminate deprecation warning (#7293)
  • [MAINTENANCE] Fluent Datasources - initial snippet tests (#7278)
  • [MAINTENANCE] add ruff PTH use-pathlib # noqa comments (#7290)
  • [MAINTENANCE] Enable SparkDatasource add_asset() methods to accept "header" and "infer_schema" arguments; fix typos in docstrings. (#7296)
  • [MAINTENANCE] enable ruff use-pathlib PTH rules (#7297)
  • [MAINTENANCE] Replace fluent data connector names with a constant (#7299)
  • [MAINTENANCE] Apply ruff path rules for contrib (#7300)
  • [MAINTENANCE] Rename column splitter to splitter. (#7303)
  • [MAINTENANCE] Run airflow operator tests in GX pipeline (#7298)
  • [MAINTENANCE] Add build docs to block PR pipeline (#7307)
  • [MAINTENANCE] Linting for tests/datasource (#7308)
  • [MAINTENANCE] Fix test_build_docs stage (#7311)
  • [MAINTENANCE] Elide Duplication of "name" Key from Fluent Data Source and DataAsset Configuration (#7312)
  • [MAINTENANCE] Remove nonexistent pypi ref in README. Add WIP warning in README. (#7304)
  • [MAINTENANCE] Fix a bug in the hourly generator. Add hourly functionality to genera… (#7305)
  • [MAINTENANCE] Update allowed deprecation warning threshold in advance of 0.16.0 (#7317)
  • [MAINTENANCE] Fluent Data Source stubs for dynamic Pandas add_asset methods (#7315)
  • [MAINTENANCE] Stub files for Fluent PandasDatasource and py.typed (#7322)
  • [MAINTENANCE] row-condition also includes tabs in conditional expectation (#7324)
  • [CONTRIB] -add athena credential support (#7186) (thanks @tmilitino)
  • [CONTRIB] expect_multicolumn_sum_values_to_be_equal_to_single_column (#7224) (thanks @swittchawa)
  • [CONTRIB][BUGFIX] Update custom multi-column expectation logic and default kwargs (#7252) (thanks @yussaaa)
  • [CONTRIB] Feature/expect column values to match thai (#7238) (thanks @swittchawa)

0.15.50​

  • [FEATURE] Utilize DataConnector in service of new DataAsset implementations (#7094)
  • [FEATURE] F/great 1393/add initial non datetime sql splitters (#7183)
  • [FEATURE] Experimental PandasDatasource with single-batch _PandasDataAssets (#7173)
  • [FEATURE] Experimental filesystem DataAssets path in batch request options and batch metadata (#7129)
  • [FEATURE] Default PandasDatasource (#7196)
  • [BUGFIX] : Allow CLI to work with RuntimeDataConnector (#7187) (thanks @luke321321)
  • [BUGFIX] Patch GX Cloud validator.save_expectation_suite() workflow (#7189)
  • [BUGFIX] Dynamic pandas asset model field substitution (#7212)
  • [DOCS] Use named snippets part 5 (#7181)
  • [DOCS] Use named snippets part 4 (#7176)
  • [DOCS] Use named snippets part 6 (#7171)
  • [DOCS] Use named snippets part 7 (#7192)
  • [DOCS] Use named snippets part 9 (#7195)
  • [DOCS] Use named snippets part 11 (#7201)
  • [DOCS] Use named snippets part 8 (#7194)
  • [DOCS] Use named snippets part 10 (#7199)
  • [DOCS] Fix broken link in anonymous_usage_statistics.md (#7211) (thanks @Erin-GX)
  • [DOCS] Use named snippets part 12 (#7214)
  • [MAINTENANCE] Update changelog when updated release 0.15.49 (#7179)
  • [MAINTENANCE] Raise store config ClassInstantiationError from original DataContextError (#7174)
  • [MAINTENANCE] New Datasources: Delineate "SparkFilesystemDatasource" (instead of "SparkDatasource") -- to be congruent with "PandasFilesystemDatasource" (#7178)
  • [MAINTENANCE] Small Refactor to Enable PandasDatsource for multiple Storage Environments (#7190)
  • [MAINTENANCE] Replace regex with batching_regex for fluent filesystem-like datasources (#7207)
  • [MAINTENANCE] Misc DataContext state management & API cleanup (#7215)

0.15.49​

  • [FEATURE] Enable customization of candidate Regular Expression patterns when running OnboardingDataAssistant (#7104)
  • [FEATURE] Enable gx.get_context() to work without any inputs (#7074)
  • [FEATURE] Add datasource arg to DataContext Datasource CRUD (#7070)
  • [FEATURE] Update zep to use sqlalchemy_data_splitter.py (#7151)
  • [FEATURE] ZEP - Dynamically define add_<ASSET_TYPE>_asset() methods if needed (#7121)
  • [FEATURE] add expectation_column_values_to_be_continuous (#5861) (thanks @jmoskovc)
  • [BUGFIX] Rename experimental get_batch_request to build_batch_request (#7107)
  • [BUGFIX] Remove version from versions.json (#7109)
  • [BUGFIX] Properly Enable/Disable Spark Integration Tests Depending on pyspark Installation for New Datasources (#7132)
  • [BUGFIX] Copy previous versions after checking out the current commit (#7142)
  • [BUGFIX] TupleAzureBlobStoreBackend no longer gives warning when obfuscating connection string (#7139)
  • [BUGFIX] Patch inconsistent ordering within GCP test asserts (#7130)
  • [BUGFIX] Parse pandas version correctly for development builds (#7147) (thanks @jtilly)
  • [BUGFIX] Patch broken rendered content Cloud tests (#7155)
  • [BUGFIX] pydantic>=1.10.4 - ImportError: cannot import name dataclass_transform (#7163)
  • [BUGFIX] ID/PK Spark and Sql fall back when unexpected_index_column_names have not been defined (#7150)
  • [BUGFIX] Patch broken Cloud test blocking 0.15.49 release (#7177)
  • [DOCS] Add CRUD API matrix to AbstractDataContext docstring (#7079)
  • [DOCS] Build API docs using latest released version (#7067)
  • [DOCS] Add displayHTML method to view Data Docs (#7125) (thanks @swittchawa)
  • [DOCS] Use named snippets part 1 (#7131)
  • [DOCS] : fix capitalization of Slack (#7136) (thanks @JoelGritter)
  • [DOCS] Remove sitemap.xml (#7141)
  • [DOCS] doc-464 consolidating and standardizing snippets (#7154)
  • [DOCS] Use named snippets part 2 (#7143)
  • [DOCS] Use named snippets part 3 (#7169) (thanks @jmoskovc)
  • [MAINTENANCE] Remove Extra Character from ID/PK Example README (#7098)
  • [MAINTENANCE] Rename experimental get_batch_request to build_batch_request (#7095)
  • [MAINTENANCE] Fix incorrect label on "How to configure a SQL Data Source" docs page (#7106)
  • [MAINTENANCE] Update dependency on pydantic (#7111)
  • [MAINTENANCE] Move experimental base_directory from _FilesystemDataAsset to PandasDatasource and SparkDatasource (#7078)
  • [MAINTENANCE] Use secret to store algolia api key (#7115)
  • [MAINTENANCE] Fluent Datasources - don't register "private" Data Source classes (#7124)
  • [MAINTENANCE] ZEP - Realign pandas asset args for Datasource level base_directory (#7123)
  • [MAINTENANCE] format notebooks with black (#7054)
  • [MAINTENANCE] mypy v1.0.0 (#7138)
  • [MAINTENANCE] Output Consistent Data Format from "table.head" Metric for every ExecutionEngine (#7134)
  • [MAINTENANCE] ruff 0.0.246 update (#7137)
  • [MAINTENANCE] Refactor sql splitter to take selectable instead of str. (#7133)
  • [MAINTENANCE] Update V3 DataConnector utilities to support New Datasources (ZEP) (#7144)
  • [MAINTENANCE] Change all instances of create_expectation_suite to add_expectation_suite in tests, docs, and source code (#7117)
  • [MAINTENANCE] Clean up pathlib.Path() usage in DataConnector utilities and restore tighter formatting in great_expectations/util.py (#7149)
  • [MAINTENANCE] Clean up mypy violations in CardinalityChecker (#7146)
  • [MAINTENANCE] Remove unused dockerfile (#7152)
  • [MAINTENANCE] Delete cli v012 tests. (#7159)
  • [MAINTENANCE] ZEP - update asset factories method signatures from asset models (#7096)
  • [MAINTENANCE] Bump minimum version of pytest (#7164)
  • [MAINTENANCE] Clean up additional deprecation warnings from outdated CRUD API (#7156)
  • [MAINTENANCE] Experimental PandasDatasource, single-batch _PandasDataAssets, related schemas (#7158)
  • [MAINTENANCE] Removing path for --v2-api upgrade and informative message (#7170)
  • [CONTRIB] Add experimental expectation to check column values after split (#7120) (thanks @ace-racer)
  • [CONTRIB] added new Expectations - India_zip_code expectation and not_to_be_future_date expectation (#6086) (thanks @prachijain136)
  • [CONTRIB] Update the rendered text for min and max values to be clearer. (#7166)

0.15.48​

  • [FEATURE] Place FilesystemDataAsset into separate module (its functionality is used by both PandasDatasource and SparkDatasource) (#7025)
  • [FEATURE] Add SQL query data asset for new experimental datasources (#6999)
  • [FEATURE] Experimental DataAsset test_connection (#7019)
  • [FEATURE] ZEP - generate pandas assets (#7044)
  • [FEATURE] Experimental Splitter connection testing (#7051)
  • [FEATURE] ID/PK ColumnPairExpectations and MultiColumnMapExpectations - Spark (#7001)
  • [FEATURE] Add expectation_suite arg to DataContext ExpectationSuite CRUD (#7059)
  • [FEATURE] ID/PK ColumnPairExpectations and MultiColumnMapExpectations - SQL (#7046)
  • [FEATURE] Introducing General-Purpose Wrapper for Regular Expressions Parsing and incorporating it in "_FilesystemDataAsset" (#7062)
  • [FEATURE] Add checkpoint arg to DataContext Checkpoint CRUD (#7066)
  • [FEATURE] Add profiler arg to DataContext Profiler CRUD (#7060)
  • [FEATURE] Add API action (#6902) (thanks @itaise)
  • [BUGFIX] ID/PK - Rendering ColumnPair and MultiColumn Expectations in DataDocs (#7041)
  • [BUGFIX] ColumnPairExpectation tests need to consider 2 possible GroupBy results (#7045)
  • [BUGFIX] zep - always serialize type field (#7056)
  • [BUGFIX] ZEP - html asset generation on pandas 1.1 (#7068)
  • [BUGFIX] fix ZEP pandas min tests (#7084)
  • [BUGFIX] Skip all ZEP pandas datasource tests for min pandas (#7091)
  • [DOCS] Add new DataContext CRUD to public API (#7058)
  • [DOCS] DOC-461 remove unlinked link (#7083)
  • [DOCS] Adding algolia click events (#7085)
  • [DOCS] Versioning for documentation (#7033)
  • [MAINTENANCE] linting for /contrib (#7005)
  • [MAINTENANCE] Deprecate old DataContext CRUD methods (#7031)
  • [MAINTENANCE] Simplify logic for add_or_update (#7035)
  • [MAINTENANCE] ZEP - test type-checking (#7028)
  • [MAINTENANCE] ZEP put schemas under source control (#6988)
  • [MAINTENANCE] Add id as a param to any CRUD methods with ge_cloud_id (#7036)
  • [MAINTENANCE] Minor Cleanup (#7047)
  • [MAINTENANCE] replace isort with ruff sorting rules (#6907)
  • [MAINTENANCE] Standardize Checkpoint CRUD (#6962)
  • [MAINTENANCE] ruff 0.0.241 (#7048)
  • [MAINTENANCE] finish linting great_expectations (#7050)
  • [MAINTENANCE] fix - FutureWarning: pandas.Float64Index is deprecated when importing great_expectations (#7055)
  • [MAINTENANCE] Move path mapping out of ExecutionEngine into DataConnector (#7065)
  • [MAINTENANCE] Add ruff TCH001 noqa annotations (#7072)
  • [MAINTENANCE] Enable ruff TCH rules (#7073)
  • [MAINTENANCE] Cache dependency installation during build of Dockerfile.tests (#7071)
  • [MAINTENANCE] Fix most typing errors in DataAssistantResult (#7010)
  • [MAINTENANCE] add ge_dev + gx_dev to .gitignore (#6860)
  • [MAINTENANCE] Refactor Filesystem DataAsset into FilePath DataAsset and Filesystem DataAsset (later inherits former) (#7075)
  • [MAINTENANCE] Refactor Store and StoreBackend to leverage new CRUD methods (#7081)
  • [MAINTENANCE] Delete gx_venv from project root (#7080)
  • [MAINTENANCE] correct typo in data assistants portion of the getting started tutorial (#7088)
  • [MAINTENANCE] ID/PK - CompoundColumnsUnique is filtered only for SQL (#7087)
  • [MAINTENANCE] Minor clean up to make DataConnector method names less confusing. (#7089)
  • [MAINTENANCE] Refactor DataConnector Path Format Utilities For Better Encapsulation (#7092)
  • [MAINTENANCE] Temporarily xfail ID/PK tests due to Pandas min version conflicts (#7097)
  • [MAINTENANCE] Remove Extra Character from ID/PK Example README (#7098)
  • [CONTRIB] Row condition parser sqlalchemy: adding support for != operator & adding support all operators for string (#7053) (thanks @maayaniti)

0.15.47​

  • [FEATURE] ZEP - dynamic pandas asset schema definitions (#6780)
  • [FEATURE] ID/PK ColumnPairExpectations and MultiColumnMapExpectations - Pandas (#6941)
  • [FEATURE] Experimental Datasource and DataAsset connection testing (#6844)
  • [FEATURE] Implement Experimental SparkDatasource with CSVDataAsset (#6981)
  • [FEATURE] Place FilesystemDataAsset into separate module (its functionality is used by both PandasDatasource and SparkDatasource) (#7025)
  • [BUGFIX] Snowflake/Oracle/DB2 <--> SQLAlchemy table and column names case insensitivity representation (#6951)
  • [BUGFIX] try except import of pandas types (#6983)
  • [BUGFIX] fix jsonschema - altair conflict (#6984)
  • [BUGFIX] Temporarily disable items with issues rendering (#6997)
  • [BUGFIX] Fix Renderer Configuration for expectation expect_column_values_to_not_be_in_set #6963 (#6990) (thanks @jmcorreia)
  • [BUGFIX] Patch logic error in new add_or_update methods (#7021)
  • [BUGFIX] Pandas ID/PK - bugfix for column name and update tests (#7015)
  • [DOCS] Regex-Based, Set-Based, Query-Based, & Actions Docstrings (#6863)
  • [DOCS] Documentation for classes and methods within ExecutionEngine class hierarchy (#6936)
  • [DOCS] Enable use of code blocks in Returns: section (#6946)
  • [DOCS] Add missing data connectors and data contexts (#6945)
  • [DOCS] DOC-280: How to use GX with AWS S3 and Spark (#6782)
  • [DOCS] Adding docstrings per the list (#6931)
  • [DOCS] Docstrings for DataContext child classes and DataAssistantResult.to_json_dict (#6956)
  • [DOCS] batch docstring (#6939)
  • [DOCS] BatchDefinition (#6940)
  • [DOCS] Add metric provider to public api report (#6958)
  • [DOCS] BatchRequest (#6943)
  • [DOCS] head (#6944)
  • [DOCS] Add public_api. Docstring is fine already (#6955)
  • [DOCS] Add public API docstring for RuleBasedProfiler (#6947)
  • [DOCS] Adding docstrings for metric providers (#6960)
  • [DOCS] Add docstrings for several data connectors (#6949)
  • [DOCS] Adds docstring to class configured data connector classes (#6961)
  • [DOCS] Add public API docstring for validate_configuration on expect_column_value_z_scores_to_be_less_than and expect_column_values_to_match_json_schema (#6873)
  • [DOCS] Expectations Class DocStrings (#6950)
  • [DOCS] D/dx 237/tal docstrings (#6959)
  • [DOCS] Add delete_checkpoint to public API (#6965)
  • [DOCS] Use markdown style code blocks (#6970)
  • [DOCS] DataContext and CheckpointConfig DocString (#6911)
  • [DOCS] Either Documentation tag style acceptable (#6974)
  • [DOCS] DocStrings for Column, Query, & Table Metric Providers & register_metric (#6971)
  • [DOCS] render utils (#6975)
  • [DOCS] Add public API docstring for UserConfigurableProfiler (#6904)
  • [DOCS] Add docstring for ExpectationValidationResult (#6968)
  • [DOCS] Add some json serialization docstrings. (#6880)
  • [DOCS] DOC-285 new guide: how to use self initializing expectations (#5205)
  • [DOCS] DOC-286 how to add support for the auto initializing framework to a custom expectation (#5300)
  • [DOCS] ExpectationConfiguration, get_success_kwargs and validate api docs (#6982)
  • [DOCS] rule_based_profiler_result (#6977)
  • [DOCS] metric_value, metric_partial (#6978)
  • [DOCS] Actions, Checkpoint, ExpectationSuiteValidationResult, RunIdentifier related docstrings (#6986)
  • [DOCS] API docs support self referential links (#6998)
  • [DOCS] Add rendering docstrings (#6992)
  • [DOCS] Expectations related DocStrings (#6994)
  • [DOCS] MetricConfiguration DocString (#6996)
  • [DOCS] Updates typo in prerequisites section (#7004) (thanks @ruankie)
  • [DOCS] Update API docs landing page (#6972)
  • [DOCS] Remove BaseDataContext and DataContext from the public API (#7008)
  • [DOCS] Fix setup instructions for email validation (#7007) (thanks @ruankie)
  • [DOCS] DOC-348 corrects typos in the aws+athena guide intro and congratulations sections (#6989)
  • [DOCS] DOC-420 updates to screenshots (#7012)
  • [DOCS] DOC-416 How to use GX with AWS using Redshift (#6985)
  • [DOCS] Fix metric provider and reorganize sidebar (#7022)
  • [DOCS] Typo - Update api_reference.md (#7024)
  • [DOCS] Nest sidebar by shortest import path (#7032)
  • [MAINTENANCE] Parameterized tests for ID/PK at ColumnMapExpectation level (#6925)
  • [MAINTENANCE] ruff -> 0.0.236 (#6948)
  • [MAINTENANCE] docstring for expect_column_values_to_not_match_regex_list's validate_configuration (#6877)
  • [MAINTENANCE] Remove handrolled linters/checkers from scripts/ and CI (#6964)
  • [MAINTENANCE] Remove refs to old scripts from invoke calls (#6967)
  • [MAINTENANCE] Fix some linting issues (#6973)
  • [MAINTENANCE] Fix variable name error associated with adding typing and docstrings (#6980)
  • [MAINTENANCE] Add test to ensure that all types in the DataContext hierarchy emit expected usage stats (#6915)
  • [MAINTENANCE] Standardize Datasource CRUD (#6892)
  • [MAINTENANCE] Typing histogram_single_batch_parameter_builder (#6916)
  • [MAINTENANCE] Add add_expectation_suite to DataContext CRUD (#6926)
  • [MAINTENANCE] ColumnExpectation, render_evaluation_parameter_string and validate method (#6995)
  • [MAINTENANCE] Add update_expectation_suite and add_or_update_expectation_suite to DataContext CRUD (#6987)
  • [MAINTENANCE] Standardize RuleBasedProfiler CRUD (#6991)
  • [MAINTENANCE] Make Pandas installation with Python 3.10 less restrictive (#7013)
  • [MAINTENANCE] ZEP - postgres test typing (#7023)
  • [MAINTENANCE][BUGFIX ] ZEP - pandas serde fix (#7009)
  • [MAINTENANCE] add preview image for twitter and other social preview images (#7027)
  • [MAINTENANCE] Update update_ methods in DataContext to return persisted object (#7034)
  • [MAINTENANCE] ZEP - use parameter that exists on min pandas version (#7037)
  • [MAINTENANCE] xfail ZEP async spark tests for release (#7038)
  • [CONTRIB] expect_multicolumn_values_not_to_be_all_null (#6912) (thanks @yussaaa)
  • [CONTRIB] Adding support for punctuation in column_value for the row_condition parser (#7018) (thanks @maayaniti)

0.15.46​

  • [BUGFIX] Disable RendererConfiguration constraint to support legacy renderer fallback behavior (#6938)
  • [DOCS] Remove the great_expectations path prefix for API docs (#6934)
  • [DOCS] Updates Custom Expectation docs w/ code snippets (#6365)
  • [DOCS] Regex-Based, Set-Based, Query-Based, & Actions Docstrings (#6863)
  • [DOCS] Documentation for classes and methods within ExecutionEngine class hierarchy (#6936)

0.15.45​

  • [FEATURE] Experimental datasources batch.head() (#6765)
  • [FEATURE] Add Validation Result URL to Checkpoint Result (#6908)
  • [BUGFIX] Fix issues rendering code blocks in API docs (#6917)
  • [BUGFIX] Fix list_keys method for TupleS3StoreBackend (#6901) (thanks @enagovitsyn)
  • [BUGFIX] Fix rendering issue with api docs (#6924)
  • [BUGFIX] Render bar graph with boolean values (#6910) (thanks @tmilitino)
  • [BUGFIX] Capital one contrib/micdavis/import hotfix (#6922) (thanks @micdavis)
  • [DOCS] Adding docstring for Checkpoint.self_check() (#6841)
  • [DOCS] AbstractDataContext.add_store docstring (#6851)
  • [DOCS] Doc Strings for ExpectationSuite Display Methods (#6856)
  • [DOCS] DataAssistantResult.get_expectation_suite() docstring (#6862)
  • [DOCS] Misc docstrings around DataAssistant (#6866)
  • [DOCS] enable running invoke docstrings on select modules (#6868)
  • [DOCS] Adds docstring for expect_column_distinct_values_to_contain_set (#6855)
  • [DOCS] Documentation Strings for Metric Domain Types and Metric Function Types (#6872)
  • [DOCS] added docstrings for the public API (#6884)
  • [DOCS] Add public API docstring for expect_column_values_to_be_unique validate_configuration (#6897)
  • [DOCS] Miscellaneous docstrings for DataContext and utils (#6852)
  • [DOCS] Add public API docstring for expect_column_values_to_be_of_type validate_configuration (#6896)
  • [DOCS] Add public API docstring for JsonSchemaProflier.validate (#6900)
  • [DOCS] Exclude DataAssistantRunner.run() (#6919)
  • [DOCS] StoreValidationResultAction, StoreEvaluationParametersAction and StoreMetricsAction api docs (#6879)
  • [DOCS] Add public API docstring for expect_column_values_to_be_dateutil_parseable validate_configuration (#6864)
  • [DOCS] YAML docs (#6861)
  • [DOCS] Add public API docstring for expect_column_values_to_be_decreasing validate_configuration (#6865)
  • [DOCS] Docstrings for Checkpoint and related classes (#6882)
  • [DOCS] Add public API docstring for expect_table_row_count_to_be_between validate_configuration (#6883) (thanks @lockettks)
  • [DOCS] Validator.get_expectation_suite() docstring (#6886)
  • [DOCS] Fix Checkpoint docstring whitespace (#6927)
  • [DOCS] DataAssistantResult docstring (#6887)
  • [DOCS] Add public API docstring for expect_column_values_to_be_in_set validate_configuration (#6890)
  • [DOCS] Add public API docstring for expect_column_values_to_be_in_type_list and expect_column_values_to_be_increasing validate_configuration (#6891)
  • [DOCS] Deprecate util.render_evaluation_parameter_string function (#6894)
  • [DOCS] Add public API docstring for Profiler.validate (#6898)
  • [DOCS] Add public API docstring for expect_column_values_to_be_between validate_configuration (#6858)
  • [DOCS] Add public API docstring for expect_column_values_to_be_in_json_parseable validate_configuration (#6893)
  • [DOCS] Add public API docstring for expect_column_values_to_be_null validate_configuration (#6895)
  • [DOCS] Update docstrings for some of actions.py (#6853)
  • [DOCS] /typo correction (#6920) (thanks @mingyyy)
  • [DOCS] DOC-417 How to use GX with AWS using Athena (#6828)
  • [DOCS] Adding docstrings (#6854)
  • [MAINTENANCE] Update teams.yml (#6839)
  • [MAINTENANCE] invoke 2.0 and schema task (for zep types) (#6836)
  • [MAINTENANCE] Build hierarchy in sidebars for API docs (#6842)
  • [MAINTENANCE] Change public_api task name to avoid confusion (#6843)
  • [MAINTENANCE] Add the fragment back to internal references (#6845)
  • [MAINTENANCE] Clean up public_api excludes (#6846)
  • [MAINTENANCE] Fix the error message for invalid batch request options (#6848)
  • [MAINTENANCE] Standardize Store CRUD (#6826)
  • [MAINTENANCE] Fix scripts not found error in invoke (#6867)
  • [MAINTENANCE] Fix argument name typo (#6850) (thanks @KirillUlich)
  • [MAINTENANCE] more clearly specifies range of supported python versions (#6870)
  • [MAINTENANCE] add validate_configuration docstring (#6857)
  • [MAINTENANCE] docstring for expect_column_values_to_not_be_null#validate_configuration (#6859)
  • [MAINTENANCE] Standardize project config CRUD (#6837)
  • [MAINTENANCE] update docstring in validator.py and checkpoint_result.py (#6875)
  • [MAINTENANCE] updated docstring on validate configuration (#6871)
  • [MAINTENANCE] Exclude unit tests from comprehensive stage of dev CI (#6903)
  • [MAINTENANCE] Refactor file_relative_path util (#6778)
  • [MAINTENANCE] switch to ruff linter (#6888)
  • [MAINTENANCE] Use docusaurus style code block in api docs (#6906)
  • [MAINTENANCE] metrics linting (#6889)
  • [MAINTENANCE] Add exception message to RenderedAtomicContent failure renderer (#6795)
  • [MAINTENANCE] Remove CloudNotificationAction (#6881)
  • [MAINTENANCE] Use ruff linter for docstring linting (#6913)
  • [MAINTENANCE] Add validate_configuration method docstrings (#6899)
  • [MAINTENANCE] docstring for expect_column_values_to_not_match_like_pattern_list's validate_configuration (#6874)
  • [MAINTENANCE] docstring for expect_column_values_to_not_match_like_pattern validate_configuration (#6876)
  • [MAINTENANCE] docstring for expect_compound_columns_to_be_unique validate_configuration (#6878)
  • [MAINTENANCE] Add docstrings for Validator and its save_expectation_suite and validate methods (#6885)
  • [MAINTENANCE] Type Hints Correction in New Datasources; Additional DocStrings (#6918)

0.15.44​

  • [FEATURE] Add pandas datasource sorter by refactoring into DataAsset (#6787)
  • [FEATURE] ID/PK Demo Files (#6833)
  • [BUGFIX] Fix missing not operator ~ (#6808)
  • [BUGFIX] Implemented lowercase function to check what type of file endswith (#6810) (thanks @tmilitino)
  • [BUGFIX] : expect_day_count_to_be_close_to_equivalent_week_day_mean (#6811) (thanks @HadasManor)
  • [BUGFIX] Pandas ID/PK query was causing DataDocs error (#6832)
  • [DOCS] Link to gh issue #4152 for ruamel.yaml (#6799) (thanks @jamesmyatt)
  • [DOCS] ExpectationSuite and remove_expectation api docs (#6785)
  • [DOCS] Add GitHub PR links to changelogs (#6818)
  • [DOCS] Update yarn-snippet-check to only target specific source code dirs (#6825)
  • [DOCS] Adding docstring for ExpectationSuite.add_expectation (#6829)
  • [DOCS] DOC-394: Fix broken redirect links (#6835)
  • [MAINTENANCE] Enable more backends for some contrib expectations (#6775)
  • [MAINTENANCE] Change execution_engine_type from method to property. (#6788)
  • [MAINTENANCE] More backends for expect_yesterday_count_compared_to_avg_equivalent_days_of_week (#6790)
  • [MAINTENANCE] Update gallery pipeline to only have one scheduled run per day (early AM) (#6791)
  • [MAINTENANCE] Convert the validation results to JSON serializable (#6776) (thanks @lu-lz)
  • [MAINTENANCE] Propagate "runtime_configuration" argument throughout Validator flow (#6767)
  • [MAINTENANCE] Only include relevant diagnostics info in gallery JSON (#6797)
  • [MAINTENANCE] Clean up public api report part 1 (#6784)
  • [MAINTENANCE] Clean up public api report part 2 (#6792)
  • [MAINTENANCE] Shift daily gallery run by 6 hours (#6802)
  • [MAINTENANCE] Misc docstrings in AbstractDataContext (#6801)
  • [MAINTENANCE] Add checkpoint and datadoc integration test for zep pandas datasource. (#6793)
  • [MAINTENANCE] Use environment variables for expectation gallery data paths (#6805)
  • [MAINTENANCE] Suppress 2 kl_divergence datasets for bigquery that took 90 minutes to insert (#6807)
  • [MAINTENANCE] Improve type hints in ExecutionEngine.resolve_metrics() flow and delete unnecessary checks (#6804)
  • [MAINTENANCE] Fixes for column_values_to_be_between tests (#6809)
  • [MAINTENANCE] Clean up public api report part 3 (#6803)
  • [MAINTENANCE] Add docstring for AbstractDataContext.add_checkpoint (#6728)
  • [MAINTENANCE] Use Enum classes for all metric name suffixes (#6819)
  • [MAINTENANCE] Use shortened_dotted_paths in API docs (#6820)
  • [MAINTENANCE] Update batch request option validation error message (#6821)
  • [MAINTENANCE] Add docstring to DataAsset.add_sorters (#6822)
  • [MAINTENANCE] Misc type cleanup withincheckpoint/ and validator/ (#6817)
  • [MAINTENANCE] Update algolia indexing (#6827)
  • [MAINTENANCE] When running our test suite, suppress warnings result_format configuration in Expectations and Validators (#6823)
  • [MAINTENANCE] ZEP - lower logging levels from INFO -> DEBUG (#6830)
  • [MAINTENANCE] Use shortened dotted paths in api docs (#6831)
  • [MAINTENANCE] Remove outdated refs to Superconductive (#6816)
  • [CONTRIB] Improve contrib schwifty expectations (#6812) (thanks @mkopec87)

0.15.43​

  • [FEATURE] ZEP - Synchronize & save XDatasources (#6717)
  • [FEATURE] Official Python 3.10 support (#6763)
  • [FEATURE] F/great 1313/zep pandas poc (#6745)
  • [FEATURE] Add GX Cloud hyperlink to slack notification (#6740)
  • [FEATURE] Get ExpectationSuite, Checkpoint by name (#6774)
  • [FEATURE] API docs (#6766)
  • [BUGFIX] - Implementing deep copy of runtime_configuration variable (#6682) (thanks @tmilitino)
  • [BUGFIX] Patch broken test_data_context_ge_cloud_mode_with_incomplete_cloud_config_should_throw_error (#6741)
  • [BUGFIX] reformatting setup.py (#6756)
  • [BUGFIX] Fix observed value (#6759) (thanks @itaise)
  • [BUGFIX] fix comment stripping when saving a zep configuration (#6783)
  • [DOCS] DOC-414: Remove guide for use of outdated docker images (#6718)
  • [DOCS] Convert docs snippets to named snippets (#6735)
  • [DOCS] Update documentation to reference get_context (#6738)
  • [DOCS] Convert remaining snippets to named snippets (#6736)
  • [DOCS] Convert line number references to named references in docs (#6748)
  • [DOCS] Doc-280 AWS golden path with S3 cloud storage and Pandas (#6618)
  • [DOCS] Preparation for building api docs (#6737)
  • [DOCS] Change prefix reference for tutorial folder/directory (#6751) (thanks @medeirosthiago)
  • [DOCS] Fix line-links in 4th step's 5th and 6th block (#6752) (thanks @OnkarMadli)
  • [DOCS] - fixed code reference in documentation (#6732) (thanks @tmilitino)
  • [DOCS] validator.head docstring (#6762)
  • [MAINTENANCE] Update docstrings for experimental SQL datasources. (#6714)
  • [MAINTENANCE] update cli DataContext types (#6703)
  • [MAINTENANCE] Fix missing exclamation marks in API docs admonitions (#6721)
  • [MAINTENANCE] ID/PK Tests at Expectations-level with Warnings caught (#6713)
  • [MAINTENANCE] Refactor tests to leverage get_context instead of BaseDataContext (#6720)
  • [MAINTENANCE] Update remaining atomic prescriptive templates (1 of 2) (#6696)
  • [MAINTENANCE] Refactor tests to leverage get_context instead of DataContext (#6723)
  • [MAINTENANCE] Update remaining atomic prescriptive templates (2 of 2) (#6724)
  • [MAINTENANCE] execution_engine typing (#6730)
  • [MAINTENANCE] core/expectation_ type checking (#6731)
  • [MAINTENANCE] Remove printing of entire snippet map in remark-named-snippet hook (#6749)
  • [MAINTENANCE] Rename all instances of ge_exceptions to gx_exceptions (#6742)
  • [MAINTENANCE] Remove base_data_context mark in tests (#6750)
  • [MAINTENANCE] Consolidate different Metric Types definition Enums (#6746)
  • [MAINTENANCE] exclude scripts directory from package (#6744) (thanks @cburroughs)
  • [MAINTENANCE] Force cryptography version installed where snowflake runs to be v38.0.4 (#6755)
  • [MAINTENANCE] ID/PK - Adding semi-colon to SQL Query output (#6743)
  • [MAINTENANCE] ID/PK result_format documentation update (#6716)
  • [MAINTENANCE] Consistent use of Metric Name Enum values (#6757)
  • [MAINTENANCE] Fix min version test requirements install on azure async pipeline. (#6753)
  • [MAINTENANCE] expectations linting & bug fixes (#6739)
  • [MAINTENANCE] Add Python 3.10 to async Azure pipeline (#6760)
  • [MAINTENANCE] Unset cloud vars when running pytest from a mac (#6747)
  • [MAINTENANCE] Update CheckChanges for dev pipeline (#6768)
  • [MAINTENANCE] Update contrib pipeline to track package changes (#6770)
  • [MAINTENANCE] Update docstring for AbstractDataContext.add_batch_kwargs_generator (#6727)
  • [MAINTENANCE] Update docstring for add_datasource (#6729)
  • [MAINTENANCE] Remove chunk of code in build_gallery.py to skip processing some Expectations (#6772)
  • [MAINTENANCE] Update docstring for AbstractDataContext.build_data_docs (#6726)
  • [MAINTENANCE] Move constraints-test dir within azure dir to clean up project root (#6764)
  • [MAINTENANCE] Misc cleanup of SerializableDataContext (#6777)
  • [MAINTENANCE] Removed some 30 type hint violations (#6771)
  • [MAINTENANCE] Adjust gallery schedule and timeout (#6781)
  • [MAINTENANCE] type-checking - metrics/util.py (#6754)
  • [MAINTENANCE] Update requirements.txt to reflect 3.10 support (#6786)
  • [MAINTENANCE] Enable more backends for some contrib expectations (#6775)
  • [CONTRIB] added condition to ExpectQueriedColumnListToBeUnique (#6702) (thanks @maayaniti)
  • [CONTRIB] Implement Spark backend for several expectations (#6683) (thanks @mkopec87)
  • [CONTRIB] Improve Spark backend support for contrib query based expectations (#6733) (thanks @mkopec87)
  • [CONTRIB] Refactor ExpectColumnValuesToBeHexadecimal expectation to be RegexBased (#6734) (thanks @mkopec87)
  • [CONTRIB] Fix regex based expectations for spark (#6725) (thanks @mkopec87)

0.15.42​

  • [FEATURE] ZEP - PG BatchSorter loading + dumping (#6580)
  • [FEATURE] Ensure result_format accessed is through Checkpoint, and warns users if Expectation or Validator-level (#6562)
  • [FEATURE] ZEP - PG SqlYearMonthSplitter serialization + deserialization (#6595)
  • [FEATURE] ID/PK - unexpected_index_list updated to include actual unexpected value, and EVR to include unexpected_index_column_names (#6586)
  • [FEATURE] Atomic rendering of Evaluation Parameters (#6232)
  • [FEATURE] Add zep datasource data assistant e2e tests. (#6612)
  • [FEATURE] F/great 1400/sql datasource (#6623)
  • [FEATURE] Accept a pathlib.Path context_root_dir (#6613)
  • [FEATURE] Atomic rendering of meta notes (#6627)
  • [FEATURE] Docstring linter for public api (#6638)
  • [FEATURE] ZEP - Load/dump new style config from DataContext (#6631)
  • [FEATURE] ID/PK Rendering in DataDocs (#6637)
  • [FEATURE] Use docstring linter for public api to catch missing parameters (#6642)
  • [FEATURE] ZEP - load from shared config (#6655)
  • [FEATURE] Added new expectation: ExpectYesterdayCountComparedToAvgEquivalentDaysOfWeek… (#6622) (thanks @HadasManor)
  • [FEATURE] Add sqlite datasource (#6657)
  • [FEATURE] ExpectDaySumToBeCloseToEquivalentWeekDayMean (#6664) (thanks @HadasManor)
  • [FEATURE] ID/PK flag return_unexpected_index_query that allows QUERY output to be suppressed (#6660)
  • [FEATURE] F/great 1400/postgres constr (#6674)
  • [FEATURE] Ensure Pandas ID/PK can use named indices (#6656)
  • [FEATURE] Support to include ID/PK in validation result for each row - Spark (#6676)
  • [FEATURE] ID/PK Pandas query returned as all unexpected indices (#6692)
  • [BUGFIX] Support non-string datetime evaluation parameters (#6571)
  • [BUGFIX] Use v3.3.6 or higher of google-cloud-bigquery (with shapely bugfix) (#6590)
  • [BUGFIX] Remove rendered header from Cloud-rendering tests (#6597)
  • [BUGFIX] Patch broken Validator test after DataContext refactor (#6605)
  • [BUGFIX] Column value counts metric dtype inference due to numpy deprecation of object dtype (#6604)
  • [BUGFIX] delete_datasource() was getting passed in incorrect parameter for Spark Docs test (#6601)
  • [BUGFIX] Stop overwriting query with static string in RuntimeBatchRequests for SQL (#6614)
  • [BUGFIX] Simplify metric results processing and improve detection of Decimal types in columns (#6610)
  • [BUGFIX] Do not round output of proportion computing metrics (#6619)
  • [BUGFIX] Add sqrt on connect to sqlite database. (#6635)
  • [BUGFIX] RendererConfiguration min_value and max_value with datetimes (#6632)
  • [BUGFIX] Fix a typo in contrib queried expectation (and add type hints to its implementation) (#6650)
  • [BUGFIX] Avoid key collisions between Rule-Based Profiler terminal literals and MetricConfiguration value keys (#6675)
  • [BUGFIX] Add connect args to execution engine schema (#6663) (thanks @itaise)
  • [BUGFIX] Increase minimum numpy versions for Python 3.8 and 3.9 due to support in latest release of scipy (#6704)
  • [BUGFIX] Format current branch name properly for tag branches in docker tests (#6711)
  • [DOCS] Patch broken snippet around Validation Actions (#6606)
  • [DOCS] Fix formatting of 0.15.35 and 0.15.36 in changelogs (#6603)
  • [DOCS] Convert broken snippet to named snippets (#6611)
  • [DOCS] - add anonymous_usage_statistics configutation in documentation (#6626) (thanks @tmilitino)
  • [DOCS] fixing wrong line reference on docs (#6599) (thanks @wagneralbjr)
  • [DOCS] Sidebar changes for Integrations and how-tos (#6649)
  • [DOCS] edit term(data_conext, checkpoints)-link in with airflow (#6646) (thanks @jx2lee)
  • [DOCS] DOC-400 remove an outdated video link (#6667)
  • [DOCS] doc-356 importable prerequisite box with correct theme applied and default entries (#6666)
  • [MAINTENANCE] mypy config update (#6589)
  • [MAINTENANCE] Small refactor of ExecutionEngine.resolve_metrics() for better code readability (and miscellaneous additional clean up) (#6587)
  • [MAINTENANCE] Remove ExplorerDataContext (#6592)
  • [MAINTENANCE] Leverage RendererConfiguration in existing prescriptive templates (2 of 3) (#6488)
  • [MAINTENANCE] Leverage RendererConfiguration in existing prescriptive templates (3 of 3) (#6530)
  • [MAINTENANCE] Add docs snippet checker to dev CI (#6594)
  • [MAINTENANCE] Utilize a StrEnum for ConfigPeer modes (#6596)
  • [MAINTENANCE] Refactor BaseDataContext and DataContext into factory functions (#6531)
  • [MAINTENANCE] flake8 coverage - render, juptyer_ux, checkpoint sub-packages (#6607)
  • [MAINTENANCE] filter RemovedInMarshmallow4 warnings (#6602)
  • [MAINTENANCE] Generate public API candidates (#6600)
  • [MAINTENANCE] partial cli + usage_stats typing (#6335)
  • [MAINTENANCE] update pip installs in pipelines (#6609)
  • [MAINTENANCE] create cache as part of --ci type-checking step (#6621)
  • [MAINTENANCE] Add row_condition logic to RendererConfiguration and remove from atomic renderer implementations (#6616)
  • [MAINTENANCE] install pydantic in develop pipeline (#6624)
  • [MAINTENANCE] Fix develop static type-check stage (#6628)
  • [MAINTENANCE] Unexpected Counts table in DataDocs able to show counts for sampled values (#6634)
  • [MAINTENANCE] CI - install from requirements-types.txt (#6639)
  • [MAINTENANCE] Add docstring linter for public api to CI (#6641)
  • [MAINTENANCE] Batch ID must incorporate batch_spec_passthrough. Instantiate Validator with DataContext in test modules. Query metrics/expectations types cleanup. (#6636)
  • [MAINTENANCE] Skip postgres tests in spark. (#6643)
  • [MAINTENANCE] Enrich RendererConfiguration primitive types (#6629)
  • [MAINTENANCE] M/great 1225/async builds branch (#6644)
  • [MAINTENANCE] Comment out calling _disable_progress_bars in build_gallery.py (#6648)
  • [MAINTENANCE] Update generate_expectation_tests func to only log an ERROR message if there is an error (#6651)
  • [MAINTENANCE] Use the correct test for positive_test__exact_min_and_max on trino (#6652)
  • [MAINTENANCE] Update evaluate_json_test_v3_api func to use the debug_logger with useful info when exception occurs (#6653)
  • [MAINTENANCE] Make only column y data_alt different in col_pair_equal tests (#6661)
  • [MAINTENANCE] Add separate tests for exact stdev for redshift and snowflake (#6658)
  • [MAINTENANCE] Add redshift/snowflake casting for sample data on expect_column_values_to_be_of_type (#6659)
  • [MAINTENANCE] Add redshift/snowflake casting for sample data on expect_column_values_to_be_in_type_list (#6668)
  • [MAINTENANCE] Make only column y data_alt different in col_pair_in_set tests (#6670)
  • [MAINTENANCE] Only spark v2 for special test in not_be_in_set (#6669)
  • [MAINTENANCE] Don't attempt any regex Expectation tests with snowflake (#6672)
  • [MAINTENANCE] Clean up returns style and type hints in CardinalityChecker utility (#6677)
  • [MAINTENANCE] begin flake8 linting on tests (#6679)
  • [MAINTENANCE] Clean up packaging & installation pipeline (#6687)
  • [MAINTENANCE] Misc updates to dev Azure pipeline (#6686)
  • [MAINTENANCE] mypy typing for core/util.py (#6617)
  • [MAINTENANCE] Update get_context return type (#6684)
  • [MAINTENANCE] Get datetime tests working for trino/snowflake/spark in values_to_be_in_set (#6671)
  • [MAINTENANCE] Cleanup typing errors. (#6691)
  • [MAINTENANCE] Remove unused Metric and BatchMetric classes and consolidate ValidationMetricIdentifier with other identifiers (#6693)
  • [MAINTENANCE] Refactor BaseDataContext to leverage get_context (#6689)
  • [MAINTENANCE] expect day count to be close to equivalent week day mean (#6680) (thanks @HadasManor)
  • [MAINTENANCE] ID/PK squashed tests re-added (#6694)
  • [MAINTENANCE] initial type checking for rules_based_profiler (#6681)
  • [MAINTENANCE] Improve type checking for Expectations with atomic renderers leveraging RendererConfiguration (#6633)
  • [MAINTENANCE] Add deprecated Cloud variables to _CloudConfigurationProvider.get_values() output (#6708)
  • [MAINTENANCE] Autobuild markdown stubs (#6700)
  • [MAINTENANCE] API docs styling (#6712)

0.15.41​

  • [FEATURE] enable mostly for expect_compound_columns_to_be_unique (#6533) (thanks @kimfrie)
  • [BUGFIX] Return unique list of batch_definitions (#6579) (thanks @tanelk)
  • [BUGFIX] convert_to_json_serializable does not accept numpy datetime (#6553) (thanks @tmilitino)
  • [DOCS] Clean up misc snippet violations (#6582)
  • [MAINTENANCE] Update json schema validation on usage stats to filter based on format. (#6502)
  • [MAINTENANCE] Renaming Metric Name Suffixes using Enum Values for Better Code Readability (#6575)
  • [MAINTENANCE] M/great 1433/cloud tests to async (#6543)
  • [MAINTENANCE] Add static type checking to rule.py and rule_based_profiler_result.py (#6573)
  • [MAINTENANCE] Update most contrib Expectation docstrings to be consistent and decently formatted for gallery (#6577)
  • [MAINTENANCE] Update changelogs to reflect PyPI yanks (0.15.37-0.15.39) (#6581)
  • [MAINTENANCE] Refactor ExecutionEngine.resolve_metrics() for better code readability (#6578)
  • [MAINTENANCE] adding googletag manager to docusaurus (#6584)
  • [MAINTENANCE] typo in method name (#6585)

0.15.40​

  • [FEATURE] F/great 1397/zep checkpoints (#6525)
  • [FEATURE] Add integration test for zep sqlalchemy datasource with renderering. (#6564)
  • [BUGFIX] Patch additional deprecated call to GXCloudIdentifier.ge_cloud_id attr (#6555)
  • [BUGFIX] Patch packaging_and_installation Azure pipeline test failures (#6559)
  • [BUGFIX] Fix dependency issues to reenable RTD builds (#6560)
  • [BUGFIX] Add missing raise statement in RuntimeDataConnector logic (#6569)
  • [DOCS] doc 383: bring sql datasource configuration examples under test (#6466)
  • [MAINTENANCE] Add error handling to docs snippet checker (#6556)
  • [MAINTENANCE] ID/PK tests at Checkpoint-level (#6539)
  • [MAINTENANCE] Improve DataAssistant Parameter Builder Naming/Sanitization Mechanism and Enhance TableDomainBuilder (#6554)
  • [MAINTENANCE] Simplify computational graph assembly from metric configurations (#6563)
  • [MAINTENANCE] RTD Mobile header brand adjustment (#6557)
  • [MAINTENANCE] Use MetricsCalculator methods for ValidationGraph construction and resolution operations in Validator (#6566)
  • [MAINTENANCE] Cast type in execution_environment.py to bypass flaky mypy warnings (#6572)
  • [MAINTENANCE] Additional patch for mypy issue in execution_environment.py (#6574)
  • [MAINTENANCE] Clean up GX rename artifacts (#6561)
  • [CONTRIB] fix observed value in custom expectation (#6515) (thanks @itaise)

0.15.39 - YANKED​

  • [BUGFIX] Patch faulty GX Cloud arg resolution logic (#6542)
  • [BUGFIX] Fix resolution of cloud variables. (#6546)
  • [DOCS] Fix line numbers in snippets part 2 (#6537)
  • [DOCS] Convert nested snippets to named snippets (#6541)
  • [DOCS] Simplify snippet checker logic to catch stray tags in CI (#6538)
  • [MAINTENANCE] v2 Docs link (#6534)
  • [MAINTENANCE] Fix logic around cloud_mode and ge_cloud_mode. (#6550)

0.15.38 - YANKED​

  • [BUGFIX] Patch broken Cloud E2E test around Datasource CRUD (#6520)
  • [BUGFIX] Patch outdated ge_cloud_id attribute call in ValidationOperator (#6529)
  • [BUGFIX] Revert refactor to Datasource instantiation logic in DataContext (#6535)
  • [BUGFIX] Patch faulty GX Cloud arg resolution logic (#6542)
  • [DOCS] Fix line numbers in snippets (#6536)
  • [DOCS] Fix line numbers in snippets part 2 (#6537)
  • [DOCS] Convert nested snippets to named snippets (#6541)
  • [MAINTENANCE] Update Data Assistant plot images (#6521)
  • [MAINTENANCE] Clean up type hints and make test generation more elegant (#6523)
  • [MAINTENANCE] Clean up Datasource instantiation logic in DataContext (#6517)
  • [MAINTENANCE] Update Domain computation in MetricConfiguration (#6528)
  • [MAINTENANCE] v2 Docs link (#6534)

0.15.37 - YANKED​

  • [FEATURE] Support to include ID/PK in validation result for each row - SQL (#6448)
  • [FEATURE] Build process and example API docs (part 1) (#6474)
  • [FEATURE] Add temp_table_schema_name support for BigQuery (#6303) (thanks @BobbyRyterski)
  • [FEATURE] Decorators for API docs (part 2) (#6497)
  • [FEATURE] Decorators for API docs (part 3) (#6504)
  • [BUGFIX] Support slack channel name with webhook also (#6481) (thanks @Kozehh)
  • [BUGFIX] Airflow operator package conflict for jsonschema (#6495)
  • [BUGFIX] Validator uses proper arguments to show progress bar at Metrics resolution-level (#6510) (thanks @tommy-watts-depop)
  • [DOCS] Schedule Algolia Crawler daily at midnight (#6323)
  • [DOCS] fix(gh-6512): fix rendering of Batch definition (#6513) (thanks @JoelGritter)
  • [MAINTENANCE] Add pretty representations for zep pydantic models (#6472)
  • [MAINTENANCE] Misc updates to PR template (#6479)
  • [MAINTENANCE] Minor cleanup for better code readability (#6478)
  • [MAINTENANCE] Move zep method from datasource to data asset. (#6477)
  • [MAINTENANCE] Staging for build gallery (#6480)
  • [MAINTENANCE] Reformat core expectation docstrings (#6423)
  • [MAINTENANCE] Move "Domain" to "great_expectations/core" to avoid circular imports; also add MetricConfiguration tests; and other clean up. (#6484)
  • [MAINTENANCE] Query the database for datetime column splitter defaults (#6482)
  • [MAINTENANCE] Placing metrics test db under try-except (#6489)
  • [MAINTENANCE] Clean up tests for more formal Batch and Validator instantiation (#6491)
  • [MAINTENANCE] Rename ge to gx across the codebase (#6487)
  • [MAINTENANCE] Upgrade CodeSee workflow to version 2 (#6498) (thanks @codesee-maps[bot])
  • [MAINTENANCE] Rename GE to GX across codebase (GREAT-1352) (#6494)
  • [MAINTENANCE] Resolve mypy issues in cli/docs.py (#6500)
  • [MAINTENANCE] Increase timeout to 15 minutes for the 2 jobs in manual-staging-json-to-prod pipeline (#6509)
  • [MAINTENANCE] Update Data Assistant plot color scheme and fonts (#6496)
  • [MAINTENANCE] Update RendererConfiguration to pydantic model (#6452)
  • [MAINTENANCE] Message for how to install Great Expectations in Cloud Composer by pinning packages (#6492)
  • [MAINTENANCE] Leverage RendererConfiguration in existing prescriptive templates (1 of 3) (#6460)
  • [MAINTENANCE] Clean up teams.yml (#6511)
  • [MAINTENANCE] Make Generated Integration Tests More Robust Using BatchDefinition and InMemoryDataContext In Validator and ExecutionEngine Instantiation (#6505)
  • [MAINTENANCE] DO NOT MERGE UNTIL DEC 8: [MAINTENANCE] Brand changes in docs (#6427)
  • [MAINTENANCE] fixed typo in nav (#6518)
  • [MAINTENANCE] Clean up GX Cloud environment variable usage (GREAT-1352) (#6501)
  • [MAINTENANCE] Update Data Assistant plot images (#6521)
  • [CONTRIB] Add uniqueness expectation (#6473) (thanks @itaise)

0.15.36​

  • [BUGFIX] Contrib Expectation tracebacks (#6471)
  • [BUGFIX] Add additional error checking to ExpectationAnonymizer (#6467)
  • [MAINTENANCE] Add docstring for context.sources.add_postgres (#6459)
  • [MAINTENANCE] fixing type hints in metrics utils module (#6469)
  • [MAINTENANCE] Moving tutorials to great-expectations repo (#6464)

0.15.35​

  • [FEATURE] add multiple input metric (#6373) (thanks @CarstenFrommhold)
  • [FEATURE] add multiple column metric (#6372) (thanks @CarstenFrommhold)
  • [FEATURE]: DataProfilerUnstructuredDataAssistant Integration (#6400) (thanks @micdavis)
  • [FEATURE] add new metric - query template values (#5994) (thanks @itaise)
  • [FEATURE] ZEP Config serialize as YAML (#6398)
  • [BUGFIX] Patch issue with call to ExpectationAnonymizer to ensure DataContext init events are captured (#6458)
  • [BUGFIX] Support Table and Column Names Case Non-Sensitivity Relationship Between Snowflake, Oracle, DB2, etc. DBMSs (Upper Case) and SQLAlchemy (Lower Case) Representations (#6450)
  • [BUGFIX] Metrics return value no longer returns None for unexpected_index_list - Sql and Spark (#6392)
  • [BUGFIX] Fix for mssql tests that depend on datetime to string conversion (#6449)
  • [BUGFIX] issue-4295-fix-issue (#6164) (thanks @YevgeniyaLee)
  • [BUGFIX] updated capitalone setup.py file (#6410) (thanks @micdavis)
  • [BUGFIX] Patch key-generation issue with DataContext.save_profiler() (#6405)
  • [DOCS] add configuration of anonymous_usage_statistics for documentation (#6293) (thanks @milithino)
  • [DOCS] add boto3 explanations on document (#6407) (thanks @tiruka)
  • [MAINTENANCE][CONTRIB] Multicolumns sum equal to single column (#6446) (thanks @asafla)
  • [MAINTENANCE][CONTRIB] add expectation - check gaps in SCD tables (#6433) (thanks @itaise)
  • [MAINTENANCE][CONTRIB] Add no days missing expectation (#6432) (thanks @itaise)
  • [MAINTENANCE][CONTRIB] Feature/add two tables expectation (#6429) (thanks @itaise)
  • [MAINTENANCE][CONTRIB] Add number of unique values expectation (#6425) (thanks @itaise)
  • [MAINTENANCE] Add sorters to zep postgres datasource. (#6456)
  • [MAINTENANCE] Bump ubuntu version in CI (#6457)
  • [MAINTENANCE] Remove anticipatory multi-language support from renderers (#6426)
  • [MAINTENANCE] Remove yaml user_flow_scripts (#6454)
  • [MAINTENANCE] Additional sqlite database fixture for taxi_data - All 2020 data in single table (#6455)
  • [MAINTENANCE] Clean Up Variable Names In Test Modules, Type Hints, and Minor Refactoring For Better Code Elegance/Readability (#6444)
  • [MAINTENANCE] Update and Simplify Pandas tests for MapMetrics (#6443)
  • [MAINTENANCE] Add metadata to experimental datasource Batch class (#6442)
  • [MAINTENANCE] Small refactor (#6422)
  • [MAINTENANCE] Sorting batch IDs and typehints clean up (#6421)
  • [MAINTENANCE] Clean Up Type Hints and Minor Refactoring For Better Code Elegance/Readability (#6418)
  • [MAINTENANCE] Implement RendererConfiguration (#6412)
  • [MAINTENANCE] Cleanup For Better Code Elegance/Readability (#6406)
  • [MAINTENANCE] ZEP - GxConfig cleanup (#6404)
  • [MAINTENANCE] Migrate remaining methods from BaseDataContext (#6403)
  • [MAINTENANCE] Migrate additional CRUD methods from BaseDataContext to AbstractDataContext (#6395)
  • [MAINTENANCE] ZEP add yaml methods to all experimental models (#6401)
  • [MAINTENANCE] Remove call to verify_library_dependent_modules for pybigquery (#6394)
  • [MAINTENANCE] Make "IDDict.to_id()" serialization more efficient. (#6389)

0.15.34​

  • [BUGFIX] Ensure packaging_and_installation CI tests against latest tag (#6386)
  • [BUGFIX] Fixed missing comma in pydantic constraints (#6391) (thanks @awburgess)
  • [BUGFIX] fix pydantic dev req file entries (#6396)
  • [DOCS] DOC-379 bring spark datasource configuration example scripts under test (#6362)
  • [MAINTENANCE] Handle both ExpectationConfiguration and ExpectationValidationResult in default Atomic renderers and cleanup include_column_name (#6380)
  • [MAINTENANCE] Add type annotations to all existing atomic renderer signatures (#6385)
  • [MAINTENANCE] move zep -> experimental package (#6378)
  • [MAINTENANCE] Migrate additional methods from BaseDataContext to other parts of context hierarchy (#6388)

0.15.33​

  • [FEATURE] POC ZEP Config Loading (#6320)
  • [BUGFIX] Fix issue with misaligned indentation in docs snippets (#6339)
  • [BUGFIX] Use requirements.txt file when installing linting/static check dependencies in CI (#6368)
  • [BUGFIX] Patch nested snippet indentation issues within remark-named-snippets plugin (#6376)
  • [BUGFIX] Ensure packaging_and_installation CI tests against latest tag (#6386)
  • [DOCS] DOC-308 update CLI command in docs when working with RBPs instead of Data Assistants (#6222)
  • [DOCS] DOC-366 updates to docs in support of branding updates (#5766)
  • [DOCS] Add yarn snippet-check command (#6351)
  • [MAINTENANCE] Add missing one-line docstrings and try to make the others consistent (#6340)
  • [MAINTENANCE] Refactor variable aggregation/substitution logic into ConfigurationProvider hierarchy (#6321)
  • [MAINTENANCE] In ExecutionEngine: Make variable names and usage more descriptive of their purpose. (#6342)
  • [MAINTENANCE] Move Cloud-specific enums to cloud_constants.py (#6349)
  • [MAINTENANCE] Refactor out termcolor dependency (#6348)
  • [MAINTENANCE] Zep PostgresDatasource returns a list of batches. (#6341)
  • [MAINTENANCE] Refactor usage_stats_opt_out method in DataContext (#5339)
  • [MAINTENANCE] Fix computed metrics type hint in ExecutionEngine.resolve_metrics() method (#6347)
  • [MAINTENANCE] Subject: Support to include ID/PK in validation result for each row t… (#5876) (thanks @abekfenn)
  • [MAINTENANCE] Pin mypy to 0.990 (#6361)
  • [MAINTENANCE] Misc cleanup of GX Cloud helpers (#6352)
  • [MAINTENANCE] Update column_reflection_fallback to also use schema name for Trino (#6350)
  • [MAINTENANCE] Bump version of mypy in contrib CLI (#6370)
  • [MAINTENANCE] Move config variable substitution logic into ConfigurationProvider (#6345)
  • [MAINTENANCE] Removes comment in code that was causing confusion to some users. (#6366)
  • [MAINTENANCE] minor metrics typing (#6374)
  • [MAINTENANCE] Make ConfigurationProvider and ConfigurationSubstitutor private (#6375)
  • [MAINTENANCE] Rename GeCloudStoreBackend to GXCloudStoreBackend (#6377)
  • [MAINTENANCE] Cleanup Metrics and ExecutionEngine methods (#6371)
  • [MAINTENANCE] F/great 1314/integrate zep in core (#6358)
  • [MAINTENANCE] Loosen pydantic version requirement (#6384)

0.15.32​

  • [BUGFIX] Patch broken CloudNotificationAction tests (#6327)
  • [BUGFIX] add create_temp_table flag to ExecutionEngineConfigSchema (#6331) (thanks @tommy-watts-depop)
  • [BUGFIX] MapMetrics now return partial_unexpected values for SUMMARY format (#6334)
  • [DOCS] Re-writes "how to implement custom notifications" as "How to get Data Docs URLs for use in custom Validation Actions" (#6281)
  • [DOCS] Removes deprecated expectation notebook exploration doc (#6298)
  • [DOCS] Removes a number of unused & deprecated docs (#6300)
  • [DOCS] Prioritizes Onboarding Data Assistant in ToC (#6302)
  • [DOCS] Add ZenML into integration table in Readme (#6144) (thanks @dnth)
  • [DOCS] add pypi release badge (#6324)
  • [MAINTENANCE] Remove unneeded BaseDataContext.get_batch_list (#6291)
  • [MAINTENANCE] Clean up implicit Optional errors flagged by mypy (#6319)
  • [MAINTENANCE] Add manual prod flags to core Expectations (#6278)
  • [MAINTENANCE] Fallback to isnot method if is_not is not available (old sqlalchemy) (#6318)
  • [MAINTENANCE] Add ZEP postgres datasource. (#6274)
  • [MAINTENANCE] Delete "metric_dependencies" from MetricConfiguration constructor arguments (#6305)
  • [MAINTENANCE] Clean up DataContext (#6304)
  • [MAINTENANCE] Deprecate save_changes flag on Datasource CRUD (#6258)
  • [MAINTENANCE] Deprecate great_expectations.render.types package (#6315)
  • [MAINTENANCE] Update range of allowable sqlalchemy versions (#6328)
  • [MAINTENANCE] Fixing checkpoint types (#6325)
  • [MAINTENANCE] Fix column_reflection_fallback for Trino and minor logging/testing improvements (#6218)
  • [MAINTENANCE] Change the number of expected Expectations in the 'quick check' stage of build_gallery pipeline (#6333)

0.15.31​

  • [BUGFIX] Include all requirement files in the sdist (#6292) (thanks @xhochy)
  • [DOCS] Updates outdated batch_request snippet in Terms (#6283)
  • [DOCS] Update Conditional Expectations doc w/ current availability (#6279)
  • [DOCS] Remove outdated Data Discovery page and all references (#6288)
  • [DOCS] Remove reference/evaluation_parameters page and all references (#6294)
  • [DOCS] Removing deprecated Custom Metrics doc (#6282)
  • [DOCS] Re-writes "how to implement custom notifications" as "How to get Data Docs URLs for use in custom Validation Actions" (#6281)
  • [DOCS] Removes deprecated expectation notebook exploration doc (#6298)
  • [MAINTENANCE] Move RuleState into rule directory. (#6284)

0.15.30​

  • [FEATURE] Add zep datasources to data context. (#6255)
  • [BUGFIX] Iterate through GeCloudIdentifiers to find the suite ID from the name (#6243)
  • [BUGFIX] Update default base url for cloud API (#6176)
  • [BUGFIX] Pin termcolor to below 2.1.0 due to breaking changes in lib's TTY parsing logic (#6257)
  • [BUGFIX] InferredAssetSqlDataConnector include_schema_name introspection of identical table names in different schemas (#6166)
  • [BUGFIX] Fixdocs-integration tests, and temporarily pin sqlalchemy (#6268)
  • [BUGFIX] Fix serialization for contrib packages (#6266)
  • [BUGFIX] Ensure that Datasource credentials are not persisted to Cloud/disk (#6254)
  • [DOCS] Updates package contribution references (#5885)
  • [MAINTENANCE] Maintenance/great 1103/great 1318/alexsherstinsky/validation graph/refactor validation graph usage 2022 10 20 248 (#6228)
  • [MAINTENANCE] Refactor instances of noqa: F821 Flake8 directive (#6220)
  • [MAINTENANCE] Logo URI ref in data_docs (#6246)
  • [MAINTENANCE] fix typos in docstrings (#6247)
  • [MAINTENANCE] Isolate Trino/MSSQL/MySQL tests in dev CI (#6231)
  • [MAINTENANCE] Split up compatability and comprehensive stages in dev CI to improve performance (#6245)
  • [MAINTENANCE] ZEP POC - Asset Type Registration (#6194)
  • [MAINTENANCE] Add Trino CLI support and bump Trino version (#6215) (thanks @hovaesco)
  • [MAINTENANCE] Delete unneeded Rule attribute property (#6264)
  • [MAINTENANCE] Small clean-up of Marshmallow warnings (missing parameter changed to load_default as of 3.13) (#6213)
  • [MAINTENANCE] Move .png files out of project root (#6249)
  • [MAINTENANCE] Cleanup expectation.py attributes (#6265)
  • [MAINTENANCE] Further parallelize test runs in dev CI (#6267)
  • [MAINTENANCE] GCP Integration Pipeline fix (#6259)
  • [MAINTENANCE] mypy warn_unused_ignores (#6270)
  • [MAINTENANCE] ZEP - Data Source base class (#6263)
  • [MAINTENANCE] Reverting marshmallow version bump (#6271)
  • [MAINTENANCE] type hints cleanup in Rule-Based Profiler (#6272)
  • [MAINTENANCE] Remove unused f-strings (#6248)
  • [MAINTENANCE] Make ParameterBuilder.resolve_evaluation_dependencies() into instance (rather than utility) method (#6273)
  • [MAINTENANCE] Test definition for ExpectColumnValueZScoresToBeLessThan (#6229)
  • [MAINTENANCE] Make RuleState constructor argument ordering consistent with standard pattern. (#6275)
  • [MAINTENANCE][REQUEST] Please allow Rachel to unblock blockers (#6253)

0.15.29​

  • [FEATURE] Add support to AWS Glue Data Catalog (#5123) (thanks @lccasagrande)
  • [FEATURE] / Added pairwise expectation 'expect_column_pair_values_to_be_in_set' (#6097) (thanks @Arnavkar)
  • [BUGFIX] Adjust condition in RenderedAtomicValueSchema.clean_null_attrs (#6168)
  • [BUGFIX] Add py to dev dependencies to circumvent compatability issues with pytest==7.2.0 (#6202)
  • [BUGFIX] Fix test_package_dependencies.py to include py lib (#6204)
  • [BUGFIX] Fix logic in ExpectationDiagnostics._check_renderer_methods method (#6208)
  • [BUGFIX] Patch issue with empty config variables file raising TypeError (#6216)
  • [BUGFIX] Release patch for Azure env vars (#6233)
  • [BUGFIX] Cloud Data Context should overwrite existing suites based on ge_cloud_id instead of name (#6234)
  • [BUGFIX] Add env vars to Pytest min versions Azure stage (#6239)
  • [DOCS] doc-297: update the create Expectations overview page for Data Assistants (#6212)
  • [DOCS] DOC-378: bring example scripts for pandas configuration guide under test (#6141)
  • [MAINTENANCE] Add unit test for MetricsCalculator.get_metric() Method -- as an example template (#6179)
  • [MAINTENANCE] ZEP MetaDatasource POC (#6178)
  • [MAINTENANCE] Update scope_check in Azure CI to trigger on changed .py source code files (#6185)
  • [MAINTENANCE] Move test_yaml_config to a separate class (#5487)
  • [MAINTENANCE] Changed profiler to Data Assistant in CLI, docs, and tests (#6189)
  • [MAINTENANCE] Update default GE_USAGE_STATISTICS_URL in test docker image. (#6192)
  • [MAINTENANCE] Re-add a renamed test definition file (#6182)
  • [MAINTENANCE] Refactor method parse_evaluation_parameter (#6191)
  • [MAINTENANCE] Migrate methods from BaseDataContext to AbstractDataContext (#6188)
  • [MAINTENANCE] Rename cfe to v3_api (#6190)
  • [MAINTENANCE] Test Trino doc examples with test_script_runner.py (#6198)
  • [MAINTENANCE] Cleanup of Regex ParameterBuilder (#6196)
  • [MAINTENANCE] Apply static type checking to expectation.py (#6173)
  • [MAINTENANCE] Remove version matrix from dev CI pipeline to improve performance (#6203)
  • [MAINTENANCE] Rename CloudMigrator.retry_unsuccessful_validations (#6206)
  • [MAINTENANCE] Add validate_configuration method to expect_table_row_count_to_equal_other_table (#6209)
  • [MAINTENANCE] Replace deprecated iteritems with items (#6205)
  • [MAINTENANCE] Add instructions for setting up the test_ci database (#6211)
  • [MAINTENANCE] Add E2E tests for Cloud-backed Datasource CRUD (#6186)
  • [MAINTENANCE] Execution Engine linting & partial typing (#6210)
  • [MAINTENANCE] Test definition for ExpectColumnValuesToBeJsonParsable, including a fix for Spark (#6207)
  • [MAINTENANCE] Port over usage statistics enabled methods from BaseDataContext to AbstractDataContext (#6201)
  • [MAINTENANCE] Remove temporary dependency on py (#6217)
  • [MAINTENANCE] Adding type hints to DataAssistant implementations (#6224)
  • [MAINTENANCE] Remove AWS config file dependencies and use existing env vars in CI/CD (#6227)
  • [MAINTENANCE] Make UsageStatsEvents a StrEnum (#6225)
  • [MAINTENANCE] Move all requirements-dev*.txt files to separate dir (#6223)
  • [MAINTENANCE] Maintenance/great 1103/great 1318/alexsherstinsky/validation graph/refactor validation graph usage 2022 10 20 248 (#6228)

0.15.28​

  • [FEATURE] Initial zep datasource protocol. (#6153)
  • [FEATURE] Introduce BatchManager to manage Batch objects used by Validator and BatchData used by ExecutionEngine (#6156)
  • [FEATURE] Add support for Vertica dialect (#6145) (thanks @viplazylmht)
  • [FEATURE] Introduce MetricsCalculator and Refactor Redundant Code out of Validator (#6165)
  • [BUGFIX] SQLAlchemy selectable Bug fix (#6159) (thanks @tommy-watts-depop)
  • [BUGFIX] Parameterize usage stats endpoint in test dockerfile. (