InferredAssetDBFSDataConnector
- class great_expectations.datasource.data_connector.InferredAssetDBFSDataConnector(name: str, datasource_name: str, base_directory: str, execution_engine: great_expectations.execution_engine.execution_engine.ExecutionEngine, default_regex: Optional[dict] = None, glob_directive: str = '*', sorters: Optional[list] = None, batch_spec_passthrough: Optional[dict] = None, id: Optional[str] = None)#
-
An Inferred Asset Data Connector used to connect to data on a DBFS filesystem.
- Parameters:
-
-
name – The name of the Data Connector.
-
datasource_name – The name of this Data Connector’s Datasource.
-
base_directory – The directory from which the Data Connector should read files.
-
execution_engine – The Execution Engine object to used by this Data Connector to read the data.
-
default_regex – A regex configuration for filtering data references.
-
glob_directive – A glob pattern for selecting files in directory.
-
sorters – A list of sorters for sorting data references.
-
batch_spec_passthrough – Dictionary with keys that will be added directly to the batch spec.
-
id – The unique identifier for this Data Connector used when running in cloud mode.
-
- get_available_data_asset_names() List[str] #
-
Return the list of asset names known by this DataConnector
- Returns:
-
A list of available names