Datasources
Models
OCFDatasource
Individual list item returned in the response of the function get_ocf_datasources
that represents a data source in Alation.
Attributes:
Name | Type | Description |
---|---|---|
uri | str | Jdbc uri for connecting to datasources. Please ensure you either give host, port or just uri parameter. Please do not enter both the parameters. |
connector_id | int | The OCF conector’s id that we want to create datasource with. |
db_username | str | The service account username. |
title | str | The title of the datasource. |
description | str | The description of the datasource. |
private | bool | Boolean flag determining if the datasource is private. Defaults to False. |
is_hidden | bool | Boolean flag determining if the datasource is hidden. Defaults to False. |
id | int | Unique identifier of the datasource. INTERNAL |
supports_explain | bool | INTERNAL |
data_upload_disabled_message | bool | INTERNAL |
is_gone | bool | INTERNAL |
supports_qli_diagnostics | bool | INTERNAL |
latest_extraction_time | str | INTERNAL |
negative_filter_words | list[str] | INTERNAL |
can_data_upload | bool | INTERNAL |
qualified_name | str | INTERNAL |
all_schemas | str | INTERNAL |
has_previewable_qli | bool | INTERNAL |
supports_qli_daterange | bool | INTERNAL |
latest_extraction_successful | bool | INTERNAL |
owner_ids | list[int] | INTERNAL |
favorited_by_list | bool | INTERNAL |
supports_compose | bool | INTERNAL |
enable_designated_credential | bool | INTERNAL |
deleted | bool | INTERNAL |
limit_schemas | str | INTERNAL |
obfuscate_literals | list[str] | INTERNAL |
remove_filtered_schemas | bool | INTERNAL |
profiling_tip | str | INTERNAL |
supports_profiling | str | INTERNAL |
icon | str | INTERNAL |
url | str | INTERNAL |
otype | str | INTERNAL |
exclude_schemas | str | Schemas to exclude in MDE |
exclude_additional_columns_in_qli | bool | INTERNAL |
can_toggle_ds_privacy | bool | INTERNAL |
supports_md_diagnostics | bool | INTERNAL |
supports_ocf_query_service_api | bool | INTERNAL |
uses_ocf_agent | bool | INTERNAL |
nosql_mde_sample_size | int | INTERNAL |
disable_auto_extraction | bool | INTERNAL |
unresolved_mention_fingerprint_method | bool | INTERNAL |
enable_default_schema_extraction | bool | INTERNAL |
enabled_in_compose | bool | INTERNAL |
builtin_datasource | str | INTERNAL |
cron_extraction | str | INTERNAL |
supports_default_schema_extraction | bool | INTERNAL |
OCFDatasourceParams
Optional item used to filter the response of the returned data from the function get_ocf_datasources
.
Attributes:
Name | Type | Description |
---|---|---|
include_hidden | bool | Specifies if hidden datasources should be included in retrieved list. Hidden data sources are not visible in the UI. These are the data sources created via the API with the is_hidden property set to True. There is no UI for the Settings page of such sources and they can only be accessed through the API. |
NativeDatasource
Individual list item returned in the response of the function get_native_datasources
that represents a data source in Alation.
Attributes:
Name | Type | Description |
---|---|---|
dbtype | str | The database type. Currently the certified types are mysql, oracle, postgresql, sqlserver, redshift, teradata and snowflake. |
host | str | The host of the datasource. Note: Not required if is_virtual == True or if the ‘uri’ parameter is provided. |
port | int | The port of the datasource. Note: Not required if is_virtual == True or if the ‘uri’ parameter is provided. |
uri | str | Jdbc uri for connecting to datasources. Please ensure you either give host, port or just uri parameter. Please do not enter both the parameters. |
dbname | str | The database name of the datasource. Note: Mandatory for Oracle (service name is dbname), Redshift and Postgresql datasource. |
db_username | str | The service account username. Note: Not required if deployment_setup_complete == False or is_virtual == True. |
title | str | The title of the datasource. Note: Not required if deployment_setup_complete == False. |
description | str | The description of the datasource. |
deployment_setup_complete | bool | Boolean flag determining if the deployment setup is complete. When set to true, complete datasource information is required, else, only partial information is required. Defaults to True. |
private | bool | Boolean flag determining if the datasource is private. Defaults to False. |
is_virtual | bool | Boolean flag determining if the datasource is virtual. Defaults to False. |
is_hidden | bool | Boolean flag determining if the datasource is hidden. Defaults to False. |
id | int | Unique identifier of the datasource. INTERNAL |
supports_explain | bool | INTERNAL |
data_upload_disabled_message | str | INTERNAL |
hive_logs_source_type | int | Hive related |
metastore_uri | bool | Hive related |
is_hive | bool | INTERNAL |
is_gone | bool | INTERNAL |
webhdfs_server | str | Hive related |
supports_qli_diagnostics | bool | INTERNAL |
is_presto_hive | bool | Presto related |
latest_extraction_time | str | INTERNAL |
negative_filter_words | list[str] | INTERNAL |
has_hdfs_based_qli | bool | Hive related |
can_data_upload | bool | INTERNAL |
qualified_name | str | INTERNAL |
all_schemas | str | INTERNAL |
has_previewable_qli | bool | INTERNAL |
hive_tez_logs_source | str | Hive related |
has_metastore_uri | bool | Hive related |
webhdfs_port | int | Hive related |
supports_qli_daterange | bool | INTERNAL |
latest_extraction_successful | bool | INTERNAL |
owner_ids | list[int] | INTERNAL |
favorited_by_list | bool | INTERNAL |
supports_compose | bool | INTERNAL |
hive_logs_source | str | Hive related |
enable_designated_credential | bool | INTERNAL |
deleted | bool | INTERNAL |
limit_schemas | str | Schemas to limit in MDE |
obfuscate_literals | list[str] | INTERNAL |
remove_filtered_schemas | bool | INTERNAL |
profiling_tip | str | INTERNAL |
supports_profiling | bool | INTERNAL |
webhdfs_username | str | Hive related |
icon | str | INTERNAL |
url | str | INTERNAL |
otype | str | INTERNAL |
exclude_schemas | str | Schemas to exclude in MDE |
qli_aws_region | str | Hive related |
has_aws_glue_metastore | bool | Hive related |
exclude_additional_columns_in_qli | bool | INTERNAL |
can_toggle_ds_privacy | bool | INTERNAL |
aws_region | str | Hive related |
aws_access_key_id | str | Hive related |
supports_md_diagnostics | bool | INTERNAL |
nosql_mde_sample_size | int | INTERNAL |
disable_auto_extraction | bool | INTERNAL |
metastore_type | str | Hive related |
unresolved_mention_fingerprint_method | str | INTERNAL |
qli_hive_connection_source | str | Hive related |
compose_oauth_enabled | bool | Snowflake and Databricks related |
enable_default_schema_extraction | bool | INTERNAL |
enabled_in_compose | bool | INTERNAL |
builtin_datasource | str | INTERNAL |
has_aws_s3_based_qli | bool | Hive related |
qli_aws_access_key_id | str | Hive related |
jdbc_driver | str | INTERNAL |
cron_extraction | str | INTERNAL |
supports_default_schema_extraction | bool | INTERNAL |
NativeDatasourceParams
Optional item used to filter the response of the returned data from the function get_native_datasources
.
Attributes:
Name | Type | Description |
---|---|---|
include_undeployed | bool | Specifies if undeployed datasources should be included in retrieved list. Undeployed data sources are the ones whose configurations and deployment setup is not complete. Admins cannot trigger metadata extraction on undeployed data sources. |
include_hidden | bool | Specifies if hidden datasources should be included in retrieved list. Hidden data sources are not visible in the UI. These are the data sources created via the API with the is_hidden property set to True. There is no UI for the Settings page of such sources and they can only be accessed through the API. |
Methods
get_ocf_datasources
get_ocf_datasources(self, query_params:OCFDatasourceParams = None) -> list:
Query multiple Alation OCF Data Sources and return their details.
Args:
- query_params (
OCFDatasourceParams
): REST API OCF Datasource Query Parameters. Returns: - list: Alation OCF Data Sources
get_native_datasources
get_native_datasources(self, query_params:NativeDatasourceParams = None) -> list:
Query multiple Alation Native Data Sources and return their details.
Args:
- query_params (
NativeDatasourceParams
): REST API Native Datasource Query Parameters. Returns: - list: Alation Native Data Sources