dlt.sources.sql_database.helpers
SQL database source helpers
unwrap_json_connector_x
def unwrap_json_connector_x(field: str) -> TDataItem
Creates a transform function to be added with add_map that will unwrap JSON columns
ingested via connectorx. Such columns are additionally quoted and translate SQL NULL to json "null"
remove_nullability_adapter
def remove_nullability_adapter(table: Table) -> Table
A table adapter that removes nullability from columns.
SqlTableResourceConfiguration Objects
@configspec
class SqlTableResourceConfiguration(BaseConfiguration)
incremental
type: ignore[type-arg]
default_engine_adapter_callback
def default_engine_adapter_callback(engine: Engine,
metadata: MetaData) -> None
Applies default engine adaptations for known dialects.
For Oracle dialect, registers an event listener on the provided MetaData that forces NUMBER columns to be reflected as Python Decimal to preserve numeric precision.
Arguments:
engine- The SQLAlchemy engine to check dialect for.metadata- The MetaData instance to register the listener on.