Skip to main content
Version: 1.3.0 (latest)

common.destination.utils

verify_schema_capabilities

def verify_schema_capabilities(schema: Schema,
capabilities: DestinationCapabilitiesContext,
destination_type: str,
warnings: bool = True) -> List[Exception]

[view_source]

Verifies load_tables that have all hints filled by job client before loading against capabilities. Returns a list of exceptions representing critical problems with the schema. It will log warnings by default. It is up to the caller to eventually raise exception

  • Checks all table and column name lengths against destination capabilities and raises on too long identifiers
  • Checks if schema has collisions due to case sensitivity of the identifiers

column_type_to_str

def column_type_to_str(column: TColumnType) -> str

[view_source]

Converts column type to db-like type string

resolve_merge_strategy

@with_config
def resolve_merge_strategy(
tables: TSchemaTables,
table: TTableSchema,
destination_capabilities: Optional[
DestinationCapabilitiesContext] = ConfigValue
) -> Optional[TLoaderMergeStrategy]

[view_source]

Resolve merge strategy for a table, possibly resolving the 'x-merge-strategy from a table chain. strategies selector in destination_capabilities is used if present. If table does not contain strategy hint, a default value will be used which is the first.

destination_capabilities are injected from context if not explicitly passed.

Returns None if table write disposition is not merge

This demo works on codespaces. Codespaces is a development environment available for free to anyone with a Github account. You'll be asked to fork the demo repository and from there the README guides you with further steps.
The demo uses the Continue VSCode extension.

Off to codespaces!

DHelp

Ask a question

Welcome to "Codex Central", your next-gen help center, driven by OpenAI's GPT-4 model. It's more than just a forum or a FAQ hub – it's a dynamic knowledge base where coders can find AI-assisted solutions to their pressing problems. With GPT-4's powerful comprehension and predictive abilities, Codex Central provides instantaneous issue resolution, insightful debugging, and personalized guidance. Get your code running smoothly with the unparalleled support at Codex Central - coding help reimagined with AI prowess.