destinations.impl.lancedb.utils
generate_uuid
def generate_uuid(data: DictStrAny, unique_identifiers: Sequence[str],
table_name: str) -> str
Generates deterministic UUID - used for deduplication.
Arguments:
data
Dict[str, Any] - Arbitrary data to generate UUID for.unique_identifiers
Sequence[str] - A list of unique identifiers.table_name
str - LanceDB table name.
Returns:
str
- A string representation of the generated UUID.
list_merge_identifiers
def list_merge_identifiers(table_schema: TTableSchema) -> Sequence[str]
Returns a list of merge keys for a table used for either merging or deduplication.
Arguments:
table_schema
TTableSchema - a dlt table schema.
Returns:
Sequence[str]
- A list of unique column identifiers.