destinations.impl.lancedb.lancedb_adapter

lancedb_adapter

def lancedb_adapter(data: Any,
                    embed: TColumnNames = None,
                    merge_key: TColumnNames = None,
                    no_remove_orphans: bool = False) -> DltResource

[view_source]

Prepares data for the LanceDB destination by specifying which columns should be embedded.

Arguments:

• data Any - The data to be transformed. It can be raw data or an instance of DltResource. If raw data, the function wraps it into a DltResource object.
• embed TColumnNames, optional - Specify columns to generate embeddings for. It can be a single column name as a string, or a list of column names.
• merge_key TColumnNames, optional - Specify columns to merge on. It can be a single column name as a string, or a list of column names.
• no_remove_orphans bool - Specify whether to remove orphaned records in child tables with no parent records after merges to maintain referential integrity.

Returns:

• DltResource - A resource with applied LanceDB-specific hints.

Raises:

• ValueError - If input for embed invalid or empty.

Examples:

    data = [{"name": "Marcel", "description": "Moonbase Engineer"}]
    lancedb_adapter(data, embed="description")

[DltResource with hints applied]