destinations.impl.lancedb.lancedb_adapter
lancedb_adapter
def lancedb_adapter(data: Any,
embed: TColumnNames = None,
merge_key: TColumnNames = None,
no_remove_orphans: bool = False) -> DltResource
Prepares data for the LanceDB destination by specifying which columns should be embedded.
Arguments:
data
Any - The data to be transformed. It can be raw data or an instance of DltResource. If raw data, the function wraps it into a DltResource object.embed
TColumnNames, optional - Specify columns to generate embeddings for. It can be a single column name as a string, or a list of column names.merge_key
TColumnNames, optional - Specify columns to merge on. It can be a single column name as a string, or a list of column names.no_remove_orphans
bool - Specify whether to remove orphaned records in child tables with no parent records after merges to maintain referential integrity.
Returns:
DltResource
- A resource with applied LanceDB-specific hints.
Raises:
ValueError
- If input forembed
invalid or empty.
Examples:
data = [{"name": "Marcel", "description": "Moonbase Engineer"}]
lancedb_adapter(data, embed="description")
[DltResource with hints applied]