sources._single_file_templates.arrow_pipeline

The Arrow Pipeline Template will show how to load and transform arrow tables.

resource

@dlt.resource(write_disposition="append", name="people")
def resource()

[view_source]

One resource function will materialize as a table in the destination, wie yield example data here

add_updated_at

def add_updated_at(item: pa.Table)

[view_source]

Map function to add an updated at column to your incoming data.

source

@dlt.source
def source()

[view_source]

A source function groups all resources into one schema.