sources.pipeline_templates.dataframe_pipeline

The DataFrame Pipeline Template will show how to load and transform pandas dataframes.

resource

@dlt.resource(write_disposition="append", name="people")
def resource()

[view_source]

One resource function will materialize as a table in the destination, wie yield example data here

add_updated_at

def add_updated_at(item: pd.DataFrame)

[view_source]

Map function to add an updated at column to your incoming data.

source

@dlt.source
def source()

[view_source]

A source function groups all resources into one schema.