Skip to main content
Version: 1.7.0 (latest)

Local transformations

dlt+

This page is for dlt+, which requires a license. Join our early access program for a trial license.

As part of dlt+, we provide a local transformation cache — a staging layer for data transformations allowing you to test, validate, and debug data pipelines without running everything in the warehouse. With local transformations, you can:

  • Run transformations locally, eliminating the need to wait for warehouse queries.
  • Validate the schema before loading to catch mismatches early.
  • Test without incurring cloud costs, as in-memory execution prevents wasted compute.

Local transformations are built on DuckDB, Arrow, and dbt, so they work with your existing stack.

caution

The local transformations feature is currently in the early access phase. We recommend waiting for general access before using it in production.

This demo works on codespaces. Codespaces is a development environment available for free to anyone with a Github account. You'll be asked to fork the demo repository and from there the README guides you with further steps.
The demo uses the Continue VSCode extension.

Off to codespaces!

DHelp

Ask a question

Welcome to "Codex Central", your next-gen help center, driven by OpenAI's GPT-4 model. It's more than just a forum or a FAQ hub – it's a dynamic knowledge base where coders can find AI-assisted solutions to their pressing problems. With GPT-4's powerful comprehension and predictive abilities, Codex Central provides instantaneous issue resolution, insightful debugging, and personalized guidance. Get your code running smoothly with the unparalleled support at Codex Central - coding help reimagined with AI prowess.