Tutorial
Welcome to the tutorial on how to efficiently use dlt to build a data pipeline. This tutorial will introduce you to the foundational concepts of dlt and guide you through basic and advanced usage scenarios.
As a practical example, we'll build a data pipeline that loads data from the GitHub API into DuckDB.
What We'll Cover
- Fetching data from the GitHub API
- Understanding and managing data loading behaviors
- Incrementally loading new data and deduplicating existing data
- Making our data fetch more dynamic and reducing code redundancy
- Securely handling secrets
- Making reusable data sources
Ready to dive in?
Let's begin by loading data from an API.