30+ SQL databases
Join our Slack community or Get in touch with the dltHub Customer Success team.
SQL databases are management systems (DBMS) that store data in a structured format, commonly used for efficient and reliable data retrieval.
The SQL Database verified source loads data to your specified destination using one of the following backends: SQLAlchemy, PyArrow, pandas, or ConnectorX.
Sources and resources that can be loaded using this verified source are:
Name | Description |
---|---|
sql_database | Reflects the tables and views in an SQL database and retrieves the data |
sql_table | Retrieves data from a particular SQL database table |
If you prefer to skip the tutorial and see the code example right away, check out the pipeline example here.
Supported databases
Check out dlt+ for support of change tracking for Microsoft SQL Server.
We support all SQLAlchemy dialects, which include, but are not limited to, the following database engines:
- PostgreSQL
- MySQL
- SQLite
- Oracle
- Microsoft SQL Server
- MariaDB
- IBM DB2 and Informix
- Google BigQuery
- Snowflake
- Redshift
- Apache Hive and Presto
- SAP Hana
- CockroachDB
- Firebird
- Teradata Vantage
Note that there are many unofficial dialects, such as DuckDB.
📄️ Setup
basic steps for setting up a dlt pipeline for SQL Database
📄️ Configuration
configuring the pipeline script, connection, and backend settings in the sql_database source
📄️ Usage
basic usage of the sql_database source
📄️ Troubleshooting
common troubleshooting use-cases for the sql_database source
📄️ Advanced usage
advance configuration and usage of the sql_database source
📄️ Incremental loading guide
Incremental SQL data loading strategies