Load SAP HANA data to Microsoft SQL Server
Load SAP HANA tables into Microsoft SQL Server with dlt's sql_database source and your coding agent: the SQLAlchemy driver, connection string, table selection, and incremental loading.
SAP HANA is an in-memory relational database that can be used with SQLAlchemy through the sqlalchemy-hana dialect. This page has everything needed to load SAP HANA tables into Microsoft SQL Server with dlt's sql_database source: the SQLAlchemy driver, the connection string, how to choose tables and load only new rows, plus the steps that hand the job to your coding agent.
Build your SAP HANA to Microsoft SQL Server pipeline
Set up a project, install the dltHub AI harness and its sql-database-pipeline toolkit, and let your coding agent build the pipeline:
uv init uv add "dlt[hub,sql_database,mssql]" pyarrow pandas hdbcli uv run dlthub ai init --agent <your-agent> # <agent>: claude | cursor | codex uv run dlthub ai toolkit install sql-database-pipeline
Then paste this prompt into Claude, Codex, or Cursor:
The toolkit lists the schemas and tables in your database, asks which tables to load, then scaffolds a one-table pipeline and runs it with a load limit before scaling up. Credentials are inspected through MCP tools, so your agent never reads secrets.toml itself. About the toolkit →
Prefer to write it yourself? Every fact the agent uses is below.
SAP HANA at a glance
| dlt source | sql_database (from dlt.sources.sql_database import sql_database) |
| SQLAlchemy driver name | hana+hdbcli |
| Python driver package | hdbcli |
| Default port | 30015 |
| Tables are grouped by | schema (default: MY_SCHEMA) |
connectorx backend | not supported |
How do I connect to SAP HANA?
dlt needs a database user with read access to the tables you want to load. Add its connection details to .dlt/secrets.toml:
[sources.sql_database.credentials] drivername = "hana+hdbcli" host = "localhost" port = 30015 username = "my_user" password = "my_password" database = "my_database"
Or as a single connection string:
[sources.sql_database] credentials = "hana+hdbcli://my_user:my_password@localhost:30015/my_database"
Use the sqlalchemy-hana dialect with the hdbcli driver. The dialect determines its default schema by querying CURRENT_USER; SAP HANA creates a schema with the user's name and uses it as that user's default schema. For ordinary SAP HANA identifiers, use lowercase names in SQLAlchemy—even though HANA reports unquoted identifiers in uppercase—because uppercase SQLAlchemy names are treated as quoted, case-sensitive identifiers by the dialect.
Microsoft SQL Server credentials go in the same file; the Microsoft SQL Server destination docs list the fields it needs. dlt reads .dlt/secrets.toml automatically at runtime — never hardcode credentials in your pipeline script. For production, see setting up credentials with dlt.
Which SAP HANA tables can I load into Microsoft SQL Server?
Any table or view the database user can read. The sql_database source reads each table's schema from SAP HANA and creates a matching table in Microsoft SQL Server. These options narrow a load down to what you need:
| To load | Use |
|---|---|
| A single table | sql_table(table="orders") |
| A specific schema | sql_database(schema="MY_SCHEMA") |
| Views as well as tables | sql_database(include_views=True) |
| Only some columns | sql_table(table="orders", included_columns=["id", "status"]) |
| Only some rows | sql_database(query_adapter_callback=...) |
Always pass table_names=[...] to sql_database(): without it, dlt reflects every table in the schema before loading anything. SAP HANA stores unquoted names in upper case, so a table created as orders is usually named ORDERS here.
How do I load only new SAP HANA rows?
Give each table a cursor column and a primary key, and dlt loads only rows changed since the last run and merges them into Microsoft SQL Server:
source.orders.apply_hints( incremental=dlt.sources.incremental("updated_at"), write_disposition="merge", primary_key="id", )
Use a timestamp such as updated_at for tables whose rows change, and an increasing id for append-only tables. On the first run dlt loads everything; after that it reads only rows past the last cursor value. See incremental loading.
What does the SAP HANA to Microsoft SQL Server pipeline look like?
This loads the customers and orders tables from the MY_SCHEMA schema into Microsoft SQL Server. Replace the table names with your own:
import dlt from dlt.sources.sql_database import sql_database def load_sap_hana_to_mssql() -> None: source = sql_database( schema="MY_SCHEMA", table_names=["customers", "orders"], backend="pyarrow", ) source.orders.apply_hints( incremental=dlt.sources.incremental("updated_at"), write_disposition="merge", primary_key="id", ) pipeline = dlt.pipeline( pipeline_name="sap_hana_pipeline", destination="mssql", dataset_name="sap_hana_data", ) load_info = pipeline.run(source) print(load_info) if __name__ == "__main__": load_sap_hana_to_mssql()
Credentials are not passed in the code: sql_database() reads them from [sources.sql_database] in .dlt/secrets.toml. Run it with uv run python sap_hana_pipeline.py.
Which backend should I use?
The backend decides how rows are read from SAP HANA. The example uses pyarrow; switch if your data calls for it:
| Data size | Backend | Why |
|---|---|---|
| Under 100k rows | sqlalchemy (default) | No extra dependencies, runs dlt's full row-by-row normalization |
| 100k – 10M rows | pyarrow | 20–30× faster, keeps decimal and date types exact; needs numpy |
| Over 10M rows | pyarrow | connectorx does not support SAP HANA |
The toolkit's /optimize-sql-performance skill measures where time goes and picks a backend, chunk size and parallelism for you. See configuring the backend.
How do I query SAP HANA data in Microsoft SQL Server?
After a run, pipeline.dataset() holds the loaded tables. A Relation is a query on that dataset, either a whole table or a SQL string, and reading it gives you the data as a Pandas DataFrame, a PyArrow table or Python tuples. Nothing is read until you ask for it.
import dlt pipeline = dlt.pipeline("sap_hana_pipeline") # Step 1: Get the dataset from the pipeline dataset = pipeline.dataset() # Step 2: Get a Relation, either a whole table... orders = dataset.table("orders") # ...or any SQL query against Microsoft SQL Server recent = dataset("SELECT * FROM orders ORDER BY updated_at DESC LIMIT 100") # Step 3: Read the data df = orders.df() # or orders.df(chunk_size=50) for a large table arrow_table = recent.arrow() # a PyArrow Table rows = recent.fetchall() # a list of Python tuples
The columns are the ones of your SAP HANA tables; dataset.row_counts().df() lists every table with its row count. Your agent can run the same queries through the MCP server's execute_sql_query tool, and uv run dlthub show opens the Pipeline Dashboard with the schema, load metrics and a query box. See access loaded data in Python and exploring it in marimo notebooks.
How do I deploy the SAP HANA to Microsoft SQL Server pipeline in production?
The pipeline runs locally, which is ideal for prototyping and one-off loads. When you need it on a schedule, monitored on every load, and shared with your team, deploy the same dlt code on the dltHub platform — no infrastructure to maintain. The harness's dlthub-platform toolkit takes your agent there:
uv run dlthub ai toolkit install dlthub-platform
- Deploy & schedule — run the pipeline as a managed job with automatic retries.
- Monitor — observable job queues, alerting, and load metrics for every run.
- Transform — promote raw SAP HANA loads into governed, documented models.
- Visualize & share — explore data in notebooks and publish live dashboards instead of static screenshots.
What other destinations can I load SAP HANA data to?
dlt loads into any of these — only the destination argument changes:
| Destination | Example value |
|---|---|
| DuckDB | "duckdb" |
| PostgreSQL | "postgres" |
| BigQuery | "bigquery" |
| Snowflake | "snowflake" |
| Redshift | "redshift" |
| Databricks | "databricks" |
| Filesystem (S3, GCS, Azure) | "filesystem" |
Set dlt.pipeline(destination="snowflake") and add that destination's credentials in .dlt/secrets.toml. See the full destinations list.
Next steps
Was this page helpful?
Community Hub
Need more dlt context for SAP HANA to Microsoft SQL Server?
Request dlt skills, commands, AGENT.md files, and AI-native context.