dlt.common.destination.configuration
CsvFormatConfiguration Objects
@configspec
class CsvFormatConfiguration(BaseConfiguration)
encoding
Encoding used to write csv files and to decode them when a destination loads them.
encoding_errors
How characters not representable in encoding are treated when writing csv files: a Python error handler name, e.g. strict (default, raises), replace or backslashreplace.
ParquetFormatConfiguration Objects
@configspec
class ParquetFormatConfiguration(BaseConfiguration)
flavor
could be ie. "spark"
timestamp_timezone
Deprecated as a way to pick a timezone, use the context timezone. "" still asks for no UTC adjustment.
use_content_defined_chunking
requires pyarrow>=21.0.0, ignored otherwise
supports_dictionary_encoding
When False, constant columns (like _dlt_load_id) will use regular arrays instead of dictionary-encoded arrays. Set to False for destinations using ADBC drivers that don't support dictionary types (e.g., MSSQL).
arrow_concat_promote_options
PyArrow concat_tables promote_options for Arrow table concatenation. "none" (default) requires identical schemas and enables zero-copy concat. "default" promotes within type families (e.g. int32 to int64). "permissive" promotes across families (e.g. int64 to double).