dlt.destinations.impl.filesystem.configuration
FilesystemDestinationClientConfiguration Objects
@configspec
class FilesystemDestinationClientConfiguration(
FilesystemConfigurationWithLocalFiles,
DestinationClientStagingConfiguration)
max_state_files
Maximum number of pipeline state files to keep; 0 or negative value disables cleanup.
always_refresh_views
Always refresh table scanner views by setting the newest table metadata or globbing table files
HfFilesystemDestinationClientConfiguration Objects
@configspec
class HfFilesystemDestinationClientConfiguration(
FilesystemDestinationClientConfiguration)
hf_dataset_card
Create and update dataset card (README.md) with subset metadata for the Hugging Face dataset viewer.