Accessing loaded data
After one or more successful runs of your pipeline, you can inspect or access the loaded data in various ways:
- We have a simple
streamlit
app that you can use to view your data locally in your webapp. - We have a Python interface that allows you to access your data in Python as Python tuples,
arrow
tables, orpandas
dataframes with a simple dataset object or an SQL interface. You can even run SQL commands on the filesystem destination viaDuckDB
or forward data from any table into another pipeline. - We have an
ibis
interface that allows you to hand over your loaded data to the powerful ibis-framework library. - Lastly, we have some advice for monitoring and ensuring the quality of your data.
Learn more
📄️ Viewing your data with Streamlit
Viewing your data with streamlit
📄️ Accessing loaded data in Python
Conveniently accessing the data loaded to any destination in python
📄️ Native Ibis integration
Accessing your data with native Ibis backends
📄️ The SQL Client
Technical details about the destination sql client
📄️ Ensuring data quality
Monitoring and testing data quality