dltHub
Blog /

2024 dlt Recap: Moments, Mentions, and Milestones

  • Adrian Brudaru,
    Co-Founder & CDO
  • Aman Gupta,
    Jr. Data Engineer

2024 was a remarkable year for dltHub. Together with our users and partners, we streamlined workflows, introduced powerful capabilities, and laid a stronger foundation for the future.

Strengthening Partnerships

  • Tower.dev: Improved data orchestration for more efficient workflows. (Link)
  • Cognee: Enhanced data ingestion to support faster, more accurate analysis. (Link)

Community Milestones

  • 1,000 Production Users: A testament to the trust and reliance our community has placed in dltHub. (Link)
  • dlt v1 Release: A major step forward in stability, features, and performance. (Link)

Enriching the Data Ecosystem

dlt wants to integrate with your data stack, not replace it. As testament, here are some interesting integrations or demos

Integrations:

- Dagster: https://dagster.io/blog/expanding-dagsters-embedded-elt-ecosystem-with-dlthub-for-data-ingestion
- SQLMesh: https://sqlmesh.readthedocs.io/en/stable/integrations/dlt/

- dbt: https://dlthub.com/blog/dbt-gen

Demos:
- Modal: https://modal.com/blog/analytics-stack

Community articles and mentions

  1. Getting Started with dltHub โ€“ Introductions and First Impressions

  2. Integrations with Dagster, Airflow, Databricks, and Other Orchestration Tools

  3. Real-World Use Cases, Building Pipelines, and Tooling

  4. Workshops, Events, and Community Engagement

  5. Ecosystem Outlook, Comparisons, and Future Directions

Founderโ€™s note: Our Community-Driven journey in 2024

Looking back at 2024, what stands out most isn't the technical milestones, but how our community has shaped and strengthened every aspect of dlt. When we started, we built on a clear vision: data engineers needed a better way to build pipelines in Python. What's been truly inspiring is seeing this vision resonating and evolving through the contributions of our growing community.

Each mention in this recap represents someone who invested their time and expertise in making dlt better for everyone. From engineers exploring new integrations with modern data warehouses to teams implementing dlt at fast-growing startups, to the countless thoughtful blog posts and tutorials, every shared experience has helped shape dlt's path forward.

The integration stories with various other tools showcase the power of community-driven development. Whether it's detailed write-ups about expanding workflow ecosystems or practical guides about combining dlt with different orchestrators, these experiences reinforce our commitment to building open, composable tools that work within existing data stacks.

Educational impact is another big topic. From our own courses, to the engagement with industry-leading learning platforms, the enthusiasm around community workshops, to the energy at our local meetups, these initiatives have shown how knowledge sharing is central to our community's success. Seeing experienced engineers and newcomers alike using dlt to learn and teach modern data engineering has been incredibly rewarding.

Going from a barely known library to an emerging de-facto standard for pythonic ingestion in 2024 was a milestone that reflects the trust our community has placed in dlt.

But the real achievement lies in the quality of engagement: the detailed feedback, the creative implementations, and the continuous improvements suggested by users.

Every enhancement that built towards dlt v1.0.0 came from this collaborative spirit and deep understanding of real-world needs.

Looking ahead, we're more committed than ever to our founding principles: Solving real world problems, learning from our community, and making data engineering more accessible. The strength of dlt lies in our community of engineers who use it, improve it, integrate with it, and share their knowledge with others.

Thank you for being part of this journey and for helping us build something truly meaningful together. Here's to an even more collaborative 2025!

โ€” Adrian, data engineer and co-founder at dltHub.