Blog

Summary of the ​16:00 Panel discussion: The future of data teams and their tools hosted by MotherDuck

Teams connect Claude to HubSpot, Stripe and Zendesk and call it a stack. It’s good at questions that live in one system and touch a handful of records. Everything else breaks in ways hard to predict.

Openflow covers the short tail with connectors maintained by Snowflake. dltHub covers the long tail with connectors your agents generate and you own. Here is how they fit on one Snowflake account.

AI agents are changing data engineering faster than the profession can keep up. We looked at what the pioneers are doing, what still holds them back, and what it takes to turn AI capability into reliable production work.

dltHub background agents are in public preview, starting with job-inspector: a verified agent that diagnoses failed pipeline jobs with read-only access and posts the cause, the evidence, its confidence and a recommendation to fix to Slack.

A data platform should run like a power grid: routine faults cleared automatically inside a bounded scope, anything risky escalated to a person. This is the four-level autonomy ladder dltHub is climbing, and the context graph that makes each step safe to take.

In March 2024, we published “dlt adds Reverse ETL”. This piece walks through an example GTM workflow: turning a hiring signal into enriched, sales-ready company and people records, then reverse-ETL them to Attio.

In previous blogs we talked about how to build canonical models. This blog takes that further: we declare a BigQuery property graph over those models, query it with GQL, then ask it questions in plain English. The ontology resolved in the first step is what makes the answers right at the end.

An agent can write a pipeline now, faster than a contractor and cheaper than a hire. So the question is obvious: What people do we still need on the team?

In this article, I walk through moving a HubSpot connector and its dbt models from Fivetran to dlt. I keep the old stack running as the reference, build against its schema, and diff until every mismatch has an explanation.

dlt made agents good at building pipelines. dltHub makes their work safe to run: agentic alerts, team workspaces, and managed infrastructure for your whole team.