4 articles
Data Catalogs & Metadata
Unity Catalog provides a lakehouse with shared discovery, access controls, and lineage. Pipeline checks still decide what may land and who fixes a failure.
AI Agents
Database-agent permissions should be based on the records an action can affect and whether the change is reversible, not on valid code or plausible answers.
Data Governance & Quality
Data governance sets who owns data and the rules it must meet. In data engineering, pipelines enforce those rules and keep a record of each run for audits.
Data Governance & Quality
Run a check before the load when it decides whether data may land, and after the load when it needs history. Every check also needs an owner who acts on failures.