Databricks announce Omnigent, Anthropic's latest model banned by Government, Clickhouse + Orchestra #138 w/e 12 June 2026
Join the 8,500-strong data herd getting all you need to know about Data for your Friday roundup
This week Databricks summit is commencing, and they’ve already announced that they’re OS’ing Omnigent, a harness for running agents.
If this is a bellweather for the rest of summit, there should be some pretty good announcements.
That said, it will perhaps be met with some skepticism. The OneHouse folks are going pretty heavy on the Vendor-Lockin Aspect of Unity, and if there is any merit to it, then who knows how the market will receive DBX’ other OS Projects.
Meanwhile, I know in the last round-up, we announced Fable from Anthropic launched. Will in this one, we announce it’s been banned.
Read all about it here.
Meanwhile…
Orchestra released their Clickhouse Integration
Astronomer re did an AMA on Airflow on Reddit and got roasted again (link)
Dagster increased their prices. Again. I’ve been saying it for years and I’ll say it again - don’t trust the open-core folks who raised hundreds of millions in 2021. The business models are unsustainable, the Products are too niche, and the pricing will increase. The latest in a long line of “rug pulls”, dbt, terraform, etc….
Orchestra Product Features
NEW Assets and Lineage - you can update Assets via API to create a banging context layer
NEW Check-out our sick Cloud HOsted MCP (link)
NEW Check-out our new case study with FEELD - how the dating app powers ML and AI workflows with Orchestra
We run
dbt debugwhen validating an orchestra dbt connection now which is pretty great!!Custom Webhook Alerts (send custom webhook payloads to any monitoring tool e.g. Datadog)
Postgres Sensor enabled (trigger a pipeline whenever something happens in Postgres)
trigger on any condition (link)
Trigger an Orchestra Pipeline as a task (link)
Scaling sequential Tasks in the MetaEngine - one config, infinite possibilities. Metadata-driven frameworks in ADF are a thing of the past!
Large Task Outputs - you can now pass data between tasks up to many Megabytes
Force Cancel - you can force cancel any task, pushing it into a cancelled state
Omni Integration
Pipeline run concurrency is live! Read more here
Monitor your Estuary Syncs from Orchestra (read more here)
MCP Video is live. This is the only MCP you need or API you need to reliably fix your data pipelines automatically with AI.
You can now run claude agents in Orchestra. These can automate anything, especially things you can design as code submission tasks.
AI Assistant is in Orchestra too - ask our assistant questions without having to leave to the docs!
Released our EKS operator - you can now trigger and monitor flows on Kubernetes in AWS
UI RESKIN! DARK MODE AND LIGHT MODE! TELL YOUR FRIENDS!
Improved Docs Site — CHECK OUT OUR DOCS AND ASK IT QUESTIONS
Workspaces - say goodbye to multiple airflow instances
Improved Lineage Filtering
Medium 🧠
🧠 Snowflake Summit 2026: Summary of New Features (link)
🧠 A Human-Augmenting Agentic Workflow for Causal Inference (link)
🧠 Thinking Fast & Slow for a Personalized Notification System (link)
🧠 How to Refactor Code with Claude Code (link)
🧠 I Thought Data Engineering Was Just Writing Scripts. I Was Wrong. (link)
🧠 Top Enterprise Airflow Alternatives in 2026 | Data Orchestration 101 (link)
🧠 Meta Data Engineering Interview Question — Data Engineer (link)
🧠 Building Streaming Data Contracts for Real-Time Data Quality and Schema Governance (link)
🧠 Best Practices From A Year of AI-Augmented Development with Snowflake Cortex Code (CoCo) (link)
LinkedIn 🕴
🕴 How OpenSharing Is Transforming Cross-Organization AI Sharing (link)
🕴 Mastering State-Aware Orchestration in dbt (link)
🕴 Why Great Data Teams Still Fail the Business (link)
🕴 Inside the AI-Native Enterprise with Atlan CEO Prukalpa (link)
🕴 How Agentic AI Is Reshaping Data Engineering Workflows (link)
🕴 Snowflake Launches Fully Automated Postgres Analytics Mirroring (link)
🕴 Snowflake Interactive Warehouses Just Got a Massive Performance Boost (link)
🕴 The Hidden Organizational Crisis Facing Data Teams (link)
🕴 30-Second Snowflake Postgres Mirroring Changes the Game for App Developers (link)
News 📰
📰 Databricks announce Omnigent (link)
📰 Data security firm Cyera raises $600 million at $12 billion valuation… Read More
📰 Databricks Eyes $175B Valuation on $5.4B ARR [2026]… Read More
📰 Snowflake And Anthropic Accelerate Enterprise AI Adoption As Demand For Governed AI Grows… Read More
YouTube and Podcast 🎥
Editor’s Pick
🎥 Azure SQL Database for Free? I Built a Real App Backend (Video)
🎥 60M Rows, 2 Pipelines, 1 Dashboard in 3 Minutes (Video)
🎥 Building Blocks for Agentic Analytics (Video)
🎥 DuckDB breaks the lakehouse? (Video)
🎥 The Microsoft Build 2026 Announcements You Need to Know for Microsoft Fabric and Power BI (Video)
Special 💫
💫 Data Engineering Weekly #273 (link)
💫 Kafka Share Groups and Parallelizing Consumption - Part 3: Client-local parallelism (link)
Jobs 💼
💼 Data & Integration Engineer at Marie-Stella-Maris (link)
💼 Senior Associate, Analytics Engineering at Morgan Health (link)
💼 Principal Data Architect & Engineer at Cedar (link)
💼 Manager, Product Analytics & Data Science at CompanyCam (link)
💼 Senior Analytics Engineer at Mainstay (link)
Run dbt models cheaply and easily with state?
If you’re looking for an easy way to run your dbt core models, look no further than Orchestra. Orchestra gives you state-aware orchestration out the box, which can reduce your dbt core costs, and make scheduling much easier!
dbt, dbt core and dbt labs are all trademarks of dbt labs inc