Super Data Roundup (Part 1/2) #140 w/e 19 June 2026
Join the 8,500-strong data herd getting all you need to know about Data for your Friday roundup
It’s quiet as folks are out for summer. There is another part to this roundup.
Orchestra Product Features
NEW - Readonly API Tokens in Orchestra
NEW Assets and Lineage - you can update Assets via API to create a banging context layer
NEW Check-out our sick Cloud Hosted MCP (link)
NEW Check-out our new case study with FEELD - how the dating app powers ML and AI workflows with Orchestra
We run
dbt debugwhen validating an orchestra dbt connection now which is pretty great!!Custom Webhook Alerts (send custom webhook payloads to any monitoring tool e.g. Datadog)
Postgres Sensor enabled (trigger a pipeline whenever something happens in Postgres)
trigger on any condition (link)
Trigger an Orchestra Pipeline as a task (link)
Scaling sequential Tasks in the MetaEngine - one config, infinite possibilities. Metadata-driven frameworks in ADF are a thing of the past!
Large Task Outputs - you can now pass data between tasks up to many Megabytes
Force Cancel - you can force cancel any task, pushing it into a cancelled state
Omni Integration
Pipeline run concurrency is live! Read more here
Monitor your Estuary Syncs from Orchestra (read more here)
MCP Video is live. This is the only MCP you need or API you need to reliably fix your data pipelines automatically with AI.
You can now run claude agents in Orchestra. These can automate anything, especially things you can design as code submission tasks.
AI Assistant is in Orchestra too - ask our assistant questions without having to leave to the docs!
Released our EKS operator - you can now trigger and monitor flows on Kubernetes in AWS
UI RESKIN! DARK MODE AND LIGHT MODE! TELL YOUR FRIENDS!
Improved Docs Site — CHECK OUT OUR DOCS AND ASK IT QUESTIONS
Workspaces - say goodbye to multiple airflow instances
Improved Lineage Filtering
Medium 🧠
🧠 Orchestra open-sourced their dbt state awareness product (link)
🧠 Snowflake: One Platform for First-Party and Partner Identity Resolution (link)
🧠 I Tried to Schedule My ETL Pipeline. Here’s What I Didn’t Expect (link)
🧠 Building a Custom GStreamer Plugin for NVIDIA DeepStream (link)
🧠 Top Monte Carlo Data Observability Alternatives in 2026 (link)
🧠 Real-time anomaly detection and log monitoring for dbt core (link)
🧠 7 Crucial Barriers between Data Teams and Self-Healing Data Architecture (link)
🧠 The Data Engineering Interview in 2026 (link)
🧠 How We Automated SQL Alert Creation for 1000+ Databricks Tables (link)
🧠 Data Lake: 50 Data Feeds, Zero Standards, and the Framework That Fixed It All (link)
🧠 Integrating Microsoft Copilot Studio Agents with Snowflake Cortex Using MCP through Entra ID Authentication (link)
LinkedIn 🕴
🕴 Why Data Teams Keep Fighting the Same Fires (link)
🕴 Fable 5 Performance, 50% Lower Cost: The Case for Multi-Model AI (link)
🕴 Snowflake Postgres Mirroring: Real-Time Analytics Without ETL (link)
🕴 Benchmark Wars: Can Vendor Performance Claims Be Trusted? (link)
🕴 The 7 Barriers to Self-Healing Data Architectures (link)
🕴 The Hidden Risk of Self-Managed Data Storage (link)
🕴 Databricks Hits $6.9B and Doubles Down on AI (link)
News 📰
📰 Salesforce acquire Fin / Intercom (link)
📰 SpaceX to acquire the AI coding startup Cursor for $60 billion (link)
📰 Snowflake Introduces AIM Platform For Enterprise Migration And Modernization (link)
📰 Databricks To Acquire Panther To Expand Security Lakehouse Platform (link)
📰 NVIDIA joins $54M bet on startup that gets AI data centres online three years faster (link)
YouTube and Podcast 🎥
Editor’s Pick
🎥 AI Didn’t Kill ETL — It Made Data Modeling More Important (link)
🎥 Real Time dbt Alerts with Orchestra (link)
🎥 Shipping data pipelines has never been this easy (link)
🎥 AI is turning all data viz into JavaScript (link)
🎥 From Chatbots to Collaborators: Trustable AI Workflows for Data Engineering and Analysis (link)
🎥 We tested the New Power BI Report Skills: The Future of AI-Powered Reporting? (link)
Special 💫
💫 Data Engineering Weekly #274 (link)
💫 Raise the ambition threshold (link)
Jobs 💼
💼 Senior Data Engineer at Datavant (link)
💼 Analytics Engineer at Delta Defense (link)
💼 Staff Data Analytics Engineer at Adsquare (link)
💼 Data Analytics Engineer at Adsquare (link)
💼 Senior Data Engineer at Datavant (link)
Run dbt models cheaply and easily with state?
If you’re looking for an easy way to run your dbt core models, look no further than Orchestra. Orchestra gives you state-aware orchestration out the box, which can reduce your dbt core costs, and make scheduling much easier!
dbt, dbt core and dbt labs are all trademarks of dbt labs inc