Super Data Roundup (Part 2/2) - Databricks eye $175bn IPO, Cloudflare release Data Platform, Rippling Announce DW #141 w/e 26 June 2026
Join the 8,500-strong data herd getting all you need to know about Data for your Friday roundup
Some very interesting moves this week as Cloudflare announce their data platform built on R2, their alternative to S3. This is a very interesting move, and appears to be appealing to software engineers with a new approach to platform and pricing.
With very transparent, egress and data-processing based pricing. Some interesting thoughts here too.
Separately, Rippling, the HR SAAS Platform have announced a data platform and a data warehouse, similar to what Posthog have done in the last year. reddit don’t seem to care.
THIS WEEK we are announcing something BIG. Our announcement is on Tuesday. Sign-up here. You won’t want to miss it.
Orchestra Product Features
New Readonly API Tokens in Orchestra
NEW Assets and Lineage - you can update Assets via API to create a banging context layer
NEW Check-out our sick Cloud HOsted MCP (link)
NEW Check-out our new case study with FEELD - how the dating app powers ML and AI workflows with Orchestra
We run
dbt debugwhen validating an orchestra dbt connection now which is pretty great!!Custom Webhook Alerts (send custom webhook payloads to any monitoring tool e.g. Datadog)
Postgres Sensor enabled (trigger a pipeline whenever something happens in Postgres)
trigger on any condition (link)
Trigger an Orchestra Pipeline as a task (link)
Scaling sequential Tasks in the MetaEngine - one config, infinite possibilities. Metadata-driven frameworks in ADF are a thing of the past!
Large Task Outputs - you can now pass data between tasks up to many Megabytes
Force Cancel - you can force cancel any task, pushing it into a cancelled state
Omni Integration
Pipeline run concurrency is live! Read more here
Monitor your Estuary Syncs from Orchestra (read more here)
MCP Video is live. This is the only MCP you need or API you need to reliably fix your data pipelines automatically with AI.
You can now run claude agents in Orchestra. These can automate anything, especially things you can design as code submission tasks.
AI Assistant is in Orchestra too - ask our assistant questions without having to leave to the docs!
Released our EKS operator - you can now trigger and monitor flows on Kubernetes in AWS
UI RESKIN! DARK MODE AND LIGHT MODE! TELL YOUR FRIENDS!
Improved Docs Site — CHECK OUT OUR DOCS AND ASK IT QUESTIONS
Workspaces - say goodbye to multiple airflow instances
Improved Lineage Filtering
Medium 🧠
🧠 Introducing CocoPlus: A Structured Way to Build with Snowflake CoCo (link)
🧠 VMAF v1: Good Is Not Good Enough (link)
🧠 What are Claude Skills? Open-Sourcing AI Skills for Data Engineers (link)
🧠 Why Your Data Pipeline Works Perfectly… Until Real Users Arrive (link)
🧠 One Shot, One Chance: Training Databricks Genie for the CFO Fight🥊 (link)
🧠 Your First Task as a Data Engineer in a New Company? Make the ETL Pipeline Testable (link)
🧠 Beyond One-Click Approval: Building Multi-Step Data Product Governance on Snowflake (link)
🧠 The Hot Path Belongs to GBDTs, Agents Own the Cold Path: A Payment-Fraud Benchmark (link)
LinkedIn 🕴
🕴 From Credits to Clarity: Cloudflare’s Data Platform Pricing (link)
🕴 It’s Not About AI. It’s About Tuesday (link)
🕴 Governance Isn’t the Problem—Late Governance Is (link)
🕴 The Python Gap in Snowflake’s Serverless Strategy (link)
🕴 Snowflake Gives Python Developers a Proper Development Experience (link)
🕴 AI Skills That Put a Data Engineer in Your Pocket (link)
🕴 Why Agentic BI Could Be Anthropic’s Next Big Move (link)
News 📰
📰 EY.ai Agentic for Sales powered by Snowflake and Canva (link)
📰 Databricks Valuation (2026): $134B Confirmed, $175B IPO Chatter (link)
📰 Exclusive: XCures Lands $46M Series B To Clean Up Messy Medical Records With AI (link)
YouTube and Podcast 🎥
Editor’s Pick
🎥 Is ontology replacing the semantic model? (link)
🎥 Power BI Finally Has a Date Picker — No More Workarounds? (link)
🎥 Airflow Migration 101 | Migrating Airflow DAGs to Orchestra Pipelines in Seconds (link)
🎥 AI Writes the Pipeline in a Minute. Here’s How to Make It Right (link)
🎥 5 Min Dremio Demo (link)
Special 💫
💫 Data Engineering Weekly #275 (link)
💫 Can We Agree on a Storage/Workload Architecture Taxonomy? (link)
💫 Kafka Share Groups - Pathological fetch waits with record_limit (link)
💫 You Don’t Graduate From Data Engineering: Why We Built aide for Continuous Learning (link)
Jobs 💼
💼 Senior Analytics Engineer - Part Time Contract at Up Learn (link)
💼 Analytics Engineer at Dashlane (link)
💼 Senior Analytics Engineer – P&C Insurance at Rockwoods (link)
💼 Senior Analytics Engineer at Dashlane (link)
Run dbt models cheaply and easily with state?
If you’re looking for an easy way to run your dbt core models, look no further than Orchestra. Orchestra gives you state-aware orchestration out the box, which can reduce your dbt core costs, and make scheduling much easier!
dbt, dbt core and dbt labs are all trademarks of dbt labs inc