Databricks start pushing Agent Bricks, Orchestra announces MetaEngine #101 w/e 12 Sep 2025
Join the 5,700-strong data herd getting all you need to know about Data for your Friday roundup
Databricks continue to make the headlines, this time for Agent Bricks after raising another $1bn at a $100bn valution.
This interesting article from Rora wealth sheds some light as to one of the reasons why. Where the capital undoubtedly goes into investment, much goes into paying employees, and their taxes.
However this week we’ve seen a lot OF DIGITAL PR around Agent Bricks.
Agents are the future, but let’s see if they make it to reality.
Orchestra Product Updates
Orchestra MetaEngine
We are extremely excited to announce a long-awaited feature in Orchestra from our latest product revolution— the Orchestra MetaEngine.
The Orchestra MetaEngine has been designed out of frustration.
Enterprises routinely migrate from imperative pipelines to declarative ones, and at scale when enterprises are running hundreds of thousands if not millions of Tasks, it becomes imperative to define configurations in metadata.
However, Metadata Frameworks are insanely expensive and unwieldy. They create opaque and unmaintainable monoliths of code that are hindrances for many teams.
With the Orchestra MetaEngine, Data Teams can use Orchestra’s Declarative Framework to define thousands of tasks in just a few lines of code, rapidly speeding up the build of new pipelines while creating an infinitely scalable architecture.
Spamming / spawning multiple data loading tasks
You can see a live demo below:
We are super excited about this one and giving a LIVE WEBINAR on October 1st. Sign-up now for exclusive access.
Motherduck integration
You can now connect to Motherduck directly and run dbt on duck db ran in Motherduck. This means Motherduck + Orchestra can be the backbone of your data stack just like warehouses like Snowflake and Databricks are today. Check-out the docs here.
And yes we support dbt!
Medium 🧠
🧠 Why dbt(data build tool) Caught My Attention (link)
🧠 How to leverage the MetaEngine to run millions of DQ Tests (link)
🧠 Snowflake Data Sharing vs. Data Clean Rooms: Access vs. Anonymity (link)
🧠 Medallion Architecture Is Not Enough (link)
🧠 How to Analyze and Optimize Your LLMs in 3 Steps (link)
🧠 The Silent Struggle of Streamlit Analytics: Measuring Real User Activity (link)
🧠 Is Your Training Data Representative? A Guide to Checking with PSI in Python (link)
Editor’s Pick
🧠 The Orchestra MetaEngine (link)
🧠 How to leverage a MetaEngine to run millions of data quality tests (link)
LinkedIn🕴
🕴 When Prada Targets the Wrong Customer: A Data Lesson in Marketing ROI (link)
🕴 DJing + Data: The Hottest After Hours Event at Big Data London (link)
🕴 Stop Paying for What Blob Storage Already Does (link)
Editor’s Pick
🕴 Why 2025 Belongs to the Declarative Data Stack (link)
🕴 More Than a Ride: £30K Raised for Cancer Research UK by Snowflake UKI Team & Partners (link)
News 📰
📰 3 Red Flags for Snowflake's Future (link)
Editor’s Pick
📰 Databricks: $1 Billion Series K Raised At $100 Billion Valuation For AI Agent Builder (link)
📰 Dispatch: $18 Million Series A Raised For AI-Driven Data Infrastructure For Financial Advisors (link)
YouTube and Podcast 🎥
Editor’s Pick
🎥 2025 OneLake Drive Mixtape 🔥 (P. LeBlanc) (link)
🎥 Power Query for Beginners: Clean, Fold & Load Fast (link)
🎥 How to use the Orchestra MetaEngine to run thousands of Data Quality Tests on Snowflake! (link)
Special 💫
💫 Data Engineering Weekly #236 (link)
💫 This MCP Server Could Have Been a JSON File (link)
💫 Check out the latest Orchestra MetaEngine Webinar on October 1st (link)
Jobs 💼
FOR UK Folks — Curry’s are hiring massively for a massive build-out with streaming, dbt and a brand new team. This is a HUGE role and we get to introduce you directly to the hiring manager who is awesome. If you want to build something out, message Hugo and see here
💼 Sr. Data Engineer at Double Good (link)
💼 Analytics Engineer / Senior Analytics Engineer at GoHenry (link)
💼 Senior Analytics Engineer at Lendable careers (link)
💼 Staff Analytics Engineer at Rula (link)
💼 Analytics Engineer II at Fanatics Sportsbook (link)
💼 Lead Data Architect at Booksy (link)
Run 4500 dbt models?
We’re completely rewriting our dbt engine and interested in hearing from YOU if you run more than 4,500 models. If so, please let us know as it would be great to chat!
dbt, dbt core and dbt labs are all trademarks of dbt labs inc