Multiple Acquisitions, dbt/sdf/sqlmesh - and what's up with Tik Tok?🧠 #67 w/e 17 Jan 2025
Join the 4,800-strong data herd getting all you need to know about Data for your Friday roundup
This week was a slightly nuts week with dbt acquiring SDF Labs and their other competitor, SQLMesh swiftly responding with an “acquisition” of their own.
Meanwhile, Qlik acquired Upsolver to improve their streaming and iceberg capabilities.
Meanwhile, TikTok is for sale in the US and for some reason AI Search Engine perplexity is interested? It’s all kicking off.
Announcing Orchestra architecture for Azure, ADF and Snowflake
We are excited to share our whitepaper on Azure Reference Architecture with Snowflake 🎉 Read more here or continue below.
The times of needing to rely on painful spark jobs in parquet on ADLS are over since
Winter Data Conference
Excited to share that anyone using our special code HUGO50 can get a 50% discount to the Winter Data Conference in Zell Am See - check it out here.
Meme Drop
When you ask someone on Azure how they do insights
Medium 🧠
🧠 Top 3 Questions to Ask in Near Real-Time Data Solutions (link)
🧠 What Did I Learn from Building LLM Applications in 2024? — Part 2 (link)
🧠 Reference Architecture | Snowflake on Azure for Data Engineering (link)
Editor’s Pick
🧠 What dbt™️ Labs’ acquisition of SDF Labs means for the data industry (link)
🧠 Without Advanced Analytics, Your CRM Is Just a Glorified Database (link)
🧠 Build Rapid AI Prototypes and Validates Use Cases against Snowflake Cortex with the Snowflake AI Toolkit (link)
🧠 The Era of Passive Data management is done (link)
LinkedIn🕴
🕴 Modern Data Governance: A Conversation with Sarah Levy (link)
🕴 Master Logic, Not Just Languages: My Journey to Python Integration Success (link)
🕴 Discover Snowflake's New Tools Claude-3.5-Sonnet & Cortex LLM Playground (link)
Editor’s Pick
🕴 Big Data Acquisitions: What They Mean for Data Engineers (link)
News 📰
📰 The AI Tipping Point: What Manufacturing Leaders Need to Know for 2025 - AI is proving that it’s here to stay. While 2023 brought wonder, and 2024 saw widespread experimentation, 2025 will be the year that manufacturing enterprises get serious about AI's applications. But it’s complicated: AI proofs of concept are graduating from the sandbox to production, just as some of AI’s biggest cheerleaders are turning a bit dour. Read more
📰 Wizerr AI: Revolutionizing Electronics Design and Procurement with Databricks - Processing large-scale, unstructured, and complex datasheets is at the heart of Wizerr’s patent-pending ELX engine, reimagining electronics design and procurement with an AI-first approach. Wizerr partnered with Databricks to scale their data pipeline, govern and manage data securely, accelerate iterative development and optimization of AI models, and build a future-proof platform ready for millions of datasheets. Read more
📰 Rockfish: $4 Million (Seed) Raised For Advancing Synthetic Generation Data Platform - Rockfish Data, a leader in synthetic data generation for operational workflows, announced the closing of a $4 million seed fundraising round. This funding round was led by Emergent Ventures with participation from Foster Ventures, TEN13, Dallas VC, NewBuild Venture Capital, and others. This brings the total amount raised close to $6 million. Read more
YouTube and Podcast 🎥
Editor’s Pick
🎥 Data engineering at Snowflake (w/ Rahul Jain) (link)
🎥 How to Fix Data Quality Issues and retry from the point of failure (link)
🎥 From Startup to Scale: How ForceMetrics Revolutionizes Police Data with Dremio (link)
Special 💫
Keeping these two below from last week in case they were missed
💫 This incredible podcast series on data and AI innovation in the manufacturing and industrial sectors in Europe - HIGHLY RECOMMENDED (link)
Jobs 💼
💼 Analytics Engineering at Modern Milkman (link)
💼 Analytics Engineer at MOJU (link)
Editor’s Pick
💼 Senior Analytics Engineer at Bilt Rewards (link)
💼 Data Engineer at Supabase (link)
💼 Senior Data and Analtyics Engineer at PostPilot (link)
💼 Technical Revenue Operations Manager Smartcat (link)
Want to save on your ingestion bills? You’ll love this
You can leverage Python for lightweight ELT integrations. Here you’re only paying for compute and not being penalised by row-based pricing models. Pretty neat right? Check it out below / head to Orchestra and start today.
The best place to run dbt?
Don’t believe us? Watch the video below.