NEW engine 50% faster than Spark, Postgres in Orchestra #85 w/e 23 May 2025
Join the 5,400-strong data herd getting all you need to know about Data for your Friday roundup
Yet. More. Acquisitions. This time with Databricks dominating the headlines once again.
Postgres Connector
You can now connect to Postgres in Orchestra either directly or via dbt.
Simply add your credentials below and you’ll be able to trigger queries and stored procedures in Postgres.
The best thing is Orchestra automatically parses the metadata to populate the data catalog for Postgres too
Whoever said you need a data warehouse? Just use Postgres!!!!!
💡 Read the docs here
🚀 Try it here
Who said you need an expensive data warehouse?? Just use Postgres!
Medium ðŸ§
🧠Scaling Unstructured Data Batch Inference with Snowflake Cortex LLMs (link)
🧠I Teach Data Viz with a Bag of Rocks (link)
🧠Musings on the Data Market in 2025 (link)
🧠Say Goodbye to Dirty Data: Build Trustworthy Pipelines with These Pro Tips (link)
🧠100 Days of Data Engineering Day 90: Dashboarding Insights with Databricks SQL (link)
🧠Inheritance: A Software Engineering Concept Data Scientists Must Know To Succeed (link)
LinkedIn🕴
🕴 Mastery in the Age of AI: Why Craft Still Matters (link)
🕴 Crowdsourcing the Snowflake Summit: Help Me Optimize My SF Agenda (link)
🕴 Big News Brewing: Snowflake Set to Make Major Announcement Next Week (link)
Editor’s Pick
🕴 $1B Consumed, $6.7B Committed: Snowflake’s Growth Signals an AI-Powered Future (link)
🕴 Forget the Catalog, Give Me Pipeline Metadata I Can Use (link)
🕴 Andy Grove leaves data fusion (link)
News 📰
Editor’s Pick
📰 Onehouse release Quanton — A new engine that is a drop replacement for Spark (link)
Editor’s Pick
📰 Builder.ai enters insolvency (link)
📰 AI M&A signals that the hype cycle is growing up (link)
📰 Data Sutram Secures $9 Million in Series A Funding (link)
📰 Databricks continues M&A spree, will buy Neon for $1 billion in AI-agent push - Databricks said on Wednesday it would buy database startup Neon in its latest deal valued at about $1 billion, aiming to strengthen its analytics platform with technology that can help businesses develop and use artificial intelligence agents more easily…Read More
YouTube and Podcast 🎥
Editor’s Pick
🎥 Microsoft Fabric CLI: Turbo-charge Ops with Retro Command-Line Power (link)
🎥 AI Powered BI: Can LLMs REALLY Generate Your Dashboards? ft. Michael Driscoll (link)
Special 💫
💫 you can actually use duck db to move data from one place to motherduck which is cool (link)
💫 Some classic Snowflake Databricks beef if anyone is interested (link)
Jobs 💼
💼 Analytics Engineer at ACLU (link)
💼 Analytics Engineer at Dandelion Health (link)
💼 Datan & Analytics Engineer at AgileMD (link)
💼 Go-To-Market Engineer at Konvo AI (link)
💼 Analytics Engineer at Elite Development Group (link)
Want to save on your ingestion bills? You’ll love this
You can leverage Python for lightweight ELT integrations. Here you’re only paying for compute and not being penalised by row-based pricing models. Pretty neat right? Check it out below / head to Orchestra and start today.
The best place to run dbt?
Don’t believe us? Watch the video below.