Roundup #18 w/e 19 Jan 2024
Apologies - Substack seems to have sent some old scheduled posts in error today. THIS is the correct one. Sorry again!
Latest and greatest for w/e 19 Jan 2024. As always if this was helpful, please do subscribe. And if not, please let us know why not. We hate generic-ness.
These are the staff picks from Orchestra this week. If you’ve got suggestions, think we missed something, or just want to talk data, you can DM us.
Orchestra Product Updates - loads of new integrations - this time to…Orchestration tools?? Yes. Orchestra is the only platform that does that.
We now can trigger and monitor workloads in Airflow, Prefect and AWS EC2 - for what it’s worth (just saying)!
We’re pretty sure we’re the only platform showing Snowflake Task Sub Dag metadata (In Beta)
Our Coalesce integration is genuinely best-in-class, and allows users to trigger and monitor their Coalesce/Snowflake transformations in the context of entire data pipelines (link) - more to come on this soon.
Medium / Blog 🧠
**Editor’s Pick** - and Hugo’s note: if there’s one thing you read this week..
👉 Simply incredible Write-up of an absurdly complicated yet fully-featured and sophisticated data stack from Robert Sahlin (link) There is a lot of noise around Data Contracts atm too and after some digging we also found Robert’s other project, StreamProcessor, which looks very interesting for anyone interested in enforcing data contracts on GCP (Link)
👉 Simple Modular Data Stacks for Scrappy Businesses (link)
👉 Building, Evaluating and Tracking a Local Advanced RAG System | Mistral 7b + LlamaIndex + W&B (link)
👉 Some cool semantic layer stuff on TDS (link)
Linkedin🕴
🕴dbt confusing duck-db; all that glitters.. (link)
🕴data roundtable on governance (Event) (link)
News 📰
**Editor’s Pick**
📰 Snowflake add sending HTML emails to the platform (Link)
Youtube and Podcast 🎥
🎥 Check out Orchestra’s new YOUTUBE CHANNEL (link)
Other 💫
💫 A really interesting paper on Kùzu: A Database Management System For "Beyond Relational" Workloads
💫 The ultimate guide to unit-testing in dbt (Link)
**Editor’s Pick**
💫
What did we miss?