Shipyard news, Windows Outage, Posthog a warehouse?! Don't miss this one #42
Join the 3,400-strong data herd getting all you need to know about Data for your Saturday 10am Coffee
The latest and greatest for w/e 21 July 2024. As always if this was helpful, please do subscribe. If not, please let us know why not. We hate generic-ness.
Edit: this post originally said “Azure outage”. This has been corrected to “Windows outage”.
Shipyard decommissioned?
To understand more about how to migrate from Shipyard to Orchestra, please see our detailed migration guide and our piece on modular architecture.
We are offering accelerated implementation programs with our partner GM Data Solutions with an Orchestra discount for companies affected by the Shipyard news. This is by far the easiest, reliable and most cost-effective way to migrate - if this is relevant to you, please do reach out.
For partners or the partner network, please contact Hugo Lu.
From our Partner Network: Coalesce 7.3!
To paraphrase from our friends over at Coalesce, This release includes the following product updates:
• Role-Based Access Control (RBAC): improved user security and access management capabilities are now available in private preview by request. Visit our documentation for more details and contact your support team for access.
• Merge Conflict Updates: Changes related to merge conflicts are now easier to review, navigate and resolve. To learn more, view our documentation.
Orchestra adds Branching
Branching is a fundamental feature of any orchestration tool. You can now have access to this in Orchestra. Sure, we have alerting built-in so you don’t need superfluous branching for basic things like sending alerts, but we built it anyway.
Check out the video below or try it now.
Sexy logging
For integrations like EC2, we now support exposure of logs in the UI. This is a really good looking and sexy feature and incredible for debugging those pesky python processes.
Additional integrations
We now support AWS Sagemaker, Boomi. Boom! Read more about our integrations here.
Medium 🧠
🧠 Time for Snowflake to up the table stakes (link)
🧠 Tearing down the monolith in data engineering (link)
🧠 How Migo ensure end to end data quality (link)
🧠 Modern DAta Stack 2024 (link)
🧠 dbt isn’t dynamic part 2 (link)
🧠 Data Orchestration for Data Products (link)
🧠 How to migrate from Shipyard to Orchestra (link)
LinkedIn🕴
🕴 AN incredible post from Peter Gostev on the relative and changing cheapness of AI models (link)
News 📰
**Editor’s Pick**
📰 Google in talks to purchase Wiz (WSJ - link)
📰 Windows outage. Yep. Just everywhere. Link and link
📰 Posthog has released a data warehouse product (see above and the docs here)
I’ve lifted this from Sifted
📰 London-based Switchee, a data platform for social housing providers which is aiming to lower heating bills and prevent mould in houses, raised £5m in funding from AXA and Octopus Ventures.
📰 Brussels-based Soda, which helps data teams test, prevent and debug data issues, raised $14m from investors including Singular and Point Nine.
📰 Amsterdam-based Scaler, a platform for ESG data collection and reporting for the real estate sector, raised $10m in Series A funding. Plural led the round and was joined by investors including Base10.
📰 Stockholm-based Arkion (formerly Skyqraft), an AI analytics platform for power grid companies, raised $4m in funding. Subvenio Invest led the round and was joined by investors including Neptunia Invest and Antler.
YouTube and Podcast 🎥
🎥 How AI is Built at Bayer with Nicolay Gerold and Abhishek Choudhary (link)
🎥 Matt Mullins and Joe Reis have a good old rant about data (link)
Jobs 💼
dbt inspo
Senior Data Engineer at Snap
Location:United States
Stack:* BigQuery / Google Cloud* Fivetran * Databricks* DBT
Posted by:@Maksim Pecherskiy
Data Engineer At Otter.ai
Location:United States
Company:https://otter.ai/careers?gh_src=ad587e343us
Stack: snowflake, dbt, airflow, superset, fivetran, amplitude,stitch,census
Posted by:@Viswa Murali
**Editor’s Pick**
Goldman Sachs are hiring for Data Engineers (link)
IAG Loyalty are hiring for A LOT of data roles (link)
Other 💫
**Editor’s Pick**
💫 You’ve got to BAKE THE CAKE before putting the Cherry on top. Listen to the always-incredible Veronika Durgin share some sage thoughts on Gen AI in Analytics (link)
💫 AI/ML at Stripe (San francisco event; sign-up)