Ververica go all in on Flink, Winter Data Conference and DB reconciliation⚡#58
Join the 4,400-strong data herd getting all you need to know about Data for your Friday roundup
The latest and greatest for w/e 1 Nov2024. As always if this was helpful, please do subscribe. If not, please let us know why not. We hate generic-ness. Honestly there wasn’t a whole lot that happened this week - I suppose everyone is getting ready for Christmas???
Want to keep an eye on other news? Hit subscribe below.
Or read on Medium https://medium.com/@hugolu87
dbt Core™️ and other Orchestra Product updates
💡 Read more about the Orchestra dbt Core™️ integration here
This integration is huge. It is by far the easiest platform for a data team of 1 and up (so everyone?)
Enhanced debugging! Identify dbt model/test cost bottlenecks easily
Simplification! One less platform to manage; let Orchestra be your dbt™️ HQ
Price! Simple and lightweight usage-based pricing where the unit costs decrease as your models increase
Worth talking? Chat here.
Other integrations
Orchestra now supports Talend and Azure Synapse (Warehouse) i.e. dbt-fabric - contact us to enable at support@getorchestra.io
Data Quality Reconciliation - this is a pre announcement but if you’ve ever had the dreaded “Hey can you reconcile these numbers to the source db for me?” Fear not - this can now be automated and tracked in Orchestra (try it here).
Parameters - if you work with a METADATA FRAMEWORK you can set global parameters that are retained for task retrying - check out the docs.
Winter Data Conference
Excited to share that anyone using our special code HUGO50 can get a 50% discount to the Winter Data Conference in Zell Am See - check it out here.
Meme Drop
Medium 🧠
**Editors Pick**
🧠 Databricks vs. Snowflake by the numbers (link)
🧠 Orchestra achieves SOC2 Type 2 and ISO 27001 Compliance (link)
🧠 My favourite use-cases for dbt Macros (link)
**Editors Pick**
🧠 Docker pros are shrinking images by 99%: The hidden techniques you can’t afford to miss (link)
LinkedIn🕴
🕴Automatically reconcile data in source DBs and target tables with this one simple trick (link)
🕴Databricks observability using Grafana and Prometheus (link)
News 📰
**Editors Pick**
📰 Dun & Bradstreet’s Databricks case study (link)
YouTube and Podcast 🎥
**Editors Pick**
🎥 Ingesting Data in Apache Iceberg format for Dremio (link)
Jobs 💼
💼 Analytics Engineer at Loop returns (link)
💼 Senior Product Analyst at ProductBoard
💼 Very exctiging data engineering role at Landmarc (recommended, (link))
💼 Interested in Data Engineering for one of the best charitable orgs in the UK? Follow Enthuse or get in touch (link)
💼 Interested in building the future of Data in VC at Dawn? Get in touch to learn more about this one.
Some great data roles around platform and architecture at Lundbeck Pharma (link)
💼 Senior BI Developer at SERB Pharma (link)
Other 💫
**Editors Pick**
💫 There is a lot of hype at the moment around streamhouse, Ververica, Apache Paimon and all things Flink. Recommend to check out the conference here and keep an eye on it for next year.
Some material here (we are not affiliated with Ververica, we think this trend is one to watch)
💫 Lots in the latest Duck DB release from last month (link)
