AMD spend $5bn, Snowflake Polaris and more. Roundup #47
Join the 3,600-strong data herd getting all you need to know about Data for your Friday roundup
The latest and greatest for w/e 23 August 2024. As always if this was helpful, please do subscribe. If not, please let us know why not. We hate generic-ness.
Migrating Azure Data Factory
Since ADF was released ten years ago a lot has changed. ADF isn’t built for modular architectures and is cumbersome to integrate with modern data platform tools such as Fivetran, Airbyte, dbt and Coalesce.
By moving orchestration workloads away from ADF and into Orchestra, as well as gaining a unified control plane for data operations, users can significantly reduce costs in ADF and enable interoperability with the rest of the stack through deep integrations.
Medium 🧠
**Editors Pick**
🧠 Snowflake Polaris (if you’ve been napping) - (link)
🧠 Walmart Data Engineering Interview Question - (link)
🧠 Setting up AWS lambda functions - (link)
🧠 Mastering SQL UDFs - (link)
🧠 What do LLMs “Understand”? - (link)
🧠 Why Version Control is so important - (link)
LinkedIn🕴
🕴Everything you need to know about dynamic tables (link)
🕴Is the AI security market real? (link)
🕴The modern data tooling landscape (link)
🕴Using the ROLLUP command in BigQuery (link)
News 📰
**Editors Pick**
📰 BigQuery announces Vector search. Not a big deal (link)
📰 Big Tech converting power stations into data centres (link)
📰 AMD spends $5 billion to expand AI capabilities (link)
YouTube and Podcast 🎥
🎥 Exploring the intersection between marketing and data at Braze (link)
🎥 Apache Hudi Vs Apache Iceberg by The Data Guy (link)
Jobs 💼
Staff Data Engineer @ Flo Health
Senior Analytics Engineer @Onixnet
Senior Data Engineer @ Spotify
Data Engineers @ Natwest, Virgin Media & Pets at Home
Data Analyst @ Sephora
Other 💫
💫 Table format comparisons - streaming ingest (link)