#moderndatastack — Public Fediverse posts

< 從試算表到資料平台：重構資料工程的技術與團隊 >

新書上架！

它談論圍繞著 Modern Data Stack 展開的資料工程、資料分析、與管理實務。

寫作的題材，主要基於我對軟體開發的心得與為四間不同的台灣 (上市、新創) 公司改進過資料工程或是 BI 報表的經驗。

天瓏已經開啟預購了，其餘通路9/19正式上市後也都可以開始購買。
https://www.tenlong.com.tw/products/9786267757284
https://www.books.com.tw/products/0011032047

#資料工程 #BI #從試算表到資料平台
#ModernDataStack

We built a Modern Data Stack from scratch and reduced our bill by 70% — https://jchandra.com/posts/data-infra/
#HackerNews #ModernDataStack #CostReduction #DataInfrastructure #DataAnalytics #BusinessEfficiency

We built a Modern Data Stack from scratch and reduced our bill by 70% — https://jchandra.com/posts/data-infra/
#HackerNews #ModernDataStack #CostReduction #DataInfrastructure #DataAnalytics #BusinessEfficiency

Apache iceberg the Hadoop of the modern-data-stack? — https://blog.det.life/apache-iceberg-the-hadoop-of-the-modern-data-stack-c83f63a4ebb9
#HackerNews #ApacheIceberg #ModernDataStack #Hadoop #DataEngineering #BigData

Apache iceberg the Hadoop of the modern-data-stack? — https://blog.det.life/apache-iceberg-the-hadoop-of-the-modern-data-stack-c83f63a4ebb9
#HackerNews #ApacheIceberg #ModernDataStack #Hadoop #DataEngineering #BigData

🍹 C'est l'heure du cocktail de bienvenue proposé par Satya !

- une dose de #ModernDataStack,
- un trait de géo,
- un zeste d'Open Source,
- et beaucoup d'amour 💗.

Cette recette vous est servie dans cet article qui détaille comment le Gard valorise ses géo-données.

:geotribu: https://geotribu.fr/articles/2025/2025-02-25_stack_data_gard/

Relecture 🧐 : @geojulien & Michaël Galien

#PostgreSQL #PostGIS #GDAL #OGR #DBT #Metabase #ApacheAirflow

🍹 C'est l'heure du cocktail de bienvenue proposé par Satya !

- une dose de #ModernDataStack,
- un trait de géo,
- un zeste d'Open Source,
- et beaucoup d'amour 💗.

Cette recette vous est servie dans cet article qui détaille comment le Gard valorise ses géo-données.

:geotribu: https://geotribu.fr/articles/2025/2025-02-25_stack_data_gard/

Relecture 🧐 : @geojulien & Michaël Galien

#PostgreSQL #PostGIS #GDAL #OGR #DBT #Metabase #ApacheAirflow

🌶️ "The modern data stack was a good example of an architecture that was very vendor driven…"

Interesting discussion with Joe Reiss, Matt Housley, and Ghalib Suleiman

🎥 https://www.youtube.com/watch?v=wbRYCLm6pdk&t=2298s
🎧 https://podcasters.spotify.com/pod/show/ternary-data/episodes/174---Ghalib-Suleiman---The-Zero-Interest-Rate-Hangover-in-Data-and-AI-e2jkdmo

#dataEngineering #modernDataStack

🌶️ "The modern data stack was a good example of an architecture that was very vendor driven…"

Interesting discussion with Joe Reiss, Matt Housley, and Ghalib Suleiman

🎥 https://www.youtube.com/watch?v=wbRYCLm6pdk&t=2298s
🎧 https://podcasters.spotify.com/pod/show/ternary-data/episodes/174---Ghalib-Suleiman---The-Zero-Interest-Rate-Hangover-in-Data-and-AI-e2jkdmo

#dataEngineering #modernDataStack

And now it's the turn of Tristan Handy, Founder and CEO of dbt Labs (arguably inventor of the term?):

> Today, I’m swearing off using the term “modern data stack” and I think you probably should too.
> It turns out, you just don’t need it.
> the cloud has won; all data companies are now cloud data companies. Let’s move on.

https://roundup.getdbt.com/p/is-the-modern-data-stack-still-a

via @ananth 's newsletter

#ModernDataStack

Nice read: Hot takes on the modern datastack, covering dbt, redshift, airflow, airbyte, and data warehouse complexity in general https://mattpalmer.io/posts/hot-takes/ #dataengineering #moderndatastack

Nice read: Hot takes on the modern datastack, covering dbt, redshift, airflow, airbyte, and data warehouse complexity in general https://mattpalmer.io/posts/hot-takes/ #dataengineering #moderndatastack

Good to see the #drillToDetail podcast with Mark Rittman has returned.

This episode with Chris Tabb was a useful chat about current & future tooling including the #modernDataStack, along with a look back at what's been done before and what we can learn from that.

https://www.rittmananalytics.com/drilltodetail/2023/2/15/drill-to-detail-ep99-is-the-modern-data-stack-dead-with-special-guest-chris-tabb

#datadon #podcast #data #dataengineering

Good to see the #drillToDetail podcast with Mark Rittman has returned.

This episode with Chris Tabb was a useful chat about current & future tooling including the #modernDataStack, along with a look back at what's been done before and what we can learn from that.

https://www.rittmananalytics.com/drilltodetail/2023/2/15/drill-to-detail-ep99-is-the-modern-data-stack-dead-with-special-guest-chris-tabb

#datadon #podcast #data #dataengineering

🗣️"The #ModernDataStack [is] probably just marketing buzz…"

Of course, it's more nuanced than that, but you can rely on @benn for a nice 🌶️soundbite ;) @benn has a very approachable way of explaining his view on things in a clear yet detailed way. This was a really good Analytics Engineering podcast episode from late 2021 from @jthandy and @schottj.

🎧 https://overcast.fm/+w94VRRIio/
✍🏻 https://roundup.getdbt.com/p/benn-stancil-friday-night-data-fights

🗣️"The #ModernDataStack [is] probably just marketing buzz…"

Of course, it's more nuanced than that, but you can rely on @benn for a nice 🌶️soundbite ;) @benn has a very approachable way of explaining his view on things in a clear yet detailed way. This was a really good Analytics Engineering podcast episode from late 2021 from @jthandy and @schottj.

🎧 https://overcast.fm/+w94VRRIio/
✍🏻 https://roundup.getdbt.com/p/benn-stancil-friday-night-data-fights

I'm going to pin it down; It will be interesting to search in all MDS vendor's blogs how many times they mentioned Data Contract
#datacontract #datadon #moderndatastack

I'm going to pin it down; It will be interesting to search in all MDS vendor's blogs how many times they mentioned Data Contract
#datacontract #datadon #moderndatastack

Ok who's going to "Modern Data Stack Conference" in SF in April? Is this a thing that would be worth attending?
#datadon #conferences #ModernDataStack

Ok who's going to "Modern Data Stack Conference" in SF in April? Is this a thing that would be worth attending?
#datadon #conferences #ModernDataStack

If the #moderndatastack were a thanksgiving meal...

What would cranberry sauce be?

#data #datadon

If the #moderndatastack were a thanksgiving meal...

What would cranberry sauce be?

#data #datadon

Two observations from my #Twexodus of the past three days:
- the #infosec and #cybersec communities are well represented and well organized here in the #fediverse
- I am having a devil of a time finding folks involved with #DataHusbandry (my own term that covers the care & feeding of the dataset and metadataset)

Where is the conversation on #DataEngineering ? #ModernDataStack ?
#DataMesh ?

I'm leavin' these hashtags here in hopes of finding kindred spirits.

Two observations from my #Twexodus of the past three days:
- the #infosec and #cybersec communities are well represented and well organized here in the #fediverse
- I am having a devil of a time finding folks involved with #DataHusbandry (my own term that covers the care & feeding of the dataset and metadataset)

Where is the conversation on #DataEngineering ? #ModernDataStack ?
#DataMesh ?

I'm leavin' these hashtags here in hopes of finding kindred spirits.

Panacea?

#data #datadon #ModernDataStack

👀 I've interviewed numerous data leaders in the past few weeks trying to learn how you build out scalable data infrastructure.

LESSON 3:

📌 A great way to get buyin is to start measuring the various steps in your data pipeline to understand what's not working. Leading with observability highlights the risk and urgency of data infrastructure and helps leadership tie it to business outcomes.

#data #datascience #dataengineering #dataops #sql #python #moderndatastack #cloud

👀 I've interviewed numerous data leaders in the past few weeks trying to learn how you build out scalable data infrastructure.

LESSON 2:

📌 It's not enough to know the best practices in data infrastructure, you actively have to 1) find your champion to sponsor infrastructure, and 2) sell the solution within your org for either build or buy.

#data #datascience #dataengineering #dataops #sql #python #moderndatastack #cloud

👀 I've interviewed numerous data leaders in the past few weeks trying to learn how you build out scalable data infrastructure.

LESSON 1:

📌 The data industry had a huge shift in workflows with the transition cloud-- making it easier than ever before to store and compute data. This rush to data without gaurdrails are leading to intense reactivity among data professionals and thus burnout.

#data #datascience #dataengineering #dataops #sql #python #moderndatastack #cloud

@jayatid @arynn

#moderndatastack
#etl
#elt
#machinelearningfairness