#datawarehouse — Public Fediverse posts

💡 Databricks Advanced Security with RBAC, RLS & ABAC

Our newest blog-post summarizes authorization patterns on the Databricks platform. How do role-based and attribute-based access control mix with row- and column-level security? All you need to know in a concise little write-up:

🔗 https://www.nextlytics.com/blog/master-databricks-security-with-rbac-rls-abac

#databricks #dataengineering #datascience #sapdatabricks #businessintelligence #blog #azuredatabricks #datawarehouse #datagovernance #unitycatalog

The Data Lakehouse Explained: Why Apache Iceberg Is Quietly Running the Show

https://techlife.blog/posts/data-lakehouse-iceberg

#ApacheIceberg #DataLakehouse #DataWarehouse #DataLake #Snowflake #ApacheSpark #DataEngineering

Datos de Forma Deliberada: Mejores Prácticas para EDW

https://goodstrat.com/2026/03/24/datos-de-forma-deliberada-mejores-practicas-para-edw/

Datos de Forma Deliberada: Mejores Prácticas para EDW

https://goodstrat.com/2026/03/24/datos-de-forma-deliberada-mejores-practicas-para-edw/

Datos de Forma Deliberada: Mejores Prácticas para EDW

https://goodstrat.com/2026/03/24/datos-de-forma-deliberada-mejores-practicas-para-edw/

Datos de Forma Deliberada: Mejores Prácticas para EDW

https://goodstrat.com/2026/03/24/datos-de-forma-deliberada-mejores-practicas-para-edw/

Datos de Forma Deliberada: Mejores Prácticas para EDW

https://goodstrat.com/2026/03/24/datos-de-forma-deliberada-mejores-practicas-para-edw/

Confused by Data Warehouse vs. Data Lake vs. Data Mesh?

Think of it this way:
- 📦 Warehouse = organized storage room
- 🌊 Lake = throw everything in, sort later
- 🕸️ Mesh = each team owns and serves its own data - but there is still a common hub.

The key insight: Mesh isn't a storage technology. You can run a Data Mesh on top of a Warehouse or Lake. It's about ownership, not infrastructure.

👉 https://www.kdnuggets.com/data-lake-vs-data-warehouse-vs-lakehouse-vs-data-mesh-whats-the-difference

#DataMesh #DataLake #DataWarehouse #DataLiteracy
— bos | 🖼️ ai-generated

Confused by Data Warehouse vs. Data Lake vs. Data Mesh?

Think of it this way:
- 📦 Warehouse = organized storage room
- 🌊 Lake = throw everything in, sort later
- 🕸️ Mesh = each team owns and serves its own data - but there is still a common hub.

The key insight: Mesh isn't a storage technology. You can run a Data Mesh on top of a Warehouse or Lake. It's about ownership, not infrastructure.

👉 https://www.kdnuggets.com/data-lake-vs-data-warehouse-vs-lakehouse-vs-data-mesh-whats-the-difference

#DataMesh #DataLake #DataWarehouse #DataLiteracy
— bos | 🖼️ ai-generated

Every data professional should understand these seven core concepts.

From data warehouses and lakes to pipelines, meshes, and governance, these form the foundation of modern analytics infrastructure.
Mastering them bridges the gap between raw data and actionable business insights.

📕 https://ebokify.com/ai-data-science

#DataEngineering #DataScience #DataAnalytics #ETL #DataWarehouse #BigData #BusinessIntelligence #DataPipeline #DataGovernance

DATA WORLD: Data Warehouse Action: Big Business Drivers

https://goodstrat.com/2026/02/11/data-warehouse-musings-drivers/

Warehouse Snapshots in Microsoft Fabric
#DataWarehouse #SQL #MicrosoftFabric #ETL #DataScience #analytics
https://blog.fabric.microsoft.com/en-US/blog/warehouse-snapshots-in-microsoft-fabric-freeze-data-unlock-reliable-reporting/?wt.mc_id=DP-MVP-4015656

Ingest files into your Fabric Data Warehouse using the OPENROWSET function
#DataWarehouse #SQL #MicrosoftFabric #DataIngestion
https://blog.fabric.microsoft.com/en-US/blog/ingest-files-into-your-fabric-data-warehouse-using-the-openrowset-function/?wt.mc_id=DP-MVP-4015656

OneLake Security on the SQL Analytics Endpoint
#DataWarehouse #Lakehouse #MicrosoftFabric #OneLake #Cybersecurity #DataSecurity
https://blog.fabric.microsoft.com/en-US/blog/onelake-security-on-the-sql-analytics-endpoint/?wt.mc_id=DP-MVP-4015656

OneLake Security on the SQL Analytics Endpoint
#DataWarehouse #Lakehouse #MicrosoftFabric #OneLake #Cybersecurity #DataSecurity
https://blog.fabric.microsoft.com/en-US/blog/onelake-security-on-the-sql-analytics-endpoint/?wt.mc_id=DP-MVP-4015656

When the boss explain the story of datawarehouse architecture. https://williaminmon.substack.com/p/a-tale-of-two-architectures-kimball #inmon #datawarehouse #kimball #datavault #dv2 #dfakto

Resolving Write Conflicts in Microsoft Fabric Data Warehouse
#MicrosoftFabric #DataWarehouse #TSQL #DDL
https://blog.fabric.microsoft.com/en-US/blog/concurrency-control-and-conflict-resolution-in-microsoft-fabric-data-warehouse/?wt.mc_id=DP-MVP-4015656

✅ Advanced Data Warehousing in Databricks with DBT Macros and Snapshots

💡 Read our latest blog post to learn how to use advanced features of the dbt data modeling framework to harmonize Data Warehouse routine tasks like history-preserving merges.

https://www.nextlytics.com/blog/advanced-data-warehousing-in-databricks-with-dbt-macros-and-snapshots

#blog #databricks #dbt #datawarehouse #dataengineering #businessintelligence #nextlytics

RE: https://saptodon.org/@nextlytics/115501853415430874

Our #webinar from last week is available as an on-demand recording for anyone who missed it. How can #SAP Business Data Cloud interact with a wider ecosystem of modern data platforms like #Databricks, #Snowflake, #BigQuery, and (new this week) #Fabric? Where does this trend lead?

Spoiler: maybe truly open players have the advantage in the future interoperable data ecosystem over old-fashioned proprietary-first vendors...

#datascience #dataengineering #datawarehouse #datalakehouse #lakehouse

Airbyte 2.0: Data integration up to six times faster

The open-source platform Airbyte is released in version 2.0 with significantly higher sync speed, data activation, and a hybrid enterprise approach.

https://www.heise.de/en/news/Airbyte-2-0-Data-integration-up-to-six-times-faster-10777855.html?wt_mc=sm.red.ho.mastodon.mastodon.md_beitraege.md_beitraege&utm_source=mastodon

#DataWarehouse #Datenintegration #DSGVO #IT #Kubernetes #OpenSource #news

Airbyte 2.0: Datenintegration bis zu sechsmal schneller

Die Open-Source-Plattform Airbyte erscheint in Version 2.0 mit deutlich höherer Sync-Geschwindigkeit, Data Activation und einem hybriden Enterprise-Ansatz.

https://www.heise.de/news/Airbyte-2-0-Datenintegration-bis-zu-sechsmal-schneller-10777748.html?wt_mc=sm.red.ho.mastodon.mastodon.md_beitraege.md_beitraege&utm_source=mastodon

#DataWarehouse #Datenintegration #DSGVO #IT #Kubernetes #OpenSource #news

Unveiling the latest visual for 'Data Science for the Modern Enterprise'! This one maps the crucial journey from raw data to meaningful insights, covering Database Design and Data Warehouse Design.
​It's the backbone of any robust data strategy! What are the biggest challenges you've faced in designing or maintaining effective databases and data warehouses? Let's connect and share experiences! 👇
​#DatabaseDesign #DataWarehouse #DataScience #DataArchitecture #SQL #ETL #OLAP #DataManagement #Tech

Paris: Apache Iceberg Paris Community Meetup #1, Le jeudi 19 juin 2025 de 18h00 à 21h30. https://www.agendadulibre.org/events/32653 #data #dataLakehouse #dataEngineer #dataScience #dataPlatform #dataWarehouse #apacheIceberg

📅 Le 17 juin 2025 à 14h, j’animerai un webinaire gratuit sur les bases du #DataVault, en partenariat avec la #CFDV (Communauté Francophone du Data Vault).
🔗 Inscription : https://app.livestorm.co/cfdv/communaute-francophone-du-data-vault-initiation-au-data-vault #datamanagement #DataWarehouse #formation #webinaire

One of the most highlighted parts: "There is no need to move data. Data latency is minimised. Data can be transformed and analysed within a single platform.“

This is one of the reasons for 'Why ETL-Zero' :blobcoffee:

https://towardsdatascience.com/why-etl-zero-understanding-the-shift-in-data-integration-as-a-beginner-d0cefa244154

#data #datascience #dataanalysis #dataanalytics #DataEngineering #sql #salesforce #etl #datawarehouse #datalake #datalakehouse #programming

In a data warehouse you store structured & organized data. In a data lake you can additionally store unstructured data. And was is now a data lakehouse?

Think of a combination of the strengths of both previous data platforms. :blobcoffee:

https://towardsdatascience.com/sql-and-data-modelling-in-action-a-deep-dive-into-data-lakehouses-fcbab9a4b9c2

#data #DataEngineering #datalakehouse #datacenters #datawarehouse #datalake #datascience #sql

Trying to build my first Data Vault model in #Snowflake. But I'm not quite understanding the concept of hash keys. My source system already has a sequence as a surrogate key and just creating a hash of that value seems to serve no purpose.

I can understand it if I didn't always have a surrogate key but why should I use them if I do?
#sqlhelp #datawarehouse #datavault #datadesign

More flexible data integration with the open source platform Airbyte 1.0

Airbyte extracts data from various sources and APIs and merges them into a central platform – including vector databases.

https://www.heise.de/en/news/More-flexible-data-integration-with-the-open-source-platform-Airbyte-1-0-9953875.html?wt_mc=sm.red.ho.mastodon.mastodon.md_beitraege.md_beitraege&utm_source=mastodon

#API #DataWarehouse #Datenbanken #Datenintegration #news

𝐃𝐚𝐭𝐚'𝐬 𝐄𝐯𝐨𝐥𝐮𝐭𝐢𝐨𝐧 𝐢𝐧 𝐒𝐡𝐚𝐩𝐢𝐧𝐠 𝐁𝐮𝐬𝐢𝐧𝐞𝐬𝐬 𝐒𝐭𝐫𝐚𝐭𝐞𝐠𝐢𝐞𝐬 𝐚𝐧𝐝 𝐃𝐞𝐜𝐢𝐬𝐢𝐨𝐧-𝐌𝐚𝐤𝐢𝐧𝐠 𝐏𝐫𝐨𝐜𝐞𝐬𝐬𝐞𝐬

The role of data in shaping business strategies and decision-making processes is rapidly evolving. Here are some key trends and developments that will continue to fuel this evolution:

https://www.foxconsulting.co/post/data-s-evolution-in-shaping-business-strategies-and-decision-making-processes

#businessintelligence #dataanalytics #datastrategy #datainitiatives #datawarehouse #datamanagement #datagovernance #dataprofiling #metadatamanagement #dataquality #testautomation #datatrust #datafitness

I mentioned that @czds and I begun working with #IoT data in 2000. This is soon after Kevin Ashton coined the term #InternetOfThings and #RFID played a part in our use of #IoT #Analytics. We were heading a professional services firm at the time, focused on data management and analytics, #DataWarehouse #DataMarts #BusinessIntelligence #BI and a friend of a member of our Board had a RFID chips factory. We were asked how we would use that data in #SupplyChain analytics #IoTday #IoTday2024 10/16

Dive into the world of #GraphNeuralNetworks (GNNs)!

Discover their advantages over traditional machine learning and have a quick primer on graph representation learning using PyG, a popular open-source GNN library.

🎥 Watch now on #InfoQ: https://bit.ly/3UXutls

#transcript included

#PyG #GNNs #opensource #ML #DataWarehouse

Wir freuen uns! syntegris ist wieder Silber-Partner unserer IT-Tage 2023! 🚀
#ittage @syntegris #datawarehouse #datavault
https://www.ittage.informatik-aktuell.de/partner/syntegris-information-solutions-gmbh.html

GRID³ - GeoReferenced Infrastructure & Demographic Data For Development
--
https://grid3.org/ <-- home page
--
#GIS #spatial #mapping #GRID3 #infrastructure #demographic #development #humanitarian #communityengagement #community #communityhealth #communitydevelopment #communitycollaboration #Africa #government #UnitedNations #spatialsolutions #toolbox #decisionmaking #remotesensing #imagery #datawarehouse #model #modeling #nations #publichealth #publicsafety

After almost two years of work, we just complete the certification of the dFakto dataFaktory solution by the Datavault Alliance. https://datavaultalliance.com/certified-software-tools/ #data #datavault #datavaultalliance #datawarehouse #automation #analytics. Even if you don't care take a drink for me today 🍾

detailed and genuinely useful blog on how we built our internal data warehouse on #ClickHouse at ClickHouse

https://clickhouse.com/blog/building-a-data-warehouse-with-clickhouse

#ClickHouse #DataWarehouse
starring
#Superset #AppFlow #Airflow #Redis #Docker #opensource #RDS #PostgreSQL #DBT
and including data from
#Salesforce #AWS #S3 #BigQuery #M3ter #Segment #Marketo

🚨📅 SAVE THE DATE : 29 Juin - La Communauté francophone du Data Vault organise son premier évènement à Paris ! 🚨 les places sont limitées, inscrivez-vous vite ! https://linkedin.com/events/meetupcommunaut-francophoneduda7071387276831854593/ #datavault #Paris #datawarehouse #dfakto #followus #meetup #data #snowflake #sqlserver #postgresql

@stephensmith With the exponential expansion of info locked up in unstructured data in the form of images, video, audio, documents, using the traditional monolithic data warehouse based on system generated normalised data to gain organisational insights (via the so-called Inmon method) became rather outmoded #DataLakes #DataWarehouse #UnstructuredData

@stephensmith data warehouses store _structured_ data i.e. traditional, rigid table / row / columnar information usually produced by systems, for purposes of read-heavy analytics processing, e.g. customer data with cust id, address lines, name, forename, phone numbers, etc; data _lakes_ allow mass storage of _unstructured_ data, usually generated by humans, also for the purposes of analytics processing. #DataLakes #DataWarehouse #UnstructuredData

Dans Linstedt, Ken Graziano and Bill Inmon at #wwdvc #datavault #datawarehouse

#DataWarehouse, #DataLake, #DataMesh, Oh My: The History of #Data #Storage. Looking to get into #DataMesh or curious if your #DataLake is already obsolete? Join us at #GIDS #DeveloperSummit #InPerson https://developersummit.com/, slides: https://robrich.org/slides/data-warehouse-mesh-lake/

#DataWarehouse, #DataLake, #DataMesh, Oh My: The History of #Data #Storage. Looking to get into #DataMesh or curious if your #DataLake is already obsolete? Join us at #GIDS #DeveloperSummit #InPerson https://developersummit.com/, slides: https://robrich.org/slides/data-warehouse-mesh-lake/

#DataWarehouse, #DataLake, #DataMesh, Oh My: The History of #Data #Storage. Looking to get into #DataMesh or curious if your #DataLake is already obsolete? Join us at #GIDS #DeveloperSummit #InPerson https://developersummit.com/, slides: https://robrich.org/slides/data-warehouse-mesh-lake/

New Blog Post Alert!

How do you work with Pull Requests in #AzureDevOps? I have written down how I use them in the development process of our #datawarehouse development using #DatabaseProjects. How Pull Requests allowed me to introduce #PeerReviewing into the development process.

Find out how to get started with #PullRequests in #AzureDevOps!

https://www.oliviervs.be/database-projects/database-projects-working-with-pull-requests/

Looking for people working with #datavault and #datawarehouse automation. Recommendations welcomed !

A Comprehensive Guide to Data Virtualization for Enterprises - Enterprises are aggressively investigating beyond the capabilities of traditional ... - https://readwrite.com/guide-to-data-virtualization-for-enterprises/ #datavirtualization #dataandsecurity #datawarehouse #enterprises #blockchain #datalake #bigdata #etl #ai

Edge Delta raises $15M Series A to take on Splunk - Seattle-based Edge Delta, a startup that is building a modern distributed monitori... - http://feedproxy.google.com/~r/Techcrunch/~3/6tfDqvN9e14/ #informationtechnology #businessintelligence #systemadministration #macventurecapital #machinelearning #recentfunding #datawarehouse #menloventures #datasecurity #enterprise #technology #computing #microsoft #real-time #sumologic #startups #newrelic #bigdata #datadog #seattle #splunk #cloud #tc