#datawarehousing — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #datawarehousing, aggregated by home.social.
-
Postdoc Position in Data Warehousing @ TU Wien (Vienna)
Research on #dataWarehousing, #analytics & #databasePerformance bridging #dataSystems and #LLM interfaces.
Deadline: May 21, 2026
Application portal:
https://jobs.tuwien.ac.at/Job/266692 -
Postdoc Position in Data Warehousing @ TU Wien (Vienna)
Research on #dataWarehousing, #analytics & #databasePerformance bridging #dataSystems and #LLM interfaces.
Deadline: May 21, 2026
Application portal:
https://jobs.tuwien.ac.at/Job/266692 -
Postdoc Position in Data Warehousing @ TU Wien (Vienna)
Research on #dataWarehousing, #analytics & #databasePerformance bridging #dataSystems and #LLM interfaces.
Deadline: May 21, 2026
Application portal:
https://jobs.tuwien.ac.at/Job/266692 -
Postdoc Position in Data Warehousing @ TU Wien (Vienna)
Research on #dataWarehousing, #analytics & #databasePerformance bridging #dataSystems and #LLM interfaces.
Deadline: May 21, 2026
Application portal:
https://jobs.tuwien.ac.at/Job/266692 -
Postdoc Position in Data Warehousing @ TU Wien (Vienna)
Research on #dataWarehousing, #analytics & #databasePerformance bridging #dataSystems and #LLM interfaces.
Deadline: May 21, 2026
Application portal:
https://jobs.tuwien.ac.at/Job/266692 -
Just finished Analytics Engineering with dbt in @DataTalksClub's free course – a deep dive into building data pipelines for analytics. 🚀
Key learnings:
✅️ Built transformation models with dbt from raw CSV/Parquet files in Google Cloud Storage
✅️ Designed dimensional data warehouse schema (staging, intermediate tables) implemented in BigQuery
✅️ Implemented comprehensive data quality checks using dbt tests to ensure reliable analytics
✅️ Mapped dependencies & lineage with dbt visualization tools for optimized performance
✅️ Analyzed NYC taxi revenue patterns across zones using SQL window functionsReally enjoying transforming raw data into actionable insights! Check out my project:
https://github.com/ammartin8/data_engineering_zoom_camp/blob/main/modules/module_4/project_04/README.md#dataengineering #dbt #analyticalengineering #analytics #datanalytics #datawarehousing #fedihire #ai #tech #linux #data #dev #sql #code #mastodon #learning
-
There is no need to move data. Data latency is minimised. Data can be transformed and analysed within a single platform.
Let me know what you know about Zero-ETL :blobcoffee:
Why ETL-Zero? Understanding the shift in Data Integration“ by Sarah Lea on Medium: https://medium.com/towards-data-science/why-etl-zero-understanding-the-shift-in-data-integration-as-a-beginner-d0cefa244154
#python #datalake #cloudcomputing #etl #zeroetl #salesforce #data #tech #technology #datawarehousing #datalakehouse
-
The Hadoop ecosystem comprises various tools and frameworks designed to handle large-scale data processing and analytics. Let's discuss the core components, namely Hadoop, HBase, and Hive, along with other significant tools such as Pig, Sqoop, Flume, Oozie, and Zookeeper.
https://linuxexpert.org/so-you-wanna-do-big-data/
#Hadoop #HBase #Hive #BigData #HadoopEcosystem #HDFS #MapReduce #YARN #Pig #Sqoop #Flume #Oozie #Zookeeper #DataProcessing #DataAnalytics #DataWarehousing #ETL #DataIngestion #Security
-
The Hadoop ecosystem comprises various tools and frameworks designed to handle large-scale data processing and analytics. Let's discuss the core components, namely Hadoop, HBase, and Hive, along with other significant tools such as Pig, Sqoop, Flume, Oozie, and Zookeeper.
https://linuxexpert.org/so-you-wanna-do-big-data/
#Hadoop #HBase #Hive #BigData #HadoopEcosystem #HDFS #MapReduce #YARN #Pig #Sqoop #Flume #Oozie #Zookeeper #DataProcessing #DataAnalytics #DataWarehousing #ETL #DataIngestion #Security
-
The Hadoop ecosystem comprises various tools and frameworks designed to handle large-scale data processing and analytics. Let's discuss the core components, namely Hadoop, HBase, and Hive, along with other significant tools such as Pig, Sqoop, Flume, Oozie, and Zookeeper.
https://linuxexpert.org/so-you-wanna-do-big-data/
#Hadoop #HBase #Hive #BigData #HadoopEcosystem #HDFS #MapReduce #YARN #Pig #Sqoop #Flume #Oozie #Zookeeper #DataProcessing #DataAnalytics #DataWarehousing #ETL #DataIngestion #Security
-
The Hadoop ecosystem comprises various tools and frameworks designed to handle large-scale data processing and analytics. Let's discuss the core components, namely Hadoop, HBase, and Hive, along with other significant tools such as Pig, Sqoop, Flume, Oozie, and Zookeeper.
https://linuxexpert.org/so-you-wanna-do-big-data/
#Hadoop #HBase #Hive #BigData #HadoopEcosystem #HDFS #MapReduce #YARN #Pig #Sqoop #Flume #Oozie #Zookeeper #DataProcessing #DataAnalytics #DataWarehousing #ETL #DataIngestion #Security
-
The Hadoop ecosystem comprises various tools and frameworks designed to handle large-scale data processing and analytics. Let's discuss the core components, namely Hadoop, HBase, and Hive, along with other significant tools such as Pig, Sqoop, Flume, Oozie, and Zookeeper.
https://linuxexpert.org/so-you-wanna-do-big-data/
#Hadoop #HBase #Hive #BigData #HadoopEcosystem #HDFS #MapReduce #YARN #Pig #Sqoop #Flume #Oozie #Zookeeper #DataProcessing #DataAnalytics #DataWarehousing #ETL #DataIngestion #Security
-
Databricks expands Mosaic AI support for generative AI apps - Databricks is getting ready to offer more support to enterprises building generative A... - https://www.infoworld.com/article/3715542/databricks-expands-mosaic-ai-support-for-generative-ai-apps.html#tk.rss_all #datawarehousing #generativeai
-
Snowflake updates its Horizon governance suite - Snowflake has announced new capabilities for its Horizon suite, a built-in set of comp... - https://www.infoworld.com/article/3715418/snowflake-updates-its-horizon-governance-suite.html#tk.rss_all #datawarehousing #datagovernance
-
Snowflake adds AI & ML Studio, new chatbot features to Cortex - Cloud-based data warehouse company Snowflake is adding more large language model (LLM)... - https://www.infoworld.com/article/3715502/snowflake-adds-ai-and-ml-studio-new-chatbot-features-to-cortex.html#tk.rss_all #datawarehousing #generativeai
-
Snowflake updates developer tools, adds observability features - Cloud-based data warehouse company Snowflake has added a new development interface for... - https://www.infoworld.com/article/3715501/snowflake-updates-developer-tools-adds-observability-features.html#tk.rss_all #datawarehousing #devops
-
Snowflake adopts open source strategy to grab data catalog mind share - Snowflake says it will open up the source code to its new Polaris Catalog, a strategy ... - https://www.infoworld.com/article/3715319/snowflake-adopts-open-source-strategy-to-grab-data-catalog-mind-share.html#tk.rss_all #datawarehousing #datamanagement
-
Snowflake acquires TruEra’s AI observability platform - Cloud-based data warehouse company Snowflake is acquiring assets in the form of an obs... - https://www.infoworld.com/article/3715271/snowflake-acquires-truera-s-ai-observability-platform.html#tk.rss_all #artificialintelligence #datawarehousing
-
Google delivers Gemini LLM support to BigQuery data warehouse - Google is integrating its Gemini 1.0 Pro large language model with its AI and machine ... - https://www.infoworld.com/article/3713341/google-delivers-gemini-llm-support-to-bigquery-data-warehouse.html#tk.rss_all #googlecloudplatform #datawarehousing #generativeai
-
Snowflake to add developer tools to Snowpark, plans cost management feature - At its annual Snowday conference on Wednesday, cloud-based data warehouse company Snow... - https://www.infoworld.com/article/3709612/snowflake-to-add-developer-tools-to-snowpark-plans-cost-management-feature.html#tk.rss_all #developmenttools #datawarehousing #cloudcomputing
-
Snowflake’s Cortex to bring generative AI to its Data Cloud platform - Cloud-based data warehouse company Snowflake is adding more large language model capab... - https://www.infoworld.com/article/3709518/snowflake-s-cortex-to-bring-generative-ai-to-its-data-cloud-platform.html#tk.rss_all #datawarehousing #generativeai
-
Starburst Enterprise, Galaxy updated to support on-prem connectivity, storage - Data lake and analytics platform provider Starburst is adding new capabilities to its ... - https://www.infoworld.com/article/3707328/starburst-enterprise-galaxy-updated-to-support-on-prem-connectivity-storage.html#tk.rss_all #enterprisestorage #datawarehousing
-
Six faves from the #MCN2023 program in chrono order, 5/6:
Navigating Complexity: Insights from the Implementation of MoMA’s Data Warehouse Project
-
Six faves from the #MCN2023 program in chrono order, 5/6:
Navigating Complexity: Insights from the Implementation of MoMA’s Data Warehouse Project
-
Six faves from the #MCN2023 program in chrono order, 5/6:
Navigating Complexity: Insights from the Implementation of MoMA’s Data Warehouse Project
-
Six faves from the #MCN2023 program in chrono order, 5/6:
Navigating Complexity: Insights from the Implementation of MoMA’s Data Warehouse Project
-
Six faves from the #MCN2023 program in chrono order, 5/6:
Navigating Complexity: Insights from the Implementation of MoMA’s Data Warehouse Project
-
Snowflake’s Government and Education Data Cloud focuses on security, data tools - Snowflake on Tuesday said it is making another industry-specific product available in ... - https://www.infoworld.com/article/3698279/snowflake-s-government-and-education-data-cloud-focuses-on-security-data-tools.html#tk.rss_all #datawarehousing #datamanagement
-
How to explain data meshes, fabrics, and clouds - Your CEO knows what a database is and probably thinks a data warehouse is a large data... - https://www.infoworld.com/article/3695536/how-to-explain-data-meshes-fabrics-and-clouds.html#tk.rss_all #dataarchitecture #datawarehousing #datamanagement #cloudcomputing
-
Databricks launches lakehouse for manufacturing sector - Databricks on Tuesday announced an industry-specific data lakehouse for the manufactur... - https://www.infoworld.com/article/3692254/databricks-launches-lakehouse-for-manufacturing-sector.html#tk.rss_all #datawarehousing #database
-
Snowflake’s Telecom Data Cloud bets on accelerating cloud efficiency - Snowflake on Wednesday said it was making another industry-specific product available ... - https://www.infoworld.com/article/3688337/snowflakes-telecom-data-cloud-bets-on-accelerating-cloud-efficiency.html#tk.rss_all #datawarehousing #cloudcomputing
-
@maynoothuni Perhaps we need to break out of the mindset that only people out “forrin” can have insights on the practicalities of doing data stuff.
After all, #DataWarehousing was invented in Ireland in the 1980s, and some of the most innovative #DataQuality and data integration companies that emerged in the early 2000s had Irish roots.
-
Catching an excellent seafood dinner w/folks like @joereis, Matt Housley, Juan Sequenda, Bill Inmon, Chris Tabb, Ryan Dolley, Tim Gasper and more folks!
#DataDayTexas2023 #ddtx23 #dataengineering #dataops #datawarehousing
-
Snowflake to acquire Myst AI to provide time series forecasting - Cloud-based data warehouse company Snowflake has agreed to acquire artificial intellig... - https://www.infoworld.com/article/3684770/snowflake-to-acquire-myst-ai-to-provide-time-series-forecasting.html#tk.rss_all #predictiveanalytics #datawarehousing
-
How would you characterize the relationship between schematization and deserialization? #datadon #etl #elt #datawarehousing
-
This is my second #fediverse instance installation, this time with #calckey - so I suppose that I should go ahead and have a second #introduction post.
For those that may - or may not - be curious, my other account is @[email protected]
I'm a #parent to five boys, including a pair of #twins - so you may or may not see some postings of #family related activities around these parts. I have a love of all things #tech or #technology related, whether or not that's a good thing is yet to be determined.
I work in #HigherEducation as what is basically an #ApplicationAdministrator with daily experience in #Oracle and #DataWarehousing while trying to maintain my sanity. Ha.
I like to learn new things and have dabbled in #Lisp and #Clojure and while I am able to use #vim I do find myself veering towards the #emacs camp when I can.
You'll find that I post about a good variety of things, I hope, including #movies, #television, #books and other stuff. -
CW: dbt model materialization patterns
Do you materialize as table by default? View? How much do you use ephemeral materialization? When is a view better than a table?
My team has pretty small data and we use tables for everything except event streams (incremental) and some intermediate (ephemeral) models.
I'm really curious what other teams' materialization patterns are like.
#datadon #dbt #DataModeling #AnalyticsEngineering #DataWarehousing
-
Data lake upstart Upsolver takes aim at Databricks - San Francisco-based startup Upsolver is launching a new service, dubbed SQLake, that c... - https://www.infoworld.com/article/3679629/data-lake-upstart-upsolver-takes-aim-at-databricks.html#tk.rss_all #dataengineering #datawarehousing #datamanagement #datascience #analytics
-
BrandPost: Data Storage Power: Preparing for an Intelligent Digital Future - As the world’s digital economy continues to grow and mature, digital infrastructure ha... - https://www.computerworld.com/article/3678358/data-storage-power-preparing-for-an-intelligent-digital-future.html#tk.rss_all #datawarehousing #flashstorage
