#datapipeline — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #datapipeline, aggregated by home.social.
-
Romans invented data pipelines. We checked. The engineering holds up.
-
Romans invented data pipelines. We checked. The engineering holds up.
-
Romans invented data pipelines. We checked. The engineering holds up.
-
Romans invented data pipelines. We checked. The engineering holds up.
-
Romans invented data pipelines. We checked. The engineering holds up.
-
Every data professional should understand these seven core concepts.
From data warehouses and lakes to pipelines, meshes, and governance, these form the foundation of modern analytics infrastructure.
Mastering them bridges the gap between raw data and actionable business insights.📕 https://ebokify.com/ai-data-science
#DataEngineering #DataScience #DataAnalytics #ETL #DataWarehouse #BigData #BusinessIntelligence #DataPipeline #DataGovernance
-
Every data professional should understand these seven core concepts.
From data warehouses and lakes to pipelines, meshes, and governance, these form the foundation of modern analytics infrastructure.
Mastering them bridges the gap between raw data and actionable business insights.📕 https://ebokify.com/ai-data-science
#DataEngineering #DataScience #DataAnalytics #ETL #DataWarehouse #BigData #BusinessIntelligence #DataPipeline #DataGovernance
-
Every data professional should understand these seven core concepts.
From data warehouses and lakes to pipelines, meshes, and governance, these form the foundation of modern analytics infrastructure.
Mastering them bridges the gap between raw data and actionable business insights.📕 https://ebokify.com/ai-data-science
#DataEngineering #DataScience #DataAnalytics #ETL #DataWarehouse #BigData #BusinessIntelligence #DataPipeline #DataGovernance
-
Every data professional should understand these seven core concepts.
From data warehouses and lakes to pipelines, meshes, and governance, these form the foundation of modern analytics infrastructure.
Mastering them bridges the gap between raw data and actionable business insights.📕 https://ebokify.com/ai-data-science
#DataEngineering #DataScience #DataAnalytics #ETL #DataWarehouse #BigData #BusinessIntelligence #DataPipeline #DataGovernance
-
Every data professional should understand these seven core concepts.
From data warehouses and lakes to pipelines, meshes, and governance, these form the foundation of modern analytics infrastructure.
Mastering them bridges the gap between raw data and actionable business insights.📕 https://ebokify.com/ai-data-science
#DataEngineering #DataScience #DataAnalytics #ETL #DataWarehouse #BigData #BusinessIntelligence #DataPipeline #DataGovernance
-
🔥 Hot take alert! 🔥 "I would love there to be a SaaS apocalypse" in observability – that's according to Ari Zilka, CEO at #datapipeline engine startup MyDecisive AI, and a former exec at New Relic and #
Hortonworks. MyDecisive's #opensourcesoftware targets data management costs from #observability vendors such as Datadog by reducing data at the source; it can also proactively alert on and take action on #OpenTelemetry data as it comes in from enterprise applications.If Zilka has his way, #o11y will return to enterprises as an in-house discipline, but without requiring an army of engineers to set it up.
-
🔥 Hot take alert! 🔥 "I would love there to be a SaaS apocalypse" in observability – that's according to Ari Zilka, CEO at #datapipeline engine startup MyDecisive AI, and a former exec at New Relic and #
Hortonworks. MyDecisive's #opensourcesoftware targets data management costs from #observability vendors such as Datadog by reducing data at the source; it can also proactively alert on and take action on #OpenTelemetry data as it comes in from enterprise applications.If Zilka has his way, #o11y will return to enterprises as an in-house discipline, but without requiring an army of engineers to set it up.
-
🔥 Hot take alert! 🔥 "I would love there to be a SaaS apocalypse" in observability – that's according to Ari Zilka, CEO at #datapipeline engine startup MyDecisive AI, and a former exec at New Relic and #
Hortonworks. MyDecisive's #opensourcesoftware targets data management costs from #observability vendors such as Datadog by reducing data at the source; it can also proactively alert on and take action on #OpenTelemetry data as it comes in from enterprise applications.If Zilka has his way, #o11y will return to enterprises as an in-house discipline, but without requiring an army of engineers to set it up.
-
🔥 Hot take alert! 🔥 "I would love there to be a SaaS apocalypse" in observability – that's according to Ari Zilka, CEO at #datapipeline engine startup MyDecisive AI, and a former exec at New Relic and #
Hortonworks. MyDecisive's #opensourcesoftware targets data management costs from #observability vendors such as Datadog by reducing data at the source; it can also proactively alert on and take action on #OpenTelemetry data as it comes in from enterprise applications.If Zilka has his way, #o11y will return to enterprises as an in-house discipline, but without requiring an army of engineers to set it up.
-
🔥 Hot take alert! 🔥 "I would love there to be a SaaS apocalypse" in observability – that's according to Ari Zilka, CEO at #datapipeline engine startup MyDecisive AI, and a former exec at New Relic and #
Hortonworks. MyDecisive's #opensourcesoftware targets data management costs from #observability vendors such as Datadog by reducing data at the source; it can also proactively alert on and take action on #OpenTelemetry data as it comes in from enterprise applications.If Zilka has his way, #o11y will return to enterprises as an in-house discipline, but without requiring an army of engineers to set it up.
-
RE: https://mastodon.social/@TanjaStrange/116186351909288077
This #story isn’t really about a typo.
It’s about:
- digital identity accuracy
- metadata pipelines in media distribution
- algorithmic visibility of artists
- and a broken chain of responsibility#namesmatter #entertainment #news #metadata #technews #ICYMI #respecttheartist #QAFail #datapipeline #retailers #actorsunions #moviestudios #amazon
-
RE: https://mastodon.social/@TanjaStrange/116186351909288077
This #story isn’t really about a typo.
It’s about:
- digital identity accuracy
- metadata pipelines in media distribution
- algorithmic visibility of artists
- and a broken chain of responsibility#namesmatter #entertainment #news #metadata #technews #ICYMI #respecttheartist #QAFail #datapipeline #retailers #actorsunions #moviestudios #amazon
-
RE: https://mastodon.social/@TanjaStrange/116186351909288077
This #story isn’t really about a typo.
It’s about:
- digital identity accuracy
- metadata pipelines in media distribution
- algorithmic visibility of artists
- and a broken chain of responsibility#namesmatter #entertainment #news #metadata #technews #ICYMI #respecttheartist #QAFail #datapipeline #retailers #actorsunions #moviestudios #amazon
-
RE: https://mastodon.social/@TanjaStrange/116186351909288077
This #story isn’t really about a typo.
It’s about:
- digital identity accuracy
- metadata pipelines in media distribution
- algorithmic visibility of artists
- and a broken chain of responsibility#namesmatter #entertainment #news #metadata #technews #ICYMI #respecttheartist #QAFail #datapipeline #retailers #actorsunions #moviestudios #amazon
-
RE: https://mastodon.social/@TanjaStrange/116186351909288077
This #story isn’t really about a typo.
It’s about:
- digital identity accuracy
- metadata pipelines in media distribution
- algorithmic visibility of artists
- and a broken chain of responsibility#namesmatter #entertainment #news #metadata #technews #ICYMI #respecttheartist #QAFail #datapipeline #retailers #actorsunions #moviestudios #amazon
-
Discover how an MLOps workflow turns messy Excel wage tables into a clean, analysis‑ready DataFrame. The pipeline normalizes occupational salary data, enriches it with statistical insights, and makes future ML models a breeze. Dive into the step‑by‑step process and see the code you can reuse today. #MLOps #DataNormalization #OccupationalWage #DataPipeline
🔗 https://aidailypost.com/news/mlops-workflow-normalizes-enriches-occupational-wage-data-from-excel
-
How To Build Ransomware-Resilient AI Data Pipelines: A Practical Guide for Modern Enterprises https://hackread.com/building-ransomware-resilient-ai-data-pipelines/ #DataPipeline #DataSecurity #CyberAttack #Ransomware #Security #CI/CD #AI
-
There are only three types of tables
https://katharinabrunner.de/2025/11/there-are-only-three-types-of-tables/
-
NASA's #data collection has undergone massive shifts in lifecycle management, #FAIR_data, technological trends, and policy. Evolving from 1980s magnetic tapes to a network of over 30 online repositories, the tech trends are easiest to identify. Adoption of #DataPipeline and #DataStandards an ongoing focus. #DataGovernance and #DataRescue are emerging. NASA #DataStewardship navigates rapid technology and long-term science.
Bugbee, K., & Ramachandran, R. (2025) https://doi.org/10.1029/2025EA004413 #SciLit
-
NASA's #data collection has undergone massive shifts in lifecycle management, #FAIR_data, technological trends, and policy. Evolving from 1980s magnetic tapes to a network of over 30 online repositories, the tech trends are easiest to identify. Adoption of #DataPipeline and #DataStandards an ongoing focus. #DataGovernance and #DataRescue are emerging. NASA #DataStewardship navigates rapid technology and long-term science.
Bugbee, K., & Ramachandran, R. (2025) https://doi.org/10.1029/2025EA004413 #SciLit
-
NASA's #data collection has undergone massive shifts in lifecycle management, #FAIR_data, technological trends, and policy. Evolving from 1980s magnetic tapes to a network of over 30 online repositories, the tech trends are easiest to identify. Adoption of #DataPipeline and #DataStandards an ongoing focus. #DataGovernance and #DataRescue are emerging. NASA #DataStewardship navigates rapid technology and long-term science.
Bugbee, K., & Ramachandran, R. (2025) https://doi.org/10.1029/2025EA004413 #SciLit
-
NASA's #data collection has undergone massive shifts in lifecycle management, #FAIR_data, technological trends, and policy. Evolving from 1980s magnetic tapes to a network of over 30 online repositories, the tech trends are easiest to identify. Adoption of #DataPipeline and #DataStandards an ongoing focus. #DataGovernance and #DataRescue are emerging. NASA #DataStewardship navigates rapid technology and long-term science.
Bugbee, K., & Ramachandran, R. (2025) https://doi.org/10.1029/2025EA004413 #SciLit
-
NASA's #data collection has undergone massive shifts in lifecycle management, #FAIR_data, technological trends, and policy. Evolving from 1980s magnetic tapes to a network of over 30 online repositories, the tech trends are easiest to identify. Adoption of #DataPipeline and #DataStandards an ongoing focus. #DataGovernance and #DataRescue are emerging. NASA #DataStewardship navigates rapid technology and long-term science.
Bugbee, K., & Ramachandran, R. (2025) https://doi.org/10.1029/2025EA004413 #SciLit
-
Have you ever needed to extract text from images embedded in a #PDF? I can highly recommend the open source #CLI tool #OCRmyPDF which is easy to automate in for example a #DataPipeline.
It uses #Tesseract #OCR under the hood and has many options to experiment with to get the best possible accuracy for your language and PDF content.
You can get started with just a few commands:
https://samuelplumppu.se/blog/automated-text-extraction-from-pdf-images-with-ocrmypdf
-
One Open-source Project Daily
Change data capture for a variety of databases.
https://github.com/debezium/debezium
#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer -
One Open-source Project Daily
Change data capture for a variety of databases.
https://github.com/debezium/debezium
#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer -
One Open-source Project Daily
Change data capture for a variety of databases.
https://github.com/debezium/debezium
#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer -
One Open-source Project Daily
Change data capture for a variety of databases.
https://github.com/debezium/debezium
#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer -
One Open-source Project Daily
Change data capture for a variety of databases.
https://github.com/debezium/debezium
#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer -
Test your skills with our Data Engineering Quiz!
Tag a data nerd friend who’d ace it!
#DataEngineering #ETL #TechQuiz #DataNerd #EngineerLife #LearnWithFun #TechCareers #BigData #DataPipeline
#DataEngineerLife #SQL #ApacheSpark
#CareerInTech #LearnDataEngineering
#EngineeringQuiz #DataNerd #UpSkill
#TechCareers #DataDriven -
Test your skills with our Data Engineering Quiz!
Tag a data nerd friend who’d ace it!
#DataEngineering #ETL #TechQuiz #DataNerd #EngineerLife #LearnWithFun #TechCareers #BigData #DataPipeline
#DataEngineerLife #SQL #ApacheSpark
#CareerInTech #LearnDataEngineering
#EngineeringQuiz #DataNerd #UpSkill
#TechCareers #DataDriven -
#Coroot is excited to partner with #Glassflow to share how you can optimize data streaming, storage, and observability using a fully-#FOSS stack (including tools like GlassFlow, #Kafka, #Clickhouse and Coroot!): https://t.ly/oVAOL
#SRE #DevOps #tech #datapipeline #Python #Apache #linux #observability
-
#TBT... to an entire week ago at #RSAC where Seth Goldhammer had the chance to demo Graylog's data telemetry pipeline management! 🖥️ ⭐
Join Seth as he talks about data lakes, data lake previews, getting your data back when you need it, and more.
Wanna learn more about this topic? Here you go: https://graylog.org/post/security-data-lake-strategy/ #RSA #RSAC2025 #datalake #datamanagement #datapipeline
-
In 2018, our SQL queries on a 700k-row dataset were crawling and crashing. Switched to Python with Pandas, processed in chunks, and reduced the time from 5 hours to 40 minutes. Python handled it like a charm! #python #datapipeline
-
One More feather to the my developer hat !
love for creating high-performance Secured applications is always my quest and this is full stack this time .
Julia with Dash: To Supercharge data analysis with Julia’s lightning-fast computations, outpacing Python in speed.
Rust Leptos: To broaden Rust in to full stack, a framework create lightning-fast and smooth web applications.
My love for learning by Doing resulted 2 project 😉, are live 🟢 for you to check out 🔭.
Sharang (live at : https://sharang.s9lab.dev/ ): A Julia Dash-powered productivity app, Extensible by APIs and data (data pipelines) for Kubernetes admins. Simplify admin and security admin, and best part is AI can be integrated. Check it out and let me know what features you want in this App, I will code it 😆.
Note: App is in hobby, Ideation and Showcase phase.
What Next on this App?
- I will extend to various widgets with other tools, and more slim 🔌 on user PC.
- I am ready to take up any suggestion 💡 .
- More AI to make it more productive less Fancy 👒
- optimize for mobile view, Clean the code 😉Capita7.com (live at: https://capita7.com/): This a beautiful website and outcome of my Rust hobby exploration. Built with Rust, leptos and TailwindCSS.
The Journey has just started many to witness . Please visit https://ls-lrt.com/ for the future updates 🎊
#rust #julia #dashjl #leptos #mistral #ai #generativeai #learning #opensource #coding #container #kubernetes #digitalocean #container #datapipeline #podman #vscode #githubaction #automation
-
One More feather to the my developer hat !
love for creating high-performance Secured applications is always my quest and this is full stack this time .
Julia with Dash: To Supercharge data analysis with Julia’s lightning-fast computations, outpacing Python in speed.
Rust Leptos: To broaden Rust in to full stack, a framework create lightning-fast and smooth web applications.
My love for learning by Doing resulted 2 project 😉, are live 🟢 for you to check out 🔭.
Sharang (live at : https://sharang.s9lab.dev/ ): A Julia Dash-powered productivity app, Extensible by APIs and data (data pipelines) for Kubernetes admins. Simplify admin and security admin, and best part is AI can be integrated. Check it out and let me know what features you want in this App, I will code it 😆.
Note: App is in hobby, Ideation and Showcase phase.
What Next on this App?
- I will extend to various widgets with other tools, and more slim 🔌 on user PC.
- I am ready to take up any suggestion 💡 .
- More AI to make it more productive less Fancy 👒
- optimize for mobile view, Clean the code 😉Capita7.com (live at: https://capita7.com/): This a beautiful website and outcome of my Rust hobby exploration. Built with Rust, leptos and TailwindCSS.
The Journey has just started many to witness . Please visit https://ls-lrt.com/ for the future updates 🎊
#rust #julia #dashjl #leptos #mistral #ai #generativeai #learning #opensource #coding #container #kubernetes #digitalocean #container #datapipeline #podman #vscode #githubaction #automation
-
One More feather to the my developer hat !
love for creating high-performance Secured applications is always my quest and this is full stack this time .
Julia with Dash: To Supercharge data analysis with Julia’s lightning-fast computations, outpacing Python in speed.
Rust Leptos: To broaden Rust in to full stack, a framework create lightning-fast and smooth web applications.
My love for learning by Doing resulted 2 project 😉, are live 🟢 for you to check out 🔭.
Sharang (live at : https://sharang.s9lab.dev/ ): A Julia Dash-powered productivity app, Extensible by APIs and data (data pipelines) for Kubernetes admins. Simplify admin and security admin, and best part is AI can be integrated. Check it out and let me know what features you want in this App, I will code it 😆.
Note: App is in hobby, Ideation and Showcase phase.
What Next on this App?
- I will extend to various widgets with other tools, and more slim 🔌 on user PC.
- I am ready to take up any suggestion 💡 .
- More AI to make it more productive less Fancy 👒
- optimize for mobile view, Clean the code 😉Capita7.com (live at: https://capita7.com/): This a beautiful website and outcome of my Rust hobby exploration. Built with Rust, leptos and TailwindCSS.
The Journey has just started many to witness . Please visit https://ls-lrt.com/ for the future updates 🎊
#rust #julia #dashjl #leptos #mistral #ai #generativeai #learning #opensource #coding #container #kubernetes #digitalocean #container #datapipeline #podman #vscode #githubaction #automation
-
One More feather to the my developer hat !
love for creating high-performance Secured applications is always my quest and this is full stack this time .
Julia with Dash: To Supercharge data analysis with Julia’s lightning-fast computations, outpacing Python in speed.
Rust Leptos: To broaden Rust in to full stack, a framework create lightning-fast and smooth web applications.
My love for learning by Doing resulted 2 project 😉, are live 🟢 for you to check out 🔭.
Sharang (live at : https://sharang.s9lab.dev/ ): A Julia Dash-powered productivity app, Extensible by APIs and data (data pipelines) for Kubernetes admins. Simplify admin and security admin, and best part is AI can be integrated. Check it out and let me know what features you want in this App, I will code it 😆.
Note: App is in hobby, Ideation and Showcase phase.
What Next on this App?
- I will extend to various widgets with other tools, and more slim 🔌 on user PC.
- I am ready to take up any suggestion 💡 .
- More AI to make it more productive less Fancy 👒
- optimize for mobile view, Clean the code 😉Capita7.com (live at: https://capita7.com/): This a beautiful website and outcome of my Rust hobby exploration. Built with Rust, leptos and TailwindCSS.
The Journey has just started many to witness . Please visit https://ls-lrt.com/ for the future updates 🎊
#rust #julia #dashjl #leptos #mistral #ai #generativeai #learning #opensource #coding #container #kubernetes #digitalocean #container #datapipeline #podman #vscode #githubaction #automation
-
One More feather to the my developer hat !
love for creating high-performance Secured applications is always my quest and this is full stack this time .
Julia with Dash: To Supercharge data analysis with Julia’s lightning-fast computations, outpacing Python in speed.
Rust Leptos: To broaden Rust in to full stack, a framework create lightning-fast and smooth web applications.
My love for learning by Doing resulted 2 project 😉, are live 🟢 for you to check out 🔭.
Sharang (live at : https://sharang.s9lab.dev/ ): A Julia Dash-powered productivity app, Extensible by APIs and data (data pipelines) for Kubernetes admins. Simplify admin and security admin, and best part is AI can be integrated. Check it out and let me know what features you want in this App, I will code it 😆.
Note: App is in hobby, Ideation and Showcase phase.
What Next on this App?
- I will extend to various widgets with other tools, and more slim 🔌 on user PC.
- I am ready to take up any suggestion 💡 .
- More AI to make it more productive less Fancy 👒
- optimize for mobile view, Clean the code 😉Capita7.com (live at: https://capita7.com/): This a beautiful website and outcome of my Rust hobby exploration. Built with Rust, leptos and TailwindCSS.
The Journey has just started many to witness . Please visit https://ls-lrt.com/ for the future updates 🎊
#rust #julia #dashjl #leptos #mistral #ai #generativeai #learning #opensource #coding #container #kubernetes #digitalocean #container #datapipeline #podman #vscode #githubaction #automation
-
Scoop alert! Amid an enterprise #observability cost crunch, #Dynatrace expands its data ingest pricing options, third-party data support and introduces a #datapipeline. #o11y #Perform2024
-
Scoop alert! Amid an enterprise #observability cost crunch, #Dynatrace expands its data ingest pricing options, third-party data support and introduces a #datapipeline. #o11y #Perform2024
-
Scoop alert! Amid an enterprise #observability cost crunch, #Dynatrace expands its data ingest pricing options, third-party data support and introduces a #datapipeline. #o11y #Perform2024
-
Scoop alert! Amid an enterprise #observability cost crunch, #Dynatrace expands its data ingest pricing options, third-party data support and introduces a #datapipeline. #o11y #Perform2024
-
Scoop alert! Amid an enterprise #observability cost crunch, #Dynatrace expands its data ingest pricing options, third-party data support and introduces a #datapipeline. #o11y #Perform2024
-
Data patterns for community survey data integrated into a data harmonization workflow description, O'Brien etal 2021 tackles the issue of diverse data harmonization for ecological community surveys. https://www.sciencedirect.com/science/article/pii/S1574954121001655 #DataScience #DataPipeline #DataCuration #SciLit