#dataflow — Public Fediverse posts

SOFTWARE CONNECTORS SHIFTING DATA FLOWS

How are APIs changing software? Learn how composite APIs and data APIs let apps share information and features more easily.

#APIs, #SoftwareDevelopment, #DataFlow, #TechNews, #DigitalTransformation

https://newsletter.tf/apis-connect-software-sharing-data/

SOFTWARE CONNECTORS SHIFTING DATA FLOWS

How are APIs changing software? Learn how composite APIs and data APIs let apps share information and features more easily.

#APIs, #SoftwareDevelopment, #DataFlow, #TechNews, #DigitalTransformation

https://newsletter.tf/apis-connect-software-sharing-data/

Software apps are now sharing data more easily thanks to APIs. This is like having more digital handshakes between programs.

#APIs, #SoftwareDevelopment, #DataFlow, #TechNews, #DigitalTransformation
https://newsletter.tf/apis-connect-software-sharing-data/

Software apps are now sharing data more easily thanks to APIs. This is like having more digital handshakes between programs.

#APIs, #SoftwareDevelopment, #DataFlow, #TechNews, #DigitalTransformation
https://newsletter.tf/apis-connect-software-sharing-data/

Dataflow × Spanner データ移行を完遂する実戦ガイド — IAM 2ロール・パス不一致・DDL完了待ちの3チェック
https://qiita.com/kane_ryu/items/7d8d6f388849f1593658?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #IAM #DataStream #dataflow #CloudSpanner #GoogleCloud

PostgreSQL→Cloud Spanner大規模移行トラブル詳解 — 18時間ずれの解消と240テーブルPDML補正、Dataflow高速化の実戦
https://qiita.com/kane_ryu/items/c96e6f0ab2b2dbab6ad8?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #migration #PostgreSQL #dataflow #CloudSpanner #PDML

Why Apache NiFi Matters 🔄

Data movement is messy. NiFi fixes that.

Key strengths:
• Visual UI – No coding required
• 200+ processors – Ready to use
• Data provenance – Track every event
• Backpressure – Never drop data
• Built-in security – Encryption, auth

From IoT to databases to cloud – NiFi connects everything.

#ApacheNiFi #DataFlow #ETL #DataEngineering

By embracing effective data flow mapping, you can unlock the benefits of improved data quality, enhanced decision-making, and streamlined business operations.

Read more 👉 https://lttr.ai/Ao13O

#Security #Infosec #DataFlow

【ハンズオン】OCI Data Flowで始めるApache Spark｜ETLからMLまで体験してみよう！
https://qiita.com/yushibats/items/559b65f72efeccf8865b?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #oracle #ApacheSpark #oci #dataflow #データエンジニアリング

Discover how LangGraph structures agents, nodes, and data flow across 25+ AI projects. From multi‑agent orchestration to seamless workflow automation, see real‑world examples that boost GenAI and data‑science pipelines. Open‑source enthusiasts, this is a must‑read! #LangGraph #MultiAgent #DataFlow #GenAI

🔗 https://aidailypost.com/news/langgraph-models-agents-nodes-data-flow-25-ai-projects

Projects involving complex transformations and target schemas benefit significantly from precise data mapping, which maintains a trusted data foundation and ensures a consistent view of information.

Read more 👉 https://lttr.ai/Alnts

#Security #Infosec #DataFlow

Taint-анализ в C и C++ анализаторе PVS-Studio

Ваш код принимает данные извне? Поздравляем, вы вступили на минное поле! Любой непроверенный ввод от пользователя может привести к уязвимости, и найти все "растяжки" вручную в большом проекте почти невозможно. Но есть "сапёр" — статический анализатор. Инструмент нашего "сапёра" — taint-анализ (aka анализ помеченных данных). Он позволяет обнаружить "грязные" данные, дошедшие до опасных мест без проверки. Сегодня мы расскажем о том, как он работает.

https://habr.com/ru/companies/pvs-studio/articles/960448/

#taint_analysis #taint #static_analysis #pvsstudio #pvs #c++ #dataflow #dataflow_analysis #security #software_security

#ITByte: #Dataflow #Programming is a programming paradigm where the flow of data through a program is the primary focus, rather than the control flow.

This means that instructions are executed based on the availability of data, rather than a predetermined sequence.

https://knowledgezone.co.in/posts/Dataflow-Programming-66dfd1cb2390377b359fd017

#ITByte: #Dataflow #Programming is a programming paradigm where the flow of data through a program is the primary focus, rather than the control flow.

This means that instructions are executed based on the availability of data, rather than a predetermined sequence.

https://knowledgezone.co.in/posts/Dataflow-Programming-66dfd1cb2390377b359fd017

"Moreover, accurate data mapping contributes to business intelligence by revealing redundant data sources and enhancing the reliability of analytics results, thereby improving the overall performance of business processes." https://lttr.ai/AiSPk

#Security #Infosec #DataFlow

New general purpose processor chip that's claimed to be two orders of magnitude more power efficient than ARM, which is exciting enough in itself. But more, it's a hardware #DataFlow engine, so it looks to me as though it would be an ideal architecture for functional languages including #Lisp .

Downside, from what I've read so far? It appears to depend on proprietary compiler technology -- the compiler is obviously considerably different from a conventional design.

https://www.efficient.computer/electron-e1

New general purpose processor chip that's claimed to be two orders of magnitude more power efficient than ARM, which is exciting enough in itself. But more, it's a hardware #DataFlow engine, so it looks to me as though it would be an ideal architecture for functional languages including #Lisp .

Downside, from what I've read so far? It appears to depend on proprietary compiler technology -- the compiler is obviously considerably different from a conventional design.

https://www.efficient.computer/electron-e1

By streamlining internal processes through effective data flow mapping, organizations ensure smoother operations and better strategic oversight, ultimately fostering an improved business logic.

Read more 👉 https://lttr.ai/AfE6n

#Security #Infosec #DataFlow

Geospatial Without Maps [blog post]
--
https://cercanasystems.com/2025/05/geospatial-without-maps/ <-- shared blog posts
--
[I will be honest, I can’t remember the last time I personally made a map…]
#GIS #spatial #mapping #mapless #AllDataIsSpatial #usecase #appliedscience #appliedtechnology #automation #coding #machinelearning #AI #maintenance #utilities #GPS #infrastructure #datasupply #dataflow #spatialdata #spatialanalysis #spatiotemporal #farming #agriculture #precisionagriculture #yield #InternetOfThings #integration #smartinfracture #earthobservation #model #modeling #routing #urban #planning #spatiallogic #proximity #zonal #statistics #geostatistics #context #systemsintegration #workflows #processmodels #spatialintelligence #decisionsystems #businessrules #efficiency

Geospatial Without Maps [blog post]
--
https://cercanasystems.com/2025/05/geospatial-without-maps/ <-- shared blog posts
--
[I will be honest, I can’t remember the last time I personally made a map…]
#GIS #spatial #mapping #mapless #AllDataIsSpatial #usecase #appliedscience #appliedtechnology #automation #coding #machinelearning #AI #maintenance #utilities #GPS #infrastructure #datasupply #dataflow #spatialdata #spatialanalysis #spatiotemporal #farming #agriculture #precisionagriculture #yield #InternetOfThings #integration #smartinfracture #earthobservation #model #modeling #routing #urban #planning #spatiallogic #proximity #zonal #statistics #geostatistics #context #systemsintegration #workflows #processmodels #spatialintelligence #decisionsystems #businessrules #efficiency

Effectively mapping data flows is pivotal for ensuring that data from various sources is accurately aligned and integrated to support specific business objectives.

Read more 👉 https://lttr.ai/AdXsV

#Security #Infosec #DataFlow

"Effective data flow mapping provides a unified visual representation of how data moves within an organization, offering a range of benefits that enhance operational efficiency, data quality, and decision-making processes." https://lttr.ai/Acs1h

#Security #Infosec #DataFlow

By accurately defining data sources and targets, enterprises can achieve seamless data integration and comply with regulatory standards, facilitating effective data mapping and informed decision-making.

Read more 👉 https://lttr.ai/AckhE

#Security #Infosec #DataFlow

By utilizing advanced mapping solutions and techniques, businesses can ensure seamless data integration, accurate mapping accuracy, and compliance with regulatory standards.

Read more 👉 https://lttr.ai/AcT1l

#Security #Infosec #DataFlow

The Challenges and Need for Data Flow Mapping: https://lttr.ai/AcJif

#Security #Infosec #DataFlow

Поиск потенциальных уязвимостей в коде, часть 2: практика

В прошлый раз мы ознакомились с общими подходами в поиске уязвимостей безопасности в приложениях. В этот раз спустимся ближе к земле и посмотрим на то, как мы реализовали эти механизмы в нашем статическом анализаторе для Java.

https://habr.com/ru/companies/pvs-studio/articles/885576/

#sast #taint #taint_analysis #cfg #defuse #call_graph #inheritance_graph #security #dataflow #static_analysis

Anyone knows about Cuneiform workflow language?

I am digging into “Flow-based programming” and “Dataflow languages”, and I have seen Cuneiform mentioned here and there, which to me has a simple and appealing syntax.
However... the documentation is close to nonexistent. How do I get started, and should I?

http://cuneiform-lang.org/

#bioinformatics #Cuneiform #WorkflowLanguage #DataFlow #FlowBased #FunctionalProgramming

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

Поиск потенциальных уязвимостей в коде, часть 1: теория

Риски наличия уязвимостей безопасности всем известны: нарушение работы приложения, потеря данных или их конфиденциальности. В этой статье мы посмотрим на наглядных примерах фундаментальную сторону подхода, при котором уязвимости можно находить ещё на этапе разработки.

https://habr.com/ru/companies/pvs-studio/articles/866896/

#sast #taint #taint_analysis #cfg #defuse #ssa #call_graph #security #dataflow #static_analysis

Какие ваши доказательства? Объясняем разработчику отчёты SCA на пальцах. Часть 2

Привет, Habr! С вами вновь Анастасия Березовская, инженер по безопасности процессов разработки приложений в Swordfish Security. Сегодня мы продолжим наш нелегкий путь в получении Evidence для SBOM. В первой части статьи мы разобрались, что же такое Evidence с точки зрения SBOM. Описали, что представляет собой граф свойств кода, на базе которого происходят все операции нарезки, и рассмотрели срезы использования. Сегодня мы поговорим про срезы достижимости и срезы потоков данных. И, самое главное, разберем, как всё это превращается в расширенный SBOM с вхождениями. Приятного чтения!

https://habr.com/ru/companies/swordfish_security/articles/845526/

#static_analysis #sca #reachable #dataflow #sbom #software_composition_analysis #cdxgen #evinse #статический_анализ

#ITByte: #Dataflow #Programming is a programming paradigm where the flow of data through a program is the primary focus, rather than the control flow.

This means that instructions are executed based on the availability of data, rather than a predetermined sequence.

https://knowledgezone.co.in/posts/Dataflow-Programming-66dfd1cb2390377b359fd017

#ITByte: #Dataflow #Programming is a programming paradigm where the flow of data through a program is the primary focus, rather than the control flow.

This means that instructions are executed based on the availability of data, rather than a predetermined sequence.

https://knowledgezone.co.in/posts/Dataflow-Programming-66dfd1cb2390377b359fd017

Hey #PowerBI people, I just posted Part 4 of my #DataDojo #CommunityOfPractice blog series. Check it out here:
https://datavolume.xyz/2024/01/15/DataDojo-PowerBI-CommunityOfPractice-04.html

And just in case you missed any of the previous parts (or it's been a while and you need a refresher), here are the links for those:
- Part 1: https://datavolume.xyz/2023/04/02/DataDojo-PowerBI-CommunityOfPractice-01.html
- Part 2: https://datavolume.xyz/2023/05/28/DataDojo-PowerBI-CommunityOfPractice-02.html
- Part 3: https://datavolume.xyz/2023/10/13/DataDojo-PowerBI-CommunityOfPractice-03.html

#BusinessIntelligence #DataAnalytics #DataLiteracy #KnowledgeSharing #CenterOfExcellence #MicrosoftFabric #PowerQuery #Dataflow

Hey #PowerBI people, I just posted Part 4 of my #DataDojo #CommunityOfPractice blog series. Check it out here:
https://datavolume.xyz/2024/01/15/DataDojo-PowerBI-CommunityOfPractice-04.html

And just in case you missed any of the previous parts (or it's been a while and you need a refresher), here are the links for those:
- Part 1: https://datavolume.xyz/2023/04/02/DataDojo-PowerBI-CommunityOfPractice-01.html
- Part 2: https://datavolume.xyz/2023/05/28/DataDojo-PowerBI-CommunityOfPractice-02.html
- Part 3: https://datavolume.xyz/2023/10/13/DataDojo-PowerBI-CommunityOfPractice-03.html

#BusinessIntelligence #DataAnalytics #DataLiteracy #KnowledgeSharing #CenterOfExcellence #MicrosoftFabric #PowerQuery #Dataflow

TONIGHT, #DCG201 attends the last
#empirehacking meetup of 2023. Talks start at 6:00 PM EST and include Ellen Cooper (
@hackmanhattan ) reverse engineering obscure #Japanese #phones, and Evan Sultanik's ( @trailofbits ) guide to advanced #dataflow #analysis techniques:

https://meetu.ps/e/MF6Bl/lQlT6/i

@defcon @dcparrot @NYC2600

TONIGHT, #DCG201 attends the last
#empirehacking meetup of 2023. Talks start at 6:00 PM EST and include Ellen Cooper (
@hackmanhattan ) reverse engineering obscure #Japanese #phones, and Evan Sultanik's ( @trailofbits ) guide to advanced #dataflow #analysis techniques:

https://meetu.ps/e/MF6Bl/lQlT6/i

@defcon @dcparrot @NYC2600

Es gibt Möglichkeiten, iOS MDM-Beschränkungen zu umgehen. Apple hat diese Lücken bisher nicht geschlossen. Die Frage ist, wie vertrauenswürdig diese Beschränkungen sind, wenn selbst einfache Tricks nicht behoben werden.
Hier kommen Sie zum Video: https://www.youtube.com/watch?v=5uge12UogyI
#MDM #MDMRestrictions #DataFlow

Es gibt Möglichkeiten, iOS MDM-Beschränkungen zu umgehen. Apple hat diese Lücken bisher nicht geschlossen. Die Frage ist, wie vertrauenswürdig diese Beschränkungen sind, wenn selbst einfache Tricks nicht behoben werden.
Hier kommen Sie zum Video: https://www.youtube.com/watch?v=5uge12UogyI
#MDM #MDMRestrictions #DataFlow

Today we're hosting the final conference of #OPERAS GER project at #maxweberfoundation : https://operas-ger.hypotheses.org/veranstaltungen/abschlussveranstaltung-operas-ger
and I'm looking forward to chairing a panel on empowering #infrastructures with guests from @operaseu (Pierre Mounier), @coarassessment (@etothczifra), @subugoe (Margo Bargheer), @Textplus (Philippe Genêt) and OPERAS-GER (Michael Kaiser) - we will bring together the topics of #openscience , #nfdi , #dataflow on a European and national level.

Today we're hosting the final conference of #OPERAS GER project at #maxweberfoundation : https://operas-ger.hypotheses.org/veranstaltungen/abschlussveranstaltung-operas-ger
and I'm looking forward to chairing a panel on empowering #infrastructures with guests from @operaseu (Pierre Mounier), @coarassessment (@etothczifra), @subugoe (Margo Bargheer), @Textplus (Philippe Genêt) and OPERAS-GER (Michael Kaiser) - we will bring together the topics of #openscience , #nfdi , #dataflow on a European and national level.

If you have the day off and were wondering how data actually flows over the Internet, then I invite you to read this insightful paper, written by the very great Karl Auerbach: https://www.iwl.com/idocs/the-surprisingly-arcane-art-of-sending-data-on-the-internet. #Internet #dataflow

@m20k I'd probably start with a #softwaremodel though, keeping the #FPGA limitations in mind. However you will soon find that filling instructions with independent #µops (TMTA called these molecules and atoms) is really hard, especially for short #basicblocks. TMTA dealt with that in many ways, most significantly by compiling very large #superblocks (multiple exits) and make heavy use of #predication.

I would try something different: make the #dataflow explicit ...

Anyway in news that I'm sure is entirely unrelated, if you're running into weirdly pathological throughput issues and mysterious OOMs with scaled-up #Google #Cloud #Dataflow jobs using the Java runtime, try turning runner_v2 off if you've got it enabled. You might be happily surprised.

Anyway in news that I'm sure is entirely unrelated, if you're running into weirdly pathological throughput issues and mysterious OOMs with scaled-up #Google #Cloud #Dataflow jobs using the Java runtime, try turning runner_v2 off if you've got it enabled. You might be happily surprised.

For many years I've observed the following in parallel:

1. General confusion (and in some cases disdain) about the notion of a #SemanticWeb

2. Steadfast effort by a community to keep the vision going, stealthily, as exemplified by the #LODCloud (#DBpedia,, #Wikidata, #Uniprot etc..) and Schema.org (#SchemaOrg)

3. #DataSilos and all the impedance they inflict on the agility of individuals and enterprises alike on the rise i.e., #DataAccess and #DataFlow are still challenging, unnecessarily.

For many years I've observed the following in parallel:

1. General confusion (and in some cases disdain) about the notion of a #SemanticWeb

2. Steadfast effort by a community to keep the vision going, stealthily, as exemplified by the #LODCloud (#DBpedia,, #Wikidata, #Uniprot etc..) and Schema.org (#SchemaOrg)

3. #DataSilos and all the impedance they inflict on the agility of individuals and enterprises alike on the rise i.e., #DataAccess and #DataFlow are still challenging, unnecessarily.

One of the things I'll be talking about in the stream tomorrow: Understanding that https://thi.ng/rstream constructs are essentially defining a #dataflow #graph much like you'd know from a node-graph based editor (a la Blender/Houdini etc.), only obviously with the difference of actually creating such a graph programmatically rather than manually via visual editing. Personally I find this programmatic approach much more powerful, but a visual representation makes it of course much easier to debug & analyze such graph topologies, also to explain & illustrate to others how data and state changes are flowing through the app/system and/or where to attach new features/nodes or optimize/restructure the topology...

Another massive benefit: This approach makes it much easier to build features such that only the most minimal amount of work needs to be done, helping to achieve better performance...

The attached diagram was generated with #Graphviz via https://thi.ng/rstream-dot and shows the dataflow graph for the image vectorization tool mentioned in previous toots.

Full size version:
https://demo.thi.ng/umbrella/trace-bitmap/topology.html

The tool itself:
https://demo.thi.ng/umbrella/trace-bitmap/

The second image shows the minimal code required to generate the #visualization source file...

Yep!

Today, there's a massive #Fediverse comprising lots of entities and entity relationship types named using a #Hyperlink.

All of this data flows #DataSpaces without the disturbance of silos.

/cc @openlink @Mastodon

#DataFlow #DataConnectivity #LinkedData #SemanticWeb #ActivityStreams #ActivityPub

Recently I've had a conversation with my Tech Lead about what kind a #programmer I am.
He gave me only 2 options:

1. One who builds big forms and #abstractions first, and then distinguish particular #implementations
2. One who creates parts, then builds huge blocks from them, performing #refactoring in order to #clean the #code

I am the 3rd one - who build an application as the data flow comes.
And what a programmer are you?

#developer #application #composition #dataflow #architecture #design