#dataflow — Public Fediverse posts

Dataflow × Spanner データ移行を完遂する実戦ガイド — IAM 2ロール・パス不一致・DDL完了待ちの3チェック
https://qiita.com/kane_ryu/items/7d8d6f388849f1593658?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #IAM #DataStream #dataflow #CloudSpanner #GoogleCloud

Dataflow × Spanner データ移行を完遂する実戦ガイド — IAM 2ロール・パス不一致・DDL完了待ちの3チェック
https://qiita.com/kane_ryu/items/7d8d6f388849f1593658?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #IAM #DataStream #dataflow #CloudSpanner #GoogleCloud

"Ra mắt thư viện React mới: SoGloper, giúp tổ chức state, logic và dataflow trong ứng dụng React. Cung cấp tính năng debug,inspection và quản lý trạng thái động. #SoGloper #React #StateManagement #DataFlow #JavaScript #ThưVienReact #QuảnTrịTrạngThái"

https://www.reddit.com/r/SideProject/comments/1oyx9lv/sogloper_a_unified_react_library_for_state_logic/

Taint-анализ в C и C++ анализаторе PVS-Studio

Ваш код принимает данные извне? Поздравляем, вы вступили на минное поле! Любой непроверенный ввод от пользователя может привести к уязвимости, и найти все "растяжки" вручную в большом проекте почти невозможно. Но есть "сапёр" — статический анализатор. Инструмент нашего "сапёра" — taint-анализ (aka анализ помеченных данных). Он позволяет обнаружить "грязные" данные, дошедшие до опасных мест без проверки. Сегодня мы расскажем о том, как он работает.

https://habr.com/ru/companies/pvs-studio/articles/960448/

#taint_analysis #taint #static_analysis #pvsstudio #pvs #c++ #dataflow #dataflow_analysis #security #software_security

Taint-анализ в C и C++ анализаторе PVS-Studio

Ваш код принимает данные извне? Поздравляем, вы вступили на минное поле! Любой непроверенный ввод от пользователя может привести к уязвимости, и найти все "растяжки" вручную в большом проекте почти невозможно. Но есть "сапёр" — статический анализатор. Инструмент нашего "сапёра" — taint-анализ (aka анализ помеченных данных). Он позволяет обнаружить "грязные" данные, дошедшие до опасных мест без проверки. Сегодня мы расскажем о том, как он работает.

https://habr.com/ru/companies/pvs-studio/articles/960448/

#taint_analysis #taint #static_analysis #pvsstudio #pvs #c++ #dataflow #dataflow_analysis #security #software_security

Taint-анализ в C и C++ анализаторе PVS-Studio

Ваш код принимает данные извне? Поздравляем, вы вступили на минное поле! Любой непроверенный ввод от пользователя может привести к уязвимости, и найти все "растяжки" вручную в большом проекте почти невозможно. Но есть "сапёр" — статический анализатор. Инструмент нашего "сапёра" — taint-анализ (aka анализ помеченных данных). Он позволяет обнаружить "грязные" данные, дошедшие до опасных мест без проверки. Сегодня мы расскажем о том, как он работает.

https://habr.com/ru/companies/pvs-studio/articles/960448/

#taint_analysis #taint #static_analysis #pvsstudio #pvs #c++ #dataflow #dataflow_analysis #security #software_security

Taint-анализ в C и C++ анализаторе PVS-Studio

Ваш код принимает данные извне? Поздравляем, вы вступили на минное поле! Любой непроверенный ввод от пользователя может привести к уязвимости, и найти все "растяжки" вручную в большом проекте почти невозможно. Но есть "сапёр" — статический анализатор. Инструмент нашего "сапёра" — taint-анализ (aka анализ помеченных данных). Он позволяет обнаружить "грязные" данные, дошедшие до опасных мест без проверки. Сегодня мы расскажем о том, как он работает.

https://habr.com/ru/companies/pvs-studio/articles/960448/

#taint_analysis #taint #static_analysis #pvsstudio #pvs #c++ #dataflow #dataflow_analysis #security #software_security

#ITByte: #Dataflow #Programming is a programming paradigm where the flow of data through a program is the primary focus, rather than the control flow.

This means that instructions are executed based on the availability of data, rather than a predetermined sequence.

https://knowledgezone.co.in/posts/Dataflow-Programming-66dfd1cb2390377b359fd017

Поиск потенциальных уязвимостей в коде, часть 2: практика

В прошлый раз мы ознакомились с общими подходами в поиске уязвимостей безопасности в приложениях. В этот раз спустимся ближе к земле и посмотрим на то, как мы реализовали эти механизмы в нашем статическом анализаторе для Java.

https://habr.com/ru/companies/pvs-studio/articles/885576/

#sast #taint #taint_analysis #cfg #defuse #call_graph #inheritance_graph #security #dataflow #static_analysis

Поиск потенциальных уязвимостей в коде, часть 1: теория

Риски наличия уязвимостей безопасности всем известны: нарушение работы приложения, потеря данных или их конфиденциальности. В этой статье мы посмотрим на наглядных примерах фундаментальную сторону подхода, при котором уязвимости можно находить ещё на этапе разработки.

https://habr.com/ru/companies/pvs-studio/articles/866896/

#sast #taint #taint_analysis #cfg #defuse #ssa #call_graph #security #dataflow #static_analysis

Geospatial Without Maps [blog post]
--
https://cercanasystems.com/2025/05/geospatial-without-maps/ <-- shared blog posts
--
[I will be honest, I can’t remember the last time I personally made a map…]
#GIS #spatial #mapping #mapless #AllDataIsSpatial #usecase #appliedscience #appliedtechnology #automation #coding #machinelearning #AI #maintenance #utilities #GPS #infrastructure #datasupply #dataflow #spatialdata #spatialanalysis #spatiotemporal #farming #agriculture #precisionagriculture #yield #InternetOfThings #integration #smartinfracture #earthobservation #model #modeling #routing #urban #planning #spatiallogic #proximity #zonal #statistics #geostatistics #context #systemsintegration #workflows #processmodels #spatialintelligence #decisionsystems #businessrules #efficiency

New general purpose processor chip that's claimed to be two orders of magnitude more power efficient than ARM, which is exciting enough in itself. But more, it's a hardware #DataFlow engine, so it looks to me as though it would be an ideal architecture for functional languages including #Lisp .

Downside, from what I've read so far? It appears to depend on proprietary compiler technology -- the compiler is obviously considerably different from a conventional design.

https://www.efficient.computer/electron-e1

Anyone knows about Cuneiform workflow language?

I am digging into “Flow-based programming” and “Dataflow languages”, and I have seen Cuneiform mentioned here and there, which to me has a simple and appealing syntax.
However... the documentation is close to nonexistent. How do I get started, and should I?

http://cuneiform-lang.org/

#bioinformatics #Cuneiform #WorkflowLanguage #DataFlow #FlowBased #FunctionalProgramming

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

Какие ваши доказательства? Объясняем разработчику отчёты SCA на пальцах. Часть 2

Привет, Habr! С вами вновь Анастасия Березовская, инженер по безопасности процессов разработки приложений в Swordfish Security. Сегодня мы продолжим наш нелегкий путь в получении Evidence для SBOM. В первой части статьи мы разобрались, что же такое Evidence с точки зрения SBOM. Описали, что представляет собой граф свойств кода, на базе которого происходят все операции нарезки, и рассмотрели срезы использования. Сегодня мы поговорим про срезы достижимости и срезы потоков данных. И, самое главное, разберем, как всё это превращается в расширенный SBOM с вхождениями. Приятного чтения!

https://habr.com/ru/companies/swordfish_security/articles/845526/

#static_analysis #sca #reachable #dataflow #sbom #software_composition_analysis #cdxgen #evinse #статический_анализ

#ITByte: #Dataflow #Programming is a programming paradigm where the flow of data through a program is the primary focus, rather than the control flow.

This means that instructions are executed based on the availability of data, rather than a predetermined sequence.

https://knowledgezone.co.in/posts/Dataflow-Programming-66dfd1cb2390377b359fd017

Hey #PowerBI people, I just posted Part 4 of my #DataDojo #CommunityOfPractice blog series. Check it out here:
https://datavolume.xyz/2024/01/15/DataDojo-PowerBI-CommunityOfPractice-04.html

And just in case you missed any of the previous parts (or it's been a while and you need a refresher), here are the links for those:
- Part 1: https://datavolume.xyz/2023/04/02/DataDojo-PowerBI-CommunityOfPractice-01.html
- Part 2: https://datavolume.xyz/2023/05/28/DataDojo-PowerBI-CommunityOfPractice-02.html
- Part 3: https://datavolume.xyz/2023/10/13/DataDojo-PowerBI-CommunityOfPractice-03.html

#BusinessIntelligence #DataAnalytics #DataLiteracy #KnowledgeSharing #CenterOfExcellence #MicrosoftFabric #PowerQuery #Dataflow

TONIGHT, #DCG201 attends the last
#empirehacking meetup of 2023. Talks start at 6:00 PM EST and include Ellen Cooper (
@hackmanhattan ) reverse engineering obscure #Japanese #phones, and Evan Sultanik's ( @trailofbits ) guide to advanced #dataflow #analysis techniques:

https://meetu.ps/e/MF6Bl/lQlT6/i

@defcon @dcparrot @NYC2600

Es gibt Möglichkeiten, iOS MDM-Beschränkungen zu umgehen. Apple hat diese Lücken bisher nicht geschlossen. Die Frage ist, wie vertrauenswürdig diese Beschränkungen sind, wenn selbst einfache Tricks nicht behoben werden.
Hier kommen Sie zum Video: https://www.youtube.com/watch?v=5uge12UogyI
#MDM #MDMRestrictions #DataFlow

Today we're hosting the final conference of #OPERAS GER project at #maxweberfoundation : https://operas-ger.hypotheses.org/veranstaltungen/abschlussveranstaltung-operas-ger
and I'm looking forward to chairing a panel on empowering #infrastructures with guests from @operaseu (Pierre Mounier), @coarassessment (@etothczifra), @subugoe (Margo Bargheer), @Textplus (Philippe Genêt) and OPERAS-GER (Michael Kaiser) - we will bring together the topics of #openscience , #nfdi , #dataflow on a European and national level.

If you have the day off and were wondering how data actually flows over the Internet, then I invite you to read this insightful paper, written by the very great Karl Auerbach: https://www.iwl.com/idocs/the-surprisingly-arcane-art-of-sending-data-on-the-internet. #Internet #dataflow

@m20k I'd probably start with a #softwaremodel though, keeping the #FPGA limitations in mind. However you will soon find that filling instructions with independent #µops (TMTA called these molecules and atoms) is really hard, especially for short #basicblocks. TMTA dealt with that in many ways, most significantly by compiling very large #superblocks (multiple exits) and make heavy use of #predication.

I would try something different: make the #dataflow explicit ...

Anyway in news that I'm sure is entirely unrelated, if you're running into weirdly pathological throughput issues and mysterious OOMs with scaled-up #Google #Cloud #Dataflow jobs using the Java runtime, try turning runner_v2 off if you've got it enabled. You might be happily surprised.

For many years I've observed the following in parallel:

1. General confusion (and in some cases disdain) about the notion of a #SemanticWeb

2. Steadfast effort by a community to keep the vision going, stealthily, as exemplified by the #LODCloud (#DBpedia,, #Wikidata, #Uniprot etc..) and Schema.org (#SchemaOrg)

3. #DataSilos and all the impedance they inflict on the agility of individuals and enterprises alike on the rise i.e., #DataAccess and #DataFlow are still challenging, unnecessarily.

One of the things I'll be talking about in the stream tomorrow: Understanding that https://thi.ng/rstream constructs are essentially defining a #dataflow #graph much like you'd know from a node-graph based editor (a la Blender/Houdini etc.), only obviously with the difference of actually creating such a graph programmatically rather than manually via visual editing. Personally I find this programmatic approach much more powerful, but a visual representation makes it of course much easier to debug & analyze such graph topologies, also to explain & illustrate to others how data and state changes are flowing through the app/system and/or where to attach new features/nodes or optimize/restructure the topology...

Another massive benefit: This approach makes it much easier to build features such that only the most minimal amount of work needs to be done, helping to achieve better performance...

The attached diagram was generated with #Graphviz via https://thi.ng/rstream-dot and shows the dataflow graph for the image vectorization tool mentioned in previous toots.

Full size version:
https://demo.thi.ng/umbrella/trace-bitmap/topology.html

The tool itself:
https://demo.thi.ng/umbrella/trace-bitmap/

The second image shows the minimal code required to generate the #visualization source file...

Yep!

Today, there's a massive #Fediverse comprising lots of entities and entity relationship types named using a #Hyperlink.

All of this data flows #DataSpaces without the disturbance of silos.

/cc @openlink @Mastodon

#DataFlow #DataConnectivity #LinkedData #SemanticWeb #ActivityStreams #ActivityPub

Recently I've had a conversation with my Tech Lead about what kind a #programmer I am.
He gave me only 2 options:

1. One who builds big forms and #abstractions first, and then distinguish particular #implementations
2. One who creates parts, then builds huge blocks from them, performing #refactoring in order to #clean the #code

I am the 3rd one - who build an application as the data flow comes.
And what a programmer are you?

#developer #application #composition #dataflow #architecture #design

Higher resolution variant of the #screencast that demonstrates the use of GPT-Chat for generating a HowTo Knowledge Graph from text.

What's happening?
Used a copy & paste sequence (via @datasniff) to create a GPT-Chat prompt that produced a HowTo using #RDF sentences.

Resulting data uplifted to a #VirtuosoRDBMS instance via #SPARQL.

/cc @openlink @datasniff @Mastodon

#SemanticWeb #UseCase #SmartAgent #Web30 #DataConnectivity #LinkedData #DataFlow #HowTo #KnowledgeGraph #HowTo #gptChat

Ready-to-go sample data pipelines with Dataflow from Netflix Technology Blog 👇 https://netflixtechblog.com/ready-to-go-sample-data-pipelines-with-dataflow-17440a9e141d?source=rss----2615bd06b42e---4 #data-engineering #standardization #data-pipeline #dataflow #etl

Nice to know #Google #Cloud status is all green when #DataFlow hasn't run a single job in us-east1 all day for me.... :blobonfire:

A reminder that Microsoft has a huge library of svg icons, and boy howdy are these great for system design and data flows. #dataflow #diagrams #design

https://azure.microsoft.com/en-us/patterns/styles/glyphs-icons/

@Tyresome It is! I’ve started doing more things with #Dataflow and #Docker, and a rather lot of heavily-used extensions for #VSCode so a bit more laptop power is really welcome.

Geospatial Without Maps [blog post]
--
https://cercanasystems.com/2025/05/geospatial-without-maps/ <-- shared blog posts
--
[I will be honest, I can’t remember the last time I personally made a map…]
#GIS #spatial #mapping #mapless #AllDataIsSpatial #usecase #appliedscience #appliedtechnology #automation #coding #machinelearning #AI #maintenance #utilities #GPS #infrastructure #datasupply #dataflow #spatialdata #spatialanalysis #spatiotemporal #farming #agriculture #precisionagriculture #yield #InternetOfThings #integration #smartinfracture #earthobservation #model #modeling #routing #urban #planning #spatiallogic #proximity #zonal #statistics #geostatistics #context #systemsintegration #workflows #processmodels #spatialintelligence #decisionsystems #businessrules #efficiency

Geospatial Without Maps [blog post]
--
https://cercanasystems.com/2025/05/geospatial-without-maps/ <-- shared blog posts
--
[I will be honest, I can’t remember the last time I personally made a map…]
#GIS #spatial #mapping #mapless #AllDataIsSpatial #usecase #appliedscience #appliedtechnology #automation #coding #machinelearning #AI #maintenance #utilities #GPS #infrastructure #datasupply #dataflow #spatialdata #spatialanalysis #spatiotemporal #farming #agriculture #precisionagriculture #yield #InternetOfThings #integration #smartinfracture #earthobservation #model #modeling #routing #urban #planning #spatiallogic #proximity #zonal #statistics #geostatistics #context #systemsintegration #workflows #processmodels #spatialintelligence #decisionsystems #businessrules #efficiency

Geospatial Without Maps [blog post]
--
https://cercanasystems.com/2025/05/geospatial-without-maps/ <-- shared blog posts
--
[I will be honest, I can’t remember the last time I personally made a map…]
#GIS #spatial #mapping #mapless #AllDataIsSpatial #usecase #appliedscience #appliedtechnology #automation #coding #machinelearning #AI #maintenance #utilities #GPS #infrastructure #datasupply #dataflow #spatialdata #spatialanalysis #spatiotemporal #farming #agriculture #precisionagriculture #yield #InternetOfThings #integration #smartinfracture #earthobservation #model #modeling #routing #urban #planning #spatiallogic #proximity #zonal #statistics #geostatistics #context #systemsintegration #workflows #processmodels #spatialintelligence #decisionsystems #businessrules #efficiency

Geospatial Without Maps [blog post]
--
https://cercanasystems.com/2025/05/geospatial-without-maps/ <-- shared blog posts
--
[I will be honest, I can’t remember the last time I personally made a map…]
#GIS #spatial #mapping #mapless #AllDataIsSpatial #usecase #appliedscience #appliedtechnology #automation #coding #machinelearning #AI #maintenance #utilities #GPS #infrastructure #datasupply #dataflow #spatialdata #spatialanalysis #spatiotemporal #farming #agriculture #precisionagriculture #yield #InternetOfThings #integration #smartinfracture #earthobservation #model #modeling #routing #urban #planning #spatiallogic #proximity #zonal #statistics #geostatistics #context #systemsintegration #workflows #processmodels #spatialintelligence #decisionsystems #businessrules #efficiency

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

For many years I've observed the following in parallel:

1. General confusion (and in some cases disdain) about the notion of a #SemanticWeb

2. Steadfast effort by a community to keep the vision going, stealthily, as exemplified by the #LODCloud (#DBpedia,, #Wikidata, #Uniprot etc..) and Schema.org (#SchemaOrg)

3. #DataSilos and all the impedance they inflict on the agility of individuals and enterprises alike on the rise i.e., #DataAccess and #DataFlow are still challenging, unnecessarily.

For many years I've observed the following in parallel:

1. General confusion (and in some cases disdain) about the notion of a #SemanticWeb

2. Steadfast effort by a community to keep the vision going, stealthily, as exemplified by the #LODCloud (#DBpedia,, #Wikidata, #Uniprot etc..) and Schema.org (#SchemaOrg)

3. #DataSilos and all the impedance they inflict on the agility of individuals and enterprises alike on the rise i.e., #DataAccess and #DataFlow are still challenging, unnecessarily.

For many years I've observed the following in parallel:

1. General confusion (and in some cases disdain) about the notion of a #SemanticWeb

2. Steadfast effort by a community to keep the vision going, stealthily, as exemplified by the #LODCloud (#DBpedia,, #Wikidata, #Uniprot etc..) and Schema.org (#SchemaOrg)

3. #DataSilos and all the impedance they inflict on the agility of individuals and enterprises alike on the rise i.e., #DataAccess and #DataFlow are still challenging, unnecessarily.

For many years I've observed the following in parallel:

1. General confusion (and in some cases disdain) about the notion of a #SemanticWeb

2. Steadfast effort by a community to keep the vision going, stealthily, as exemplified by the #LODCloud (#DBpedia,, #Wikidata, #Uniprot etc..) and Schema.org (#SchemaOrg)

3. #DataSilos and all the impedance they inflict on the agility of individuals and enterprises alike on the rise i.e., #DataAccess and #DataFlow are still challenging, unnecessarily.

𝐔𝐧𝐝𝐞𝐫𝐬𝐭𝐚𝐧𝐝𝐢𝐧𝐠 𝐭𝐡𝐞 𝐒𝐩𝐞𝐜𝐭𝐫𝐮𝐦 𝐨𝐟 𝐃𝐚𝐭𝐚 𝐋𝐢𝐧𝐞𝐚𝐠𝐞 𝐀𝐧𝐚𝐥𝐲𝐬𝐢𝐬

#Datalineage analysis is the backbone of #datagovernance, its the journey of data from origin to consumption. It not only ensures #dataintegrity & #compliance but also aids in decision-making processes & enhances data-driven strategies. Within the realm of data lineage analysis, various methodologies & approaches exist, each tailored to specific needs & objectives: https://www.foxconsulting.co/post/understanding-the-spectrum-of-data-lineage-analysis

#dataflow #dataquality

Поиск потенциальных уязвимостей в коде, часть 2: практика

В прошлый раз мы ознакомились с общими подходами в поиске уязвимостей безопасности в приложениях. В этот раз спустимся ближе к земле и посмотрим на то, как мы реализовали эти механизмы в нашем статическом анализаторе для Java.

https://habr.com/ru/companies/pvs-studio/articles/885576/

#sast #taint #taint_analysis #cfg #defuse #call_graph #inheritance_graph #security #dataflow #static_analysis

Поиск потенциальных уязвимостей в коде, часть 2: практика

В прошлый раз мы ознакомились с общими подходами в поиске уязвимостей безопасности в приложениях. В этот раз спустимся ближе к земле и посмотрим на то, как мы реализовали эти механизмы в нашем статическом анализаторе для Java.

https://habr.com/ru/companies/pvs-studio/articles/885576/

#sast #taint #taint_analysis #cfg #defuse #call_graph #inheritance_graph #security #dataflow #static_analysis

Поиск потенциальных уязвимостей в коде, часть 2: практика

В прошлый раз мы ознакомились с общими подходами в поиске уязвимостей безопасности в приложениях. В этот раз спустимся ближе к земле и посмотрим на то, как мы реализовали эти механизмы в нашем статическом анализаторе для Java.

https://habr.com/ru/companies/pvs-studio/articles/885576/

#sast #taint #taint_analysis #cfg #defuse #call_graph #inheritance_graph #security #dataflow #static_analysis

@m20k I'd probably start with a #softwaremodel though, keeping the #FPGA limitations in mind. However you will soon find that filling instructions with independent #µops (TMTA called these molecules and atoms) is really hard, especially for short #basicblocks. TMTA dealt with that in many ways, most significantly by compiling very large #superblocks (multiple exits) and make heavy use of #predication.

I would try something different: make the #dataflow explicit ...