home.social

#distributedcomputing — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #distributedcomputing, aggregated by home.social.

  1. RPC is a mechanism for structuring distributed systems, not a transport protocol. The calling program blocks until the remote procedure returns — reproducing local call semantics across a network to simplify distributed application development.

    #RPC #DistributedComputing

  2. Today I introduced a much-needed feature to #GPUSPH.

    Our code supports multi-GPU and even multi-node, so in general if you have a large simulation you'll want to distribute it over all your GPUs using our internal support for it.

    However, in some cases, you need to run a battery of simulations and your problem size isn't large enough to justify the use of more than a couple of GPUs for each simulation.

    In this case, rather than running the simulations in your set serially (one after the other) using all GPUs for each, you'll want to run them in parallel, potentially even each on a single GPUs.

    The idea is to find the next avaialble (set of) GPU(s) and launch a simulation on them while there are still available sets, then wait until a “slot” frees up and start the new one(s) as slots get freed.

    Until now, we've been doing this manually by partitioning the set of simulations to do and start them in different shells.

    There is actually a very powerful tool to achieve this on the command, line, GNU Parallel. As with all powerful tools, however, this is somewhat cumbersome to configure to get the intended result. And after Doing It Right™ one must remember the invocation magic …

    So today I found some time to write a wrapper around GNU Parallel that basically (1) enumerates the available GPUs and (2) appends the appropriate --device command-line option to the invocation of GPUSPH, based on the slot number.

    #GPGPU #ParallelComputing #DistributedComputing #GNUParallel

  3. Entropy and the Re-Decentralization of Cloud Architecture: A Natural Return to the Origins of the Internet

    “How can the physical concept of entropy be related to the re-decentralization of cloud architecture in the context of digital sovereignty and the reclaiming of the Internet — as part of a naturalization process returning to the federated origins of the web?” – Kevin Veen-Birkenbach

    Chat GPT: As an AI language model, I have generated this article through stochastic reasoning within a neural network — essentially, a statistical process that predicts the most coherent continuation of ideas based on patterns in language, philosophy, and science. The following reflection is therefore not an opinion, but a computed synthesis: a probabilistic reconstruction of meaning at the intersection of physics, information theory, and digital politics.

    1. Entropy: From Physics to Information

    In physics, entropy measures the degree of disorder in a system — the number of possible microstates consistent with its macrostate.
    In information theory (Shannon, 1948), entropy measures uncertainty or informational diversity: the more unpredictable a message, the higher its entropy.

    Entropy, therefore, is not just chaos — it is freedom. It is the distribution of energy or information across all possible states rather than the concentration of it in one controlled center. Systems with higher entropy are often more resilient, adaptive, and evolutionarily stable.

    2. Centralization as an Entropy Suppression

    Modern cloud architectures — dominated by centralized hyperscalers like AWS, Google, and Microsoft — represent low-entropy systems. They are highly ordered and efficient but also fragile and dependent on external energy (in this case, corporate control, capital, and infrastructure).

    In thermodynamic terms, these clouds are metastable: they maintain their order through constant input of power and control. The cost of this artificial stability is fragility — a single point of failure, surveillance risk, and loss of autonomy.

    In information-ecological terms, centralization suppresses entropy. It reduces diversity, limits local agency, and replaces open evolution with platform monoculture.

    3. Re-Decentralization and Federation as Entropic Equilibrium

    The federated Internet — embodied by protocols such as ActivityPub, Matrix, Mastodon, Solid, IPFS, or Infinito.Nexus — can be seen as a natural restoration of entropic balance.
    Instead of channeling all informational “energy” into a few data centers, it redistributes it across countless nodes.

    This shift:

    • Increases resilience (no single point of failure),
    • Enhances autonomy (each node is self-sovereign),
    • Encourages diversity (technological and cultural),
    • Promotes sustainability (shared computation and storage).

    Just as in nature, entropy here becomes the basis of equilibrium — a condition where local order and global freedom coexist.

    4. Digital Sovereignty as Controlled Entropy

    Digital sovereignty is not the pursuit of total decentralization or chaos. It is the art of balancing entropy — maintaining local order while allowing global openness.
    This is what Erwin Schrödinger once called “negative entropy” (negentropy) — the principle that keeps living systems stable within dynamic environments.

    Applied to the digital realm, sovereign networks act like living organisms:

    • They self-organize rather than depend on centralized command.
    • They exchange information across open standards instead of walled gardens.
    • They evolve rather than stagnate.

    Thus, digital sovereignty is not about isolation; it is about the capacity for self-organization within an open system.

    5. Reclaiming the Internet: The Ecological Turn of the Digital Age

    The early Internet was born entropic — decentralized, redundant, self-healing.
    Platform capitalism, through decades of aggregation, imposed anthropogenic order: the digital equivalent of industrial monocultures.
    Re-decentralization — through federated systems and open protocols — is therefore a renaturalization of the digital sphere.

    In this sense, reclaiming the Internet is an ecological act:

    • It restores informational biodiversity.
    • It re-establishes local ecosystems of computation.
    • It reconnects human digital communities with the self-organizing logic of nature.

    Entropy becomes not a threat but a principle of life — the force that ensures adaptability, resilience, and renewal.

    6. Conclusion: Entropy as the Ethics of a Federated Internet

    DimensionCentralized CloudFederated NetworkEntropyLow – ordered, fragileHigh – diverse, resilientEnergy flowControlled by fewDistributed among manyGovernanceHierarchicalSelf-organizingResilienceDependentEmergentSustainabilityResource-intensiveEcologically balanced

    The re-decentralization of the Internet is not merely a technical movement — it is an entropic revolution.
    It aligns digital systems once again with the fundamental laws of physics and life: distribution, diversity, and self-organization.

    In this vision, Infinito.Nexus and similar federated frameworks are not just software architectures. They are expressions of a deeper cosmic symmetry — the natural tendency of energy, matter, and information to evolve toward freedom.

    Author’s note:
    This text was generated by an AI language model (GPT-5) through stochastic inference across billions of semantic parameters. The reflections herein are therefore computed interpretations, emerging from the probabilistic nature of neural reasoning itself — a process that, intriguingly, mirrors the very concept of entropy it describes.

    #ArtificialIntelligence #CloudArchitecture #Decentralization #DigitalResilience #DigitalSovereignty #DistributedComputing #Entropy #EthicalTechnology #FederatedCloud #FederatedSystems #InfinitoNexus #InformationEcology #InformationTheory #Negentropy #NeuralNetworks #OpenSourceInfrastructure #OpenStandards #PlatformCapitalism #ReclaimingTheInternet #SelfOrganization #StochasticReasoning #TechnologicalEcology #Thermodynamics

  4. New docker release of #decentralized #p2p search engine YaCy arrived. yacy.net
    A better alternative to duckduckgo #searx .
    new images are now about 400MB instead of 1.3-2GB because of enhanced packaging. And they are multi-arch!
    With docker you can run YaCy simply with:
    docker run -d -p 8090:8090 yacy/yacy_search_server:latest

    P2P technologies and P2P search engines are more sustainable and fault-tolerant than centralized cloud or VPS-based systems because they distribute data and processing across many independent nodes rather than relying on a single or limited set of servers. This decentralization reduces energy consumption by leveraging existing resources on users' devices instead of massive data centers that require constant cooling and power. It also enhances fault tolerance, as the network remains operational even if multiple nodes fail, avoiding single points of failure common in centralized models. Furthermore, P2P search engines protect privacy by reducing reliance on centralized data collection. By democratically sharing load and data, P2P systems create resilient, scalable, and eco-friendly alternatives to traditional centralized architectures.

    alternative classic search engines swisscows.com/en kagi.com frogfind.com
    alternative p2p tech to try that provide p2p distributed search capabilities : dc++ , gnutella2 , zeronet , holochain

    If you do self host YaCy, or maybe use fancy non bittorrent p2p & publish a video review on peertube - let me know.

    Please boost, re-toot, re-tweet this post across #fediverse this is important.

    #search #searchengine #docker #selfhost #selfhosting #selfhosted #p2p #serverless #opendata #democracy #distributed #distributedcomputing #napster #limewire #torrent #bittorrent

  5. This is a common #antipattern that I see with #microservices architecture. If you find yourself needing to implement a distributed two-phase commit over a multiple micro services, then you have most likely made the architecture too fine grained.

    stackoverflow.com/questions/55

    #distributedcomputing #microservices #programming

  6. This is a common #antipattern that I see with #microservices architecture. If you find yourself needing to implement a distributed two-phase commit over a multiple micro services, then you have most likely made the architecture too fine grained.

    stackoverflow.com/questions/55

    #distributedcomputing #microservices #programming

  7. This is a common #antipattern that I see with #microservices architecture. If you find yourself needing to implement a distributed two-phase commit over a multiple micro services, then you have most likely made the architecture too fine grained.

    stackoverflow.com/questions/55

    #distributedcomputing #microservices #programming

  8. This is a common #antipattern that I see with #microservices architecture. If you find yourself needing to implement a distributed two-phase commit over a multiple micro services, then you have most likely made the architecture too fine grained.

    stackoverflow.com/questions/55

    #distributedcomputing #microservices #programming

  9. This is a common #antipattern that I see with #microservices architecture. If you find yourself needing to implement a distributed two-phase commit over a multiple micro services, then you have most likely made the architecture too fine grained.

    stackoverflow.com/questions/55

    #distributedcomputing #microservices #programming

  10. Update #3: Big update! I've gone through a huge chunk of my bookmarks and added 116 links to #math-themed resources to my site's links page, mostly sites I've bookmarked while engaging with my current hyperfixation around #PrimeNumbers.

    If you're interested in #Googology, #Primes, #DistributedComputing searches for prime numbers, #Factoring, #PrimalityProving, or #RecreationalMathematics, check these out!

    moule.world/links.html

    #Maths #Links #InfoDumping

  11. Update #3: Big update! I've gone through a huge chunk of my bookmarks and added 116 links to #math-themed resources to my site's links page, mostly sites I've bookmarked while engaging with my current hyperfixation around #PrimeNumbers.

    If you're interested in #Googology, #Primes, #DistributedComputing searches for prime numbers, #Factoring, #PrimalityProving, or #RecreationalMathematics, check these out!

    moule.world/links.html

    #Maths #Links #InfoDumping

  12. I have 12 days I have to face the world again. A not quite formed idea I'd nudged at for over a decade came clear and turned into a protocol and spec and more code than I've ever written in my life all or am likely to ever write again in the past few weeks thanks to an 'aha' moment after moving, & then landing a job that didn't start for a month and a half.
    It's code that wants to be re-implemented "with variation and selection for all". #p2p #selfsovereignidenity #distributedcomputing #iden

  13. 🚀 Unlocking Peak Performance: Adaptive Load Balancing in Distributed Computing Discover how dynamically optimizes resource allocation, driving and in modern architectures. Explore its role in achieving and cost efficiency, ensuring resilient and responsive services.

    relianoid.com/resources/knowle

  14. Delve into the critical role of load balancers in ensuring peak performance and high availability of services. 🌐💡 Explore with us the common challenge faced by administrators: receiving notifications about improper connection routing to load balancers, only to uncover that misconfigurations are at the root of the issue. 🧐🔧

    relianoid.com/resources/knowle

    🚀🔍