home.social

#reproduciblecomputing — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #reproduciblecomputing, aggregated by home.social.

  1. RE: fediscience.org/@snakemake/116

    This little bit "performance improvements" lowered the number of file system access events for considerably! #Snakemake triggers many such events for keeping track of metadata. Which is important, but may cause some delays due to file system overhead - particularly on parallel and/or network file systems. The feature to outsource parts of this to sqlite was implemented during the #SnakemakeHackathon2026 . I hope, I can test the improvements next Monday!

    #HPC #ReproducibleComputing

  2. RE: fediscience.org/@snakemake/116

    This little bit "performance improvements" lowered the number of file system access events for considerably! #Snakemake triggers many such events for keeping track of metadata. Which is important, but may cause some delays due to file system overhead - particularly on parallel and/or network file systems. The feature to outsource parts of this to sqlite was implemented during the #SnakemakeHackathon2026 . I hope, I can test the improvements next Monday!

    #HPC #ReproducibleComputing

  3. RE: fediscience.org/@snakemake/116

    This little bit "performance improvements" lowered the number of file system access events for considerably! #Snakemake triggers many such events for keeping track of metadata. Which is important, but may cause some delays due to file system overhead - particularly on parallel and/or network file systems. The feature to outsource parts of this to sqlite was implemented during the #SnakemakeHackathon2026 . I hope, I can test the improvements next Monday!

    #HPC #ReproducibleComputing

  4. RE: fediscience.org/@snakemake/116

    This little bit "performance improvements" lowered the number of file system access events for considerably! #Snakemake triggers many such events for keeping track of metadata. Which is important, but may cause some delays due to file system overhead - particularly on parallel and/or network file systems. The feature to outsource parts of this to sqlite was implemented during the #SnakemakeHackathon2026 . I hope, I can test the improvements next Monday!

    #HPC #ReproducibleComputing

  5. RE: fediscience.org/@snakemake/116

    This little bit "performance improvements" lowered the number of file system access events for considerably! #Snakemake triggers many such events for keeping track of metadata. Which is important, but may cause some delays due to file system overhead - particularly on parallel and/or network file systems. The feature to outsource parts of this to sqlite was implemented during the #SnakemakeHackathon2026 . I hope, I can test the improvements next Monday!

    #HPC #ReproducibleComputing

  6. RE: fediscience.org/@snakemake/116

    Software provenance with #Snakemake: Using the reporter plugin for nanopublications, we can now get slightly improved nanopublications like this one: w3id.org/np/RAmgzfta63xx0wWc_z (press on the little blue arrow on the right to see the full details). Automatically captured for this workflow: w3id.org/np/RAjHDlPDghZzc9ZvQ3 - again expressed a nanopub declaration. 😉

    It now supports to capture the "classic" software support for #Conda and Snakemake wrappers.

    There is more work to do. Let's see when and if I get to it.

    #reproducibleComputing #softwareprovenance #nanopub

  7. RE: fediscience.org/@snakemake/116

    Software provenance with #Snakemake: Using the reporter plugin for nanopublications, we can now get slightly improved nanopublications like this one: w3id.org/np/RAmgzfta63xx0wWc_z (press on the little blue arrow on the right to see the full details). Automatically captured for this workflow: w3id.org/np/RAjHDlPDghZzc9ZvQ3 - again expressed a nanopub declaration. 😉

    It now supports to capture the "classic" software support for #Conda and Snakemake wrappers.

    There is more work to do. Let's see when and if I get to it.

    #reproducibleComputing #softwareprovenance #nanopub

  8. RE: fediscience.org/@snakemake/116

    Software provenance with #Snakemake: Using the reporter plugin for nanopublications, we can now get slightly improved nanopublications like this one: w3id.org/np/RAmgzfta63xx0wWc_z (press on the little blue arrow on the right to see the full details). Automatically captured for this workflow: w3id.org/np/RAjHDlPDghZzc9ZvQ3 - again expressed a nanopub declaration. 😉

    It now supports to capture the "classic" software support for #Conda and Snakemake wrappers.

    There is more work to do. Let's see when and if I get to it.

    #reproducibleComputing #softwareprovenance #nanopub

  9. RE: fediscience.org/@snakemake/116

    Software provenance with #Snakemake: Using the reporter plugin for nanopublications, we can now get slightly improved nanopublications like this one: w3id.org/np/RAmgzfta63xx0wWc_z (press on the little blue arrow on the right to see the full details). Automatically captured for this workflow: w3id.org/np/RAjHDlPDghZzc9ZvQ3 - again expressed a nanopub declaration. 😉

    It now supports to capture the "classic" software support for #Conda and Snakemake wrappers.

    There is more work to do. Let's see when and if I get to it.

    #reproducibleComputing #softwareprovenance #nanopub

  10. RE: fediscience.org/@snakemake/116

    Software provenance with #Snakemake: Using the reporter plugin for nanopublications, we can now get slightly improved nanopublications like this one: w3id.org/np/RAmgzfta63xx0wWc_z (press on the little blue arrow on the right to see the full details). Automatically captured for this workflow: w3id.org/np/RAjHDlPDghZzc9ZvQ3 - again expressed a nanopub declaration. 😉

    It now supports to capture the "classic" software support for #Conda and Snakemake wrappers.

    There is more work to do. Let's see when and if I get to it.

    #reproducibleComputing #softwareprovenance #nanopub

  11. RE: fediscience.org/@snakemake/116

    Now, folks, this is my first release of a Snakemake reporter plugin!

    I am pretty proud of it, but it would have been impossible without the input of @johanneskoester , @tkuhn and - most of all - @fbartusch !

    What is it about?

    Have you ever read a #bioinformatics paper and thought: "Hugh? How did they get there? This is absolutely not #reproducibleComputing , because I cannot apply it!"

    The Snakemake Workflow Management System helps researchers by generating a self-contained HTML report with all bells and whistles (all software metadata, runtime stats and publication-ready figures). And yet, I felt it is time to easy writing the materials & methods section.

    Declare a worfklow #nanopub using this template: w3id.org/np/RAOT7z3RA0XYlHIikn and get a declaration like this: w3id.org/np/RAjHDlPDghZzc9ZvQ3

    Use this reporter plugin and get all metadata reference in one other nano publication: w3id.org/np/RAK9xz_ccnu0Xhs4vX

    1/3

  12. RE: fediscience.org/@snakemake/116

    Now, folks, this is my first release of a Snakemake reporter plugin!

    I am pretty proud of it, but it would have been impossible without the input of @johanneskoester , @tkuhn and - most of all - @fbartusch !

    What is it about?

    Have you ever read a #bioinformatics paper and thought: "Hugh? How did they get there? This is absolutely not #reproducibleComputing , because I cannot apply it!"

    The Snakemake Workflow Management System helps researchers by generating a self-contained HTML report with all bells and whistles (all software metadata, runtime stats and publication-ready figures). And yet, I felt it is time to easy writing the materials & methods section.

    Declare a worfklow #nanopub using this template: w3id.org/np/RAOT7z3RA0XYlHIikn and get a declaration like this: w3id.org/np/RAjHDlPDghZzc9ZvQ3

    Use this reporter plugin and get all metadata reference in one other nano publication: w3id.org/np/RAK9xz_ccnu0Xhs4vX

    1/3

  13. RE: fediscience.org/@snakemake/116

    Now, folks, this is my first release of a Snakemake reporter plugin!

    I am pretty proud of it, but it would have been impossible without the input of @johanneskoester , @tkuhn and - most of all - @fbartusch !

    What is it about?

    Have you ever read a #bioinformatics paper and thought: "Hugh? How did they get there? This is absolutely not #reproducibleComputing , because I cannot apply it!"

    The Snakemake Workflow Management System helps researchers by generating a self-contained HTML report with all bells and whistles (all software metadata, runtime stats and publication-ready figures). And yet, I felt it is time to easy writing the materials & methods section.

    Declare a worfklow #nanopub using this template: w3id.org/np/RAOT7z3RA0XYlHIikn and get a declaration like this: w3id.org/np/RAjHDlPDghZzc9ZvQ3

    Use this reporter plugin and get all metadata reference in one other nano publication: w3id.org/np/RAK9xz_ccnu0Xhs4vX

    1/3

  14. RE: fediscience.org/@snakemake/116

    Now, folks, this is my first release of a Snakemake reporter plugin!

    I am pretty proud of it, but it would have been impossible without the input of @johanneskoester , @tkuhn and - most of all - @fbartusch !

    What is it about?

    Have you ever read a #bioinformatics paper and thought: "Hugh? How did they get there? This is absolutely not #reproducibleComputing , because I cannot apply it!"

    The Snakemake Workflow Management System helps researchers by generating a self-contained HTML report with all bells and whistles (all software metadata, runtime stats and publication-ready figures). And yet, I felt it is time to easy writing the materials & methods section.

    Declare a worfklow #nanopub using this template: w3id.org/np/RAOT7z3RA0XYlHIikn and get a declaration like this: w3id.org/np/RAjHDlPDghZzc9ZvQ3

    Use this reporter plugin and get all metadata reference in one other nano publication: w3id.org/np/RAK9xz_ccnu0Xhs4vX

    1/3

  15. RE: fediscience.org/@snakemake/116

    Now, folks, this is my first release of a Snakemake reporter plugin!

    I am pretty proud of it, but it would have been impossible without the input of @johanneskoester , @tkuhn and - most of all - @fbartusch !

    What is it about?

    Have you ever read a #bioinformatics paper and thought: "Hugh? How did they get there? This is absolutely not #reproducibleComputing , because I cannot apply it!"

    The Snakemake Workflow Management System helps researchers by generating a self-contained HTML report with all bells and whistles (all software metadata, runtime stats and publication-ready figures). And yet, I felt it is time to easy writing the materials & methods section.

    Declare a worfklow #nanopub using this template: w3id.org/np/RAOT7z3RA0XYlHIikn and get a declaration like this: w3id.org/np/RAjHDlPDghZzc9ZvQ3

    Use this reporter plugin and get all metadata reference in one other nano publication: w3id.org/np/RAK9xz_ccnu0Xhs4vX

    1/3

  16. The #SnakemakeHackathon2026 has ended, we are still preparing our preprint release. But, our host has prepared a note on their homepage: go.tum.de/946236 🥳

    #Snakemake #ReproducibleComputing

  17. The #SnakemakeHackathon2026 has ended, we are still preparing our preprint release. But, our host has prepared a note on their homepage: go.tum.de/946236 🥳

    #Snakemake #ReproducibleComputing

  18. The #SnakemakeHackathon2026 has ended, we are still preparing our preprint release. But, our host has prepared a note on their homepage: go.tum.de/946236 🥳

    #Snakemake #ReproducibleComputing

  19. The #SnakemakeHackathon2026 has ended, we are still preparing our preprint release. But, our host has prepared a note on their homepage: go.tum.de/946236 🥳

    #Snakemake #ReproducibleComputing

  20. The #SnakemakeHackathon2026 has ended, we are still preparing our preprint release. But, our host has prepared a note on their homepage: go.tum.de/946236 🥳

    #Snakemake #ReproducibleComputing

  21. RE: fediscience.org/@snakemake/116

    This is a big step forward: The SLURM plugin for Snakemake now supports so-called job arrays. These are cluster jobs, with ~ equal resource requirements in terms of memory and compute resources.

    The change in itself was big: The purpose of a workflow system is to make use of the vast resources of an HPC cluster. Hence, jobs are submitted to run concurrently. However, for a job array, we have to "wait" for all eligible jobs to be ready. And then we submit.

    To preserve concurrent execution of other jobs which are ready to be executed, a thread pool has been introduced. In itself, I do not see job arrays as such a big feature: The LSF system profited much more from arrays than the rather lean SLURM implementation does.

    BUT: the new code base will ease further development to pooling many shared memory tasks (applications which support no parallel execution or are confined to one computer by "only" supporting threading). Until then, there is more work to do.

    #HPC #SLURM #Snakemake #SnakemakeHackathon2026 #ReproducibleComputing #OpenScience

  22. RE: fediscience.org/@snakemake/116

    This is a big step forward: The SLURM plugin for Snakemake now supports so-called job arrays. These are cluster jobs, with ~ equal resource requirements in terms of memory and compute resources.

    The change in itself was big: The purpose of a workflow system is to make use of the vast resources of an HPC cluster. Hence, jobs are submitted to run concurrently. However, for a job array, we have to "wait" for all eligible jobs to be ready. And then we submit.

    To preserve concurrent execution of other jobs which are ready to be executed, a thread pool has been introduced. In itself, I do not see job arrays as such a big feature: The LSF system profited much more from arrays than the rather lean SLURM implementation does.

    BUT: the new code base will ease further development to pooling many shared memory tasks (applications which support no parallel execution or are confined to one computer by "only" supporting threading). Until then, there is more work to do.

    #HPC #SLURM #Snakemake #SnakemakeHackathon2026 #ReproducibleComputing #OpenScience

  23. RE: fediscience.org/@snakemake/116

    This is a big step forward: The SLURM plugin for Snakemake now supports so-called job arrays. These are cluster jobs, with ~ equal resource requirements in terms of memory and compute resources.

    The change in itself was big: The purpose of a workflow system is to make use of the vast resources of an HPC cluster. Hence, jobs are submitted to run concurrently. However, for a job array, we have to "wait" for all eligible jobs to be ready. And then we submit.

    To preserve concurrent execution of other jobs which are ready to be executed, a thread pool has been introduced. In itself, I do not see job arrays as such a big feature: The LSF system profited much more from arrays than the rather lean SLURM implementation does.

    BUT: the new code base will ease further development to pooling many shared memory tasks (applications which support no parallel execution or are confined to one computer by "only" supporting threading). Until then, there is more work to do.

    #HPC #SLURM #Snakemake #SnakemakeHackathon2026 #ReproducibleComputing #OpenScience

  24. RE: fediscience.org/@snakemake/116

    This is a big step forward: The SLURM plugin for Snakemake now supports so-called job arrays. These are cluster jobs, with ~ equal resource requirements in terms of memory and compute resources.

    The change in itself was big: The purpose of a workflow system is to make use of the vast resources of an HPC cluster. Hence, jobs are submitted to run concurrently. However, for a job array, we have to "wait" for all eligible jobs to be ready. And then we submit.

    To preserve concurrent execution of other jobs which are ready to be executed, a thread pool has been introduced. In itself, I do not see job arrays as such a big feature: The LSF system profited much more from arrays than the rather lean SLURM implementation does.

    BUT: the new code base will ease further development to pooling many shared memory tasks (applications which support no parallel execution or are confined to one computer by "only" supporting threading). Until then, there is more work to do.

    #HPC #SLURM #Snakemake #SnakemakeHackathon2026 #ReproducibleComputing #OpenScience

  25. RE: fediscience.org/@snakemake/116

    This is a big step forward: The SLURM plugin for Snakemake now supports so-called job arrays. These are cluster jobs, with ~ equal resource requirements in terms of memory and compute resources.

    The change in itself was big: The purpose of a workflow system is to make use of the vast resources of an HPC cluster. Hence, jobs are submitted to run concurrently. However, for a job array, we have to "wait" for all eligible jobs to be ready. And then we submit.

    To preserve concurrent execution of other jobs which are ready to be executed, a thread pool has been introduced. In itself, I do not see job arrays as such a big feature: The LSF system profited much more from arrays than the rather lean SLURM implementation does.

    BUT: the new code base will ease further development to pooling many shared memory tasks (applications which support no parallel execution or are confined to one computer by "only" supporting threading). Until then, there is more work to do.

    #HPC #SLURM #Snakemake #SnakemakeHackathon2026 #ReproducibleComputing #OpenScience

  26. RE: fediscience.org/@snakemake/116

    What a week at the #SnakemakeHackathon2026 !

    What a wonderful week with wonderful people!

    We were pretty productive and this #Snakemake release is just the peak of it. The list of features, bug fixes, performance improvement and additional documentation is so long — our little announcement robot cannot display it all. Even here on FediiScience with its 1500-character limit!

    #ReproducibleComputing #OpenScience

  27. RE: fediscience.org/@snakemake/116

    What a week at the #SnakemakeHackathon2026 !

    What a wonderful week with wonderful people!

    We were pretty productive and this #Snakemake release is just the peak of it. The list of features, bug fixes, performance improvement and additional documentation is so long — our little announcement robot cannot display it all. Even here on FediiScience with its 1500-character limit!

    #ReproducibleComputing #OpenScience

  28. RE: fediscience.org/@snakemake/116

    What a week at the #SnakemakeHackathon2026 !

    What a wonderful week with wonderful people!

    We were pretty productive and this #Snakemake release is just the peak of it. The list of features, bug fixes, performance improvement and additional documentation is so long — our little announcement robot cannot display it all. Even here on FediiScience with its 1500-character limit!

    #ReproducibleComputing #OpenScience

  29. RE: fediscience.org/@snakemake/116

    What a week at the #SnakemakeHackathon2026 !

    What a wonderful week with wonderful people!

    We were pretty productive and this #Snakemake release is just the peak of it. The list of features, bug fixes, performance improvement and additional documentation is so long — our little announcement robot cannot display it all. Even here on FediiScience with its 1500-character limit!

    #ReproducibleComputing #OpenScience

  30. RE: fediscience.org/@snakemake/116

    What a week at the #SnakemakeHackathon2026 !

    What a wonderful week with wonderful people!

    We were pretty productive and this #Snakemake release is just the peak of it. The list of features, bug fixes, performance improvement and additional documentation is so long — our little announcement robot cannot display it all. Even here on FediiScience with its 1500-character limit!

    #ReproducibleComputing #OpenScience

  31. What do you see here? This is an example knowledge graph describing a #Snakemake analysis workflow. You see the workflow description, a linked data set and a linked report.

    All work done to boost #HPC user support for those conducting their workflows on HPC systems (you can run Snakemake on other platforms, too).

    My to-do list:
    - an assertion template for workflows: ✅
    - another for reports: ✅ (simple datasets are already in the #nanopub verse)
    - a plugin to gather software metadata and publish as a nanopub ❌ (half done: #SnakemakeHackathon2026 )

    Kudos to @nanopub / @tkuhn and @johanneskoester - without them this pursuit would (have been) futile! And my feeling is that @fbartusch will play an important role in any further development ...

    #OpenScience #ReproducibleComputing

  32. What do you see here? This is an example knowledge graph describing a #Snakemake analysis workflow. You see the workflow description, a linked data set and a linked report.

    All work done to boost #HPC user support for those conducting their workflows on HPC systems (you can run Snakemake on other platforms, too).

    My to-do list:
    - an assertion template for workflows: ✅
    - another for reports: ✅ (simple datasets are already in the #nanopub verse)
    - a plugin to gather software metadata and publish as a nanopub ❌ (half done: #SnakemakeHackathon2026 )

    Kudos to @nanopub / @tkuhn and @johanneskoester - without them this pursuit would (have been) futile! And my feeling is that @fbartusch will play an important role in any further development ...

    #OpenScience #ReproducibleComputing

  33. What do you see here? This is an example knowledge graph describing a #Snakemake analysis workflow. You see the workflow description, a linked data set and a linked report.

    All work done to boost #HPC user support for those conducting their workflows on HPC systems (you can run Snakemake on other platforms, too).

    My to-do list:
    - an assertion template for workflows: ✅
    - another for reports: ✅ (simple datasets are already in the #nanopub verse)
    - a plugin to gather software metadata and publish as a nanopub ❌ (half done: #SnakemakeHackathon2026 )

    Kudos to @nanopub / @tkuhn and @johanneskoester - without them this pursuit would (have been) futile! And my feeling is that @fbartusch will play an important role in any further development ...

    #OpenScience #ReproducibleComputing

  34. What do you see here? This is an example knowledge graph describing a #Snakemake analysis workflow. You see the workflow description, a linked data set and a linked report.

    All work done to boost #HPC user support for those conducting their workflows on HPC systems (you can run Snakemake on other platforms, too).

    My to-do list:
    - an assertion template for workflows: ✅
    - another for reports: ✅ (simple datasets are already in the #nanopub verse)
    - a plugin to gather software metadata and publish as a nanopub ❌ (half done: #SnakemakeHackathon2026 )

    Kudos to @nanopub / @tkuhn and @johanneskoester - without them this pursuit would (have been) futile! And my feeling is that @fbartusch will play an important role in any further development ...

    #OpenScience #ReproducibleComputing

  35. What do you see here? This is an example knowledge graph describing a #Snakemake analysis workflow. You see the workflow description, a linked data set and a linked report.

    All work done to boost #HPC user support for those conducting their workflows on HPC systems (you can run Snakemake on other platforms, too).

    My to-do list:
    - an assertion template for workflows: ✅
    - another for reports: ✅ (simple datasets are already in the #nanopub verse)
    - a plugin to gather software metadata and publish as a nanopub ❌ (half done: #SnakemakeHackathon2026 )

    Kudos to @nanopub / @tkuhn and @johanneskoester - without them this pursuit would (have been) futile! And my feeling is that @fbartusch will play an important role in any further development ...

    #OpenScience #ReproducibleComputing

  36. I want to reach out: I have this pending release for the SLURM executor (github.com/snakemake/snakemake ). It implements better error feedback (in case of hardware failures and otherwise). It would need some thorough checking, and I cannot provoke too many hardware failures. Is anyone working on an older cluster? 😉

    Feedback (as issues) would be appreciated. Also nice, if you tell me it is working, here.

    #Snakemake #HPC #SLURM #ReproducibleComputing

  37. I want to reach out: I have this pending release for the SLURM executor (github.com/snakemake/snakemake ). It implements better error feedback (in case of hardware failures and otherwise). It would need some thorough checking, and I cannot provoke too many hardware failures. Is anyone working on an older cluster? 😉

    Feedback (as issues) would be appreciated. Also nice, if you tell me it is working, here.

    #Snakemake #HPC #SLURM #ReproducibleComputing

  38. I want to reach out: I have this pending release for the SLURM executor (github.com/snakemake/snakemake ). It implements better error feedback (in case of hardware failures and otherwise). It would need some thorough checking, and I cannot provoke too many hardware failures. Is anyone working on an older cluster? 😉

    Feedback (as issues) would be appreciated. Also nice, if you tell me it is working, here.

    #Snakemake #HPC #SLURM #ReproducibleComputing

  39. I want to reach out: I have this pending release for the SLURM executor (github.com/snakemake/snakemake ). It implements better error feedback (in case of hardware failures and otherwise). It would need some thorough checking, and I cannot provoke too many hardware failures. Is anyone working on an older cluster? 😉

    Feedback (as issues) would be appreciated. Also nice, if you tell me it is working, here.

    #Snakemake #HPC #SLURM #ReproducibleComputing

  40. I want to reach out: I have this pending release for the SLURM executor (github.com/snakemake/snakemake ). It implements better error feedback (in case of hardware failures and otherwise). It would need some thorough checking, and I cannot provoke too many hardware failures. Is anyone working on an older cluster? 😉

    Feedback (as issues) would be appreciated. Also nice, if you tell me it is working, here.

    #Snakemake #HPC #SLURM #ReproducibleComputing