#fluxframework — Public Fediverse posts

Interested in co-scheduling of quantum resources? We presented "Hybrid Quantum and Classical Workload Management with Graph-based Scheduling" at the OpenQSE Day today. I recorded the talk to share with the larger community. 🥳

https://youtu.be/9TV4Nxb7guk

I present the two-queue problem for co-scheduling of two different queues, and design solutions using the #FluxFramework scheduler Fluxion in Kubernetes and (WIP) on-premises.

Thank you #ORNL and collaborators for having us! 🙏

Interested in co-scheduling of quantum resources? We presented "Hybrid Quantum and Classical Workload Management with Graph-based Scheduling" at the OpenQSE Day today. I recorded the talk to share with the larger community. 🥳

https://youtu.be/9TV4Nxb7guk

I present the two-queue problem for co-scheduling of two different queues, and design solutions using the #FluxFramework scheduler Fluxion in Kubernetes and (WIP) on-premises.

Thank you #ORNL and collaborators for having us! 🙏

If you missed our #HPCKP talk on #FluxFramework Supporting Agentic Science, and some early vision for the #HPC Center of the future, the folks at the HPC Knowldege Portal have prepared all the event videos beautifully. We hope that you enjoy! 🥳

https://hpckp.org/talks/flux-framework-supporting-agentic-science/

Thank you #HPCKP! 😘

If you missed our #HPCKP talk on #FluxFramework Supporting Agentic Science, and some early vision for the #HPC Center of the future, the folks at the HPC Knowldege Portal have prepared all the event videos beautifully. We hope that you enjoy! 🥳

https://hpckp.org/talks/flux-framework-supporting-agentic-science/

Thank you #HPCKP! 😘

Interested in #quantum? Our converged computing team has started early work to explore integrations of #FluxFramework with quantum APIs and local devices, starting in #Kubernetes! You can check out the review of the space in my short talk. 🎥

https://youtu.be/GScovgpIx18?si=l8oFAkf2fCAbWDH0

Interested in #quantum? Our converged computing team has started early work to explore integrations of #FluxFramework with quantum APIs and local devices, starting in #Kubernetes! You can check out the review of the space in my short talk. 🎥

https://youtu.be/GScovgpIx18?si=l8oFAkf2fCAbWDH0

Want to learn about #FluxFramework with live presentations and tutorials? Come to our HPCIC Developer Tutorial, July 21st!

I may have something up my sleeve this year that is a bit cutting edge... hope to see you there!

https://llnlfed.webex.com/weblink/register/r694c00a304374c125262f71b3011396f

Registration is free and open to anyone!

Want to learn about #FluxFramework with live presentations and tutorials? Come to our HPCIC Developer Tutorial, July 21st!

I may have something up my sleeve this year that is a bit cutting edge... hope to see you there!

https://llnlfed.webex.com/weblink/register/r694c00a304374c125262f71b3011396f

Registration is free and open to anyone!

Interested to learn about our work in agentic science, with some added #FluxFramework? Please attend the #HPCKP meeting in Barcelona!💃

I am excited for this work, and for the future of science. After recording this talk today, I was moved to dance!🌹

https://hpckp.org/annual-meeting/agenda/annual-meeting/flux-framework-supporting-agentic-science/

Interested to learn about our work in agentic science, with some added #FluxFramework? Please attend the #HPCKP meeting in Barcelona!💃

I am excited for this work, and for the future of science. After recording this talk today, I was moved to dance!🌹

https://hpckp.org/annual-meeting/agenda/annual-meeting/flux-framework-supporting-agentic-science/

We are approaching #HPSF in Chicago and I am pumped! 🎉 Please come to my main track talk on converged computing and agentic workflows, our panel on emerging infrastructure, or the two tutorial sessions I am leading for the #FluxFramework community day.

See you there!

https://hpsf2026.sched.com/speaker/sochat1

We are approaching #HPSF in Chicago and I am pumped! 🎉 Please come to my main track talk on converged computing and agentic workflows, our panel on emerging infrastructure, or the two tutorial sessions I am leading for the #FluxFramework community day.

See you there!

https://hpsf2026.sched.com/speaker/sochat1

Coming to the #HPSF Conference in March? I hope you will attend the #FluxFramework sessions! 🌀 We will have a half day of talks, including an AI/ML Simulation Tutorial in #Kubernetes. All sing and dance with me now... "I like to Kube It, Kube It!"

https://youtu.be/21hi3jtGytg 🦩

Coming to the #HPSF Conference in March? I hope you will attend the #FluxFramework sessions! 🌀 We will have a half day of talks, including an AI/ML Simulation Tutorial in #Kubernetes. All sing and dance with me now... "I like to Kube It, Kube It!"

https://youtu.be/21hi3jtGytg 🦩

Interested in features, design, history or migration to #FluxFramework? We've updated our admin guide for you! https://flux-framework.readthedocs.io/projects/flux-core/en/latest/guide/admin_slurm.html

Have questions? Let us know! We are aiming to better engage with all of you, our community, in 2026 🎉 starting with joining #HPSF! 🥳

Interested in features, design, history or migration to #FluxFramework? We've updated our admin guide for you! https://flux-framework.readthedocs.io/projects/flux-core/en/latest/guide/admin_slurm.html

Have questions? Let us know! We are aiming to better engage with all of you, our community, in 2026 🎉 starting with joining #HPSF! 🥳

If you care about the intersection of high performance software and open source, we are pleased to announce that #FluxFramework will have a project meeting at the #HPSF 2026 Conference in Chicago next March! Please respond to the CFP to be a part of it!

https://events.linuxfoundation.org/hpsf-conference/program/cfp/

If you care about the intersection of high performance software and open source, we are pleased to announce that #FluxFramework will have a project meeting at the #HPSF 2026 Conference in Chicago next March! Please respond to the CFP to be a part of it!

https://events.linuxfoundation.org/hpsf-conference/program/cfp/

We are getting a lot of questions about #FluxFramework! 🎉 If you are new to the project, this is the right one: https://flux-framework.org/. You can most quickly get to the devs via an issue on flux-core on GitHub, or ping us in the hpc.social slack or here. ☎️

Let us know the questions you have! 🤓

We are getting a lot of questions about #FluxFramework! 🎉 If you are new to the project, this is the right one: https://flux-framework.org/. You can most quickly get to the devs via an issue on flux-core on GitHub, or ping us in the hpc.social slack or here. ☎️

Let us know the questions you have! 🤓

This is something I'm really excited about for #FluxFramework! Have you ever thought about the implications of your flag choices for binding? I made a little tool today (WIP) that can detect (and then predict) topology (binding) down to PU.

This is something I'm really excited about for #FluxFramework! Have you ever thought about the implications of your flag choices for binding? I made a little tool today (WIP) that can detect (and then predict) topology (binding) down to PU.

For folks familiar with #SLURM - we are looking for a way to validate SBATCH directives. Slurm has --test-only but it does validation for flags *and* against a cluster, and they seem tied. In #FluxFramework we can validate directives (via a directive parser) separately from resources (feasibility plugin). Thanks for the help!

For folks familiar with #SLURM - we are looking for a way to validate SBATCH directives. Slurm has --test-only but it does validation for flags *and* against a cluster, and they seem tied. In #FluxFramework we can validate directives (via a directive parser) separately from resources (feasibility plugin). Thanks for the help!

If you missed the #FluxFramework workshop or talk at #HPCK25, everything is posted online! Specifically:

🥑 Flux Framework Workshop: https://hpckp.org/talks/flux-next-generation-workload-management-for-high-performance-computing-and-cloud/
🥑 Ensemble Workloads in the Age of Converged Computing (talk) https://hpckp.org/talks/orchestrating-the-future-ensemble-workloads-in-the-age-of-converged-computing/
🥑 "Flux Time" Music Video (cut short during live session) https://youtu.be/N25GySogBeE

Thank you to all of you that could attend! 🥳

If you missed the #FluxFramework workshop or talk at #HPCK25, everything is posted online! Specifically:

🥑 Flux Framework Workshop: https://hpckp.org/talks/flux-next-generation-workload-management-for-high-performance-computing-and-cloud/
🥑 Ensemble Workloads in the Age of Converged Computing (talk) https://hpckp.org/talks/orchestrating-the-future-ensemble-workloads-in-the-age-of-converged-computing/
🥑 "Flux Time" Music Video (cut short during live session) https://youtu.be/N25GySogBeE

Thank you to all of you that could attend! 🥳

If you missed the #FluxFramework tutorial at #ISC25, have no fear! We have a little portion to share. Learn more about Flux Environments:

https://bsky.app/profile/vsoch.bsky.social/post/3lrj2y7w7gk2f

If you missed the #FluxFramework tutorial at #ISC25, have no fear! We have a little portion to share. Learn more about Flux Environments:

https://bsky.app/profile/vsoch.bsky.social/post/3lrj2y7w7gk2f

Excited about the #FluxFramework workshop coming up at #HPCKP25 in Barcelona? So are we! The schedule and registration is at https://hpckp.org/annual-meeting/agenda/. We have so much fun for you prepared...

https://youtu.be/abbUbDXHGeM?si=kr_AWC-5u6hXMif8

That's how we roll. 😎

Excited about the #FluxFramework workshop coming up at #HPCKP25 in Barcelona? So are we! The schedule and registration is at https://hpckp.org/annual-meeting/agenda/. We have so much fun for you prepared...

https://youtu.be/abbUbDXHGeM?si=kr_AWC-5u6hXMif8

That's how we roll. 😎

Good morning, and happy Monday folks! We have our first #FluxFramework dinosaur series notebook tutorial released this morning:

https://youtu.be/5qT4eyO0thw

We go through part 1 of the #HPCIC tutorial, basic commands for Flux, all in a #Jupyter notebook you can deploy too! 🥳

Good morning, and happy Monday folks! We have our first #FluxFramework dinosaur series notebook tutorial released this morning:

https://youtu.be/5qT4eyO0thw

We go through part 1 of the #HPCIC tutorial, basic commands for Flux, all in a #Jupyter notebook you can deploy too! 🥳

For our next #FluxFramework tutorial, I'll show you how to deploy an entire VM cluster on #GoogleCloud! ☁️

https://youtu.be/-EUE7Q6OI-8?si=b05Dm9686DNukq5Q

We use packer for build, Terraform for deploy, and then it's up in a few minutes. You can find resources in the video description, and please reach out with questions! ❓ 🤓

For our next #FluxFramework tutorial, I'll show you how to deploy an entire VM cluster on #GoogleCloud! ☁️

https://youtu.be/-EUE7Q6OI-8?si=b05Dm9686DNukq5Q

We use packer for build, Terraform for deploy, and then it's up in a few minutes. You can find resources in the video description, and please reach out with questions! ❓ 🤓

Experiment underway! 🧪 More #HPC convergence with #FluxFramework
+ #Kubernetes. I created a daemonset that installs Flux alongside the kubelet, and I'm going to try using it for container distribution and assisting a scheduler. https://github.com/converged-computing/flux-distribute.

*mad scientist noises* 😁

Experiment underway! 🧪 More #HPC convergence with #FluxFramework
+ #Kubernetes. I created a daemonset that installs Flux alongside the kubelet, and I'm going to try using it for container distribution and assisting a scheduler. https://github.com/converged-computing/flux-distribute.

*mad scientist noises* 😁

If you missed the #FluxFramework tutorial this year - never fear! The tutorial was just posted online! 🎉

https://youtu.be/Dt4CSZWSEJE?si=bhy4UZ_thUIrfqUo

This was immensely fun, and there is more to come!

If you missed the #FluxFramework tutorial this year - never fear! The tutorial was just posted online! 🎉

https://youtu.be/Dt4CSZWSEJE?si=bhy4UZ_thUIrfqUo

This was immensely fun, and there is more to come!

An interesting thing I'm realizing now mid-career (15 years in) is that I spend a lot more time (and get immense satisfaction) out of reading and understanding. This means code, specs, and manuals. It's recently been the Linux kernel, #Kubernetes, #FluxFramework, and #SkyPilot. ☁️

An interesting thing I'm realizing now mid-career (15 years in) is that I spend a lot more time (and get immense satisfaction) out of reading and understanding. This means code, specs, and manuals. It's recently been the Linux kernel, #Kubernetes, #FluxFramework, and #SkyPilot. ☁️

Along with talking about the #FluxFramework Operator (a partition-based strategy), I introduce a prototype to schedule to specific applications (brokers controlling a set of containers across pods) running in a Flux Framework #MiniCluster. I call this "pancake elasticity." 🥞

Along with talking about the #FluxFramework Operator (a partition-based strategy), I introduce a prototype to schedule to specific applications (brokers controlling a set of containers across pods) running in a Flux Framework #MiniCluster. I call this "pancake elasticity." 🥞

I'm proud to share that my team is sharing early work to get userspace #Kubernetes running with an #HPC workload manager #FluxFramework on #AWS!

https://arxiv.org/abs/2406.06995

There is more to do, but I'm immensely proud of this work, and grateful for the people I get to work with.🥰

I'm proud to share that my team is sharing early work to get userspace #Kubernetes running with an #HPC workload manager #FluxFramework on #AWS!

https://arxiv.org/abs/2406.06995

There is more to do, but I'm immensely proud of this work, and grateful for the people I get to work with.🥰

I'm pleased to announce that our work on the #FluxFramework operator is published in #F1000Research! This is an example of converged computing and was a joy to collaborate with Aldo Culquicondor, Antonio Ojea (Google) and Daniel Milroy (my team).

https://doi.org/10.12688/f1000research.147989.1.

It was important to me to share the design thinking underlying this work, and hopes for the future for our communities. I hope to do (and inspire others to do) work like this more often.

I'm pleased to announce that our work on the #FluxFramework operator is published in #F1000Research! This is an example of converged computing and was a joy to collaborate with Aldo Culquicondor, Antonio Ojea (Google) and Daniel Milroy (my team).

https://doi.org/10.12688/f1000research.147989.1.

It was important to me to share the design thinking underlying this work, and hopes for the future for our communities. I hope to do (and inspire others to do) work like this more often.

The reason I ask is because we are thinking about a next version for the
#FluxFramework jobspec, and although there is value in some kind of IR that looks like a graph, I have not been convinced yet this is what people want to use or write. Can you convince me otherwise? 🤔

The reason I ask is because we are thinking about a next version for the
#FluxFramework jobspec, and although there is value in some kind of IR that looks like a graph, I have not been convinced yet this is what people want to use or write. Can you convince me otherwise? 🤔

The #FOSDEM Bare metal bros talk is online! If you are interested in some of our #ConvergedComputing work with #FluxFramework and #Kubernetes, and why this work is important, this is a great talk to watch. 👇

https://fosdem.org/2024/schedule/event/fosdem-2024-2590-kubernetes-and-hpc-bare-metal-bros/

The #FOSDEM Bare metal bros talk is online! If you are interested in some of our #ConvergedComputing work with #FluxFramework and #Kubernetes, and why this work is important, this is a great talk to watch. 👇

https://fosdem.org/2024/schedule/event/fosdem-2024-2590-kubernetes-and-hpc-bare-metal-bros/

Many types of dinosaurs, including the Tall-flux-boi, the Broasaurus, the Hipstersaurus, and the Ganstasaurus choose #FluxFramework as their workload manager of choice! 🥇

Many types of dinosaurs, including the Tall-flux-boi, the Broasaurus, the Hipstersaurus, and the Ganstasaurus choose #FluxFramework as their workload manager of choice! 🥇

🐭 What are we going to do tonight, Brain?

🐀 Submit jobs to remote #FluxFramework instances, complete with auth to generate tokens and signed payloads!

*diabolical laughter* 🦹‍♂️

🐭 OK, but can we get tacos after? 🌮

🐀 🤦

https://asciinema.org/a/633719

I love my job. 😂 🥰

🐭 What are we going to do tonight, Brain?

🐀 Submit jobs to remote #FluxFramework instances, complete with auth to generate tokens and signed payloads!

*diabolical laughter* 🦹‍♂️

🐭 OK, but can we get tacos after? 🌮

🐀 🤦

https://asciinema.org/a/633719

I love my job. 😂 🥰

I (finally) took some time to write up a design we have in the wings for the #FluxFramework Operator!

👉 https://vsoch.github.io/2023/flux-operator-refactor/

With this new design, we add Flux on the fly, and there are some pretty neat implications for workflows, autoscaling, bursting, all that. Enjoy! 🎉

I (finally) took some time to write up a design we have in the wings for the #FluxFramework Operator!

👉 https://vsoch.github.io/2023/flux-operator-refactor/

With this new design, we add Flux on the fly, and there are some pretty neat implications for workflows, autoscaling, bursting, all that. Enjoy! 🎉

I'm embarrassed to say it took 10 months to put a proper release pipeline in place, but here we are! I'm happy to announce the first (official) release of the #FluxFramework operator! https://github.com/flux-framework/flux-operator/releases/tag/0.1.0. From here on out, I'll be releasing early+often akin to other projects.

I'm embarrassed to say it took 10 months to put a proper release pipeline in place, but here we are! I'm happy to announce the first (official) release of the #FluxFramework operator! https://github.com/flux-framework/flux-operator/releases/tag/0.1.0. From here on out, I'll be releasing early+often akin to other projects.

We have an amazing docs update for #FluxFramework!

Problem: Some people only read comic books. How are they going to learn about the world of supercomputing? 🤔

Solution: Start a comic series.

Brilliant! 🎉 The talent on this team inspires me daily. ❤️

https://flux-framework.readthedocs.io/en/latest/comics/fluxonomicon.html

We have an amazing docs update for #FluxFramework!

Problem: Some people only read comic books. How are they going to learn about the world of supercomputing? 🤔

Solution: Start a comic series.

Brilliant! 🎉 The talent on this team inspires me daily. ❤️

https://flux-framework.readthedocs.io/en/latest/comics/fluxonomicon.html