#htcondor — Public Fediverse posts

Today I learned that #CERN has been using #HTCondor for data processing since 2016.

https://htcondor.org/featured-users/2025-12-03-cern-stresstests-htcondor.html

⇒ https://www.gute-neuigkeiten.de/#cern-htcondor-2016

#GoodNews #TIL

Suddenly remembering the time I tried to write an #HTCondor file transfer plugin for S3. It didn't work because the underlying code did not expect anything except [a-z] in the protocol.

@drmorr just learning. My SysAdmin work regularly sits at the intersection of middleware tech-stacks, so trying to understand what's going on. Most of my time is in batch compute ( #Slurm , #HTCondor ). But I keep hearing #CloudNative will eat the world, so am curious if it can properly what the tools I already use can do. 🤨

@vsoch Now to figure out specify a desired container programmatically during #HTCondor job submission. https://htcondor.readthedocs.io/en/latest/users-manual/container-universe-jobs.html

Bouncing back to #HTCondor Workshop material, here is my talk on #EDIA issues in Research Computing. Response was... mixed, but given the scale of the problem, this was expected. 😣
https://indico.cern.ch/event/1274213/sessions/510851/#20230921

Todd Tannenbaum, #HTCondor software lead from #CHTC @ the University of Wisconsin kicks off the workshop with a broad overview of #HTCSS terminology and components. https://indico.cern.ch/event/1274213/contributions/5571128/

Here is the detailed time table from last years #HTCondor Workshop in Cuneo, Italy 🍷 . The main focus was on distributed high-throughput computing #dHTC. *Remember*: submit locally, run globally. Because (most) users don't care where it runs, as long as the #TtC is good. https://indico.cern.ch/event/1174979/timetable/#all.detailed

Very engaging talk by Peter Couvares about #IGWN data management issues, particularly the inscrutable errors with data transfer problems on #HTCondor systems. #CVMFS #OSDF
https://computing.docs.ligo.org/guide/
https://indico.cern.ch/event/1274213/contributions/5571138/

Brian B is back again to talk about the wonders of managing data transfers with #HTCondor tools and being wary of destroying #NFS servers.
https://indico.cern.ch/event/1274213/contributions/5571140/

And to wrap up the session before lunch, Brian Bockelman gives us a Token Taxonomy, with respect to #HTCondor. I appreciate it because #authentication & #authorization still confuse 😖 the heck out of me.
https://indico.cern.ch/event/1274213/contributions/5571155/

LOTS of discussion about the job life cycle and what are the reponsibilities of the main #HTCondor daemons. This can get quite complicated with multi-pool & ephemeral clusters.

Good morning from #ICJLab in Orsay, France for the 2023 Autumn #HTCondor Workshop. Detailed agenda can be found here: https://indico.cern.ch/event/1274213/timetable/#all.detailed

And so begins the morning journey to Paris for the 2023 Autumn European #HTCondor Workshop from Exeter. I agree with Sam that 5:30am is way too early to wake up.

I will be heading to Orsay, France 🥐 this September for the European #HTCondor Workshop. If anyone from #HPC or #CloudNative land are interested in learning more about distributed research computing, give me a wave. 👋🏻 https://indico.cern.ch/event/1274213/