home.social

#sidekiq — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #sidekiq, aggregated by home.social.

  1. Dear #MastoAdmin for anyone using #S3 storage I would highly recommend disabling S3 multipart uploads for a day (or forever) to see if you notice any improvements.

    Pre-existing issues with Mastodon and S3, plus some recent regressions in the #AWS S3 library can cause a variety of issues, notably in the ingress #sidekiq worker, such as:

    - infinite disk usage in /tmp
    - higher outbound bandwidth use (2-4x)
    - higher cpu and memory use by sidekiq
    - higher costs on providers like Wasabi that have minimum duration charges for incomplete multipart uploads

    You can do this by setting S3_MULTIPART_THRESHOLD=1073741824 (any sufficiently high value that all processed media will fit below).

    Note that setting S3_FORCE_SINGLE_REQUEST=true is not sufficient, as this only impacts reading files from S3 to disk, and not uploading to S3. Increasing S3 timeouts and retries may help, but doesn't solve the issues entirely.

    The results will depend on your environment and specific S3 provider, but are significant and worth testing to see if they affect you.

    github.com/mastodon/mastodon/i

    github.com/aws/aws-sdk-ruby/is

    github.com/mastodon/mastodon/p

  2. Dear #MastoAdmin for anyone using #S3 storage I would highly recommend disabling S3 multipart uploads for a day (or forever) to see if you notice any improvements.

    Pre-existing issues with Mastodon and S3, plus some recent regressions in the #AWS S3 library can cause a variety of issues, notably in the ingress #sidekiq worker, such as:

    - infinite disk usage in /tmp
    - higher outbound bandwidth use (2-4x)
    - higher cpu and memory use by sidekiq
    - higher costs on providers like Wasabi that have minimum duration charges for incomplete multipart uploads

    You can do this by setting S3_MULTIPART_THRESHOLD=1073741824 (any sufficiently high value that all processed media will fit below).

    Note that setting S3_FORCE_SINGLE_REQUEST=true is not sufficient, as this only impacts reading files from S3 to disk, and not uploading to S3. Increasing S3 timeouts and retries may help, but doesn't solve the issues entirely.

    The results will depend on your environment and specific S3 provider, but are significant and worth testing to see if they affect you.

    github.com/mastodon/mastodon/i

    github.com/aws/aws-sdk-ruby/is

    github.com/mastodon/mastodon/p

  3. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #selfhosting #opensource #forum #letsencrypt #postgresql #rockylinux #selfhosted #elasticsearch #rubyonrails #rubygems #forumsoftware #redis #sidekiq #reverseproxy

  4. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #rockylinux #postgresql #reverseproxy #forumsoftware #elasticsearch #rubyonrails #redis #sidekiq #selfhosting #rubygems #selfhosted #letsencrypt #forum #opensource

  5. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #rockylinux #postgresql #reverseproxy #forumsoftware #elasticsearch #rubyonrails #redis #sidekiq #selfhosting #rubygems #selfhosted #letsencrypt #forum #opensource

  6. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #rockylinux #postgresql #reverseproxy #forumsoftware #elasticsearch #rubyonrails #redis #sidekiq #selfhosting #rubygems #selfhosted #letsencrypt #forum #opensource

  7. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #rockylinux #postgresql #reverseproxy #forumsoftware #elasticsearch #rubyonrails #redis #sidekiq #selfhosting #rubygems #selfhosted #letsencrypt #forum #opensource

  8. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #postgresql #rubyonrails #forumsoftware #rockylinux #rubygems #opensource #elasticsearch #forum #selfhosted #letsencrypt #reverseproxy #selfhosting #sidekiq #redis

  9. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #postgresql #rubyonrails #forumsoftware #rockylinux #rubygems #opensource #elasticsearch #forum #selfhosted #letsencrypt #reverseproxy #selfhosting #sidekiq #redis

  10. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #postgresql #rubyonrails #forumsoftware #rockylinux #rubygems #opensource #elasticsearch #forum #selfhosted #letsencrypt #reverseproxy #selfhosting #sidekiq #redis

  11. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #forum #sidekiq #elasticsearch #rubygems #reverseproxy #selfhosted #rubyonrails #letsencrypt #redis #selfhosting #postgresql #forumsoftware #opensource #rockylinux

  12. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #forum #sidekiq #elasticsearch #rubygems #reverseproxy #selfhosted #rubyonrails #letsencrypt #redis #selfhosting #postgresql #forumsoftware #opensource #rockylinux

  13. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #forum #sidekiq #elasticsearch #rubygems #reverseproxy #selfhosted #rubyonrails #letsencrypt #redis #selfhosting #postgresql #forumsoftware #opensource #rockylinux

  14. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #forum #sidekiq #elasticsearch #rubygems #reverseproxy #selfhosted #rubyonrails #letsencrypt #redis #selfhosting #postgresql #forumsoftware #opensource #rockylinux

  15. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #sidekiq #forumsoftware #selfhosting #forum #opensource #reverseproxy #selfhosted #rubyonrails #redis #rockylinux #elasticsearch #postgresql #rubygems #letsencrypt

  16. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #rubyonrails #redis #forum #rockylinux #selfhosted #opensource #forumsoftware #letsencrypt #reverseproxy #sidekiq #rubygems #selfhosting #postgresql #elasticsearch

  17. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #rubyonrails #redis #forum #rockylinux #selfhosted #opensource #forumsoftware #letsencrypt #reverseproxy #sidekiq #rubygems #selfhosting #postgresql #elasticsearch

  18. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #letsencrypt #forum #sidekiq #opensource #forumsoftware #elasticsearch #rubyonrails #rubygems #rockylinux #selfhosting #postgresql #reverseproxy #redis #selfhosted

  19. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #letsencrypt #forum #sidekiq #opensource #forumsoftware #elasticsearch #rubyonrails #rubygems #rockylinux #selfhosting #postgresql #reverseproxy #redis #selfhosted

  20. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #opensource #rockylinux #sidekiq #reverseproxy #letsencrypt #rubyonrails #redis #selfhosted #elasticsearch #rubygems #forumsoftware #forum #selfhosting #postgresql

  21. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #forumsoftware #forum #postgresql #rockylinux #sidekiq #reverseproxy #rubyonrails #letsencrypt #opensource #redis #elasticsearch #selfhosting #rubygems #selfhosted

  22. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #redis #postgresql #rubyonrails #sidekiq #selfhosting #opensource #forum #rubygems #forumsoftware #letsencrypt #elasticsearch #reverseproxy #selfhosted #rockylinux

  23. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #forumsoftware #reverseproxy #selfhosted #sidekiq #letsencrypt #rockylinux #opensource #selfhosting #postgresql #rubygems #forum #rubyonrails #redis #elasticsearch

  24. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #selfhosted #opensource #forumsoftware #postgresql #elasticsearch #sidekiq #selfhosting #redis #rubygems #letsencrypt #forum #rockylinux #rubyonrails #reverseproxy

  25. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #selfhosting #reverseproxy #rockylinux #forum #rubygems #opensource #forumsoftware #selfhosted #postgresql #letsencrypt #redis #sidekiq #rubyonrails #elasticsearch

  26. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #opensource #reverseproxy #elasticsearch #selfhosted #forumsoftware #selfhosting #rockylinux #rubyonrails #rubygems #redis #forum #sidekiq #postgresql #letsencrypt

  27. Die Fehler in #Sidekiq nehmen langsam zu, wir verlieren den Kontakt zu den anderen .de-Instanzen.

    #Mastoadmin #Fnordon #DNSSEC #DEFAIL

  28. Die Fehler in #Sidekiq nehmen langsam zu, wir verlieren den Kontakt zu den anderen .de-Instanzen.

    #Mastoadmin #Fnordon #DNSSEC #DEFAIL

  29. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #postgresql #forum #opensource #rockylinux #letsencrypt #selfhosted #rubyonrails #rubygems #reverseproxy #selfhosting #sidekiq #elasticsearch #forumsoftware #redis

  30. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #selfhosting #postgresql #elasticsearch #rubygems #rubyonrails #letsencrypt #forum #opensource #reverseproxy #selfhosted #rockylinux #sidekiq #redis #forumsoftware

  31. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #postgresql #rubygems #selfhosted #forumsoftware #rubyonrails #opensource #redis #forum #elasticsearch #rockylinux #sidekiq #letsencrypt #reverseproxy #selfhosting

  32. How to Deploy #Forem on Rocky Linux #VPS This article provides a guide detailing how to deploy Forem on Rocky Linux VPS.
    What is Forem?
    Forem is a robust, open-source platform for building communities like DEV.to. Deploying it on Rocky Linux involves setting up dependencies like PostgreSQL, ...
    Continued 👉 blog.radwebhosting.com/deploy- #rockylinux #selfhosting #opensource #redis #rubyonrails #rubygems #letsencrypt #sidekiq #reverseproxy #forumsoftware #elasticsearch #forum #postgresql #selfhosted

  33. I spent a couple of days of fighting with forked #Ruby processes (think, #Sidekiq Swarm, #Puma Clusters, etc…) having broken network connections. I'd made sure to cleanup and/or re-establish connections pre/post fork. Yet the errors persisted. At which point, I was convinced, “It's me. I'm the problem, it's me.”

    And then… it turned out to be a Ruby 3.2+ and #macOS 26+ bug! bugs.ruby-lang.org/issues/21790

  34. I spent a couple of days of fighting with forked #Ruby processes (think, #Sidekiq Swarm, #Puma Clusters, etc…) having broken network connections. I'd made sure to cleanup and/or re-establish connections pre/post fork. Yet the errors persisted. At which point, I was convinced, “It's me. I'm the problem, it's me.”

    And then… it turned out to be a Ruby 3.2+ and #macOS 26+ bug! bugs.ruby-lang.org/issues/21790