#mastodonappuk — Public Fediverse posts

Just so I can finally clear the announcement off of #MastodonAppUK and #Universeodon - We've been running without the Cloudflare Caching / proxy service since November 2025 now and other than the odd hiccup behind the scenes (Which CF wouldn't have helped with anyway) it's been really stable and from the folks that have provided feedback on the performance of the sites, both in the UK (Where we host the sites) and internationally the performance has been noticeably better.

We'll continue to monitor the global performance of the site, we continuously monitor latency and response times from various global endpoints and if it looks like we need to enable some sort of cache / CDN beyond what we now have in place we will re- visit it in the future. The change to remove CF proxying is going to remain permanent and now be "Normal" instead of the response to their global outage last year.

And apologies to the folks here on #MastodonAppUK and #Universeodon - This has broken a lot of follower / following relationships which I know is never ideal. This is a lot of the reason I've been reluctant up until now to suspend the instance but the amount of reports we keep getting for it and the fact it's running a very old version of Mastodon with no active admin account since Feb 2023 means I don't see a sensible way to stay federated now.

We're adding mastodon.cloud to our #Fediblock list due to the instance seemingly being abandoned with open signups and zero moderation. The burden of us suspending accounts locally is not practical when the instance is out of date and not being maintained.

It's been flagged since August last year - https://social.growyourown.services/@FediTips/115027342813989021 so I don't see it likely that anything is suddenly going to change.

#MastodonAppUK #Universeodon #FediMedi #MastoAdmin

Apologies for the blip there impacting a wide range of the sites we run ( #MastodonAppUK / #Universeodon / #FediMedi and for #MastoAdmin The Universeodon relay).

It looks like the NIC in one of our app servers had some sort of weird failure which prevented traffic on one of the two interfaces and due to it being setup in aggregation and not failover it caused a total outage of that server and all the VM's and CT's running on it.

We have also identified some issues with our secondary HAProxy instance which we need to get to the bottom of as things did not fail over as expected (Even though we know we haven't got full HA operational yet across all services because storage and RAM prices are through the roof and we need to add a third server for that).

Apologies again, we should be back to normal for now.

I've just pushed a minor change to our infrastructure configuration for #MastodonAppUK and #Universeodon - I'm hoping this should fix some of the weird issues we've seen around IPv6 and it does mean that if our primary HAproxy server does go down for any reason the secondary server will take on the IPv6 connectivity as well.

I do need to look and see if I can do something smart to cover some IPv6 monitoring as right now IPv6 can silently fail and the site will still show as fully healthy.

Just as a bit of notice for #MastodonAppUk and #Universeodon folks

There will be an outage later this evening to facilitate the work I need to do here at the dc. Hoping it won't take too long and I'll let folks know when I have an idea on time.

I'm just waiting now for a dc staff member to let me through the front gate as it's a weekend so nobody's normally here 😂

It looks like I'm going to need to drive up to the DC now because I can't reasonably apply my fix remotely without risking breaking everything and having to go up there anyway.

For folks here on #MastodonAppUK and #Universeodon if you'd like to chip in to support my growing coffee addiction with the nonsense that is servers and kit breaking I would always appreciate it.

One Off / Monthly on Ko-Fi: https://ko-fi.com/mastodonappuk

And monthly support on Patreon: https://www.patreon.com/universeodon

The support is really appreciated and allows me to continue investing in the hardware and resources required to keep the sites online and with the continued goal now of removing dependencies on external parties.

It looks like the connectivity issues between #Universeodon and #MastodonAppUK are at least in part due to SideKiq and IPv6.

I've disabled IPv6 on SideKiq for the time being to at least let me try and get things back operational.

For now though it's very much past my bedtime and I need sleep!

We're having some major issues this evening across #MastodonAppUK and #Universeodon due to connectivity issues with our primary gateway router at our data center.

I'm waiting on some network monitoring info from our ISP but I'm starting to suspect this may be some sort of attack as I can't think of any other reason our router would be seemingly crashing regularly.

It seems as if the device comes online for a few seconds and then drops back off the internet.

Thankfully it doesn't seem to be actively impacting the sites themselves but our content processing is currently almost entirely offline due to issues with outbound connectivity.

We may be seeing some network related issues across #MastodonAppUK and #Universeodon

I'm keeping an eye but our router is currently unresponsive.

The status page will be updated should we actually see connectivity drops - https://status.atlas-media.co.uk

Just a note, we have added the following domains to our #Fediblock list across #MastodonAppUK #Universeodon and #MedMastodon

- privacysafe.social
- privacymatters.pro

Both domains have had more than a few recent reports which no action have been taken by the instances with relation to misinformation / anti-vax content and in the case of the second domain transphobia.

For #MastodonAppUK and #Universeodon folks - I think I've finally got the IPv6 connectivity working again, I need to do some digging to see what caused it to drop it's address in the first place and have a load of work to get the secondary haproxy instance aligned and sync'd with the first one but I'm hoping this should mean we're now fully operational again and everything should be working :)

I've had a few reports that #MastodonAppUk and #Universeodon are playing up again with IPv6 since the maintenance I had to do yesterday which involved a full reboot of all our servers.

I'm fairly busy with other commitments today but will take a look when I can.

#MastodonAppUK and #Universeodon

Site's going offline for a short amount of time while I get everything updated. Be right back.

There will be a short outage later today across #MastodonAppUK and #Universeodon while I apply some updates to our underlying servers and hosts which needs me to turn everything off quickly.

So some good news for #MastodonAppUK and #Universeodon folks

The issues with IPv6 are now resolved, we now have full IPv6 support which should be working for everyone now, apologies for the blip earlier - I had added the AAAA record to turn on the connectivity but had missed a firewall configuration so traffic was getting blocked.

For reasons that I cannot explain, in enabling native IPv6 support for the site it looks like the slow uploads and timeouts and "Unknown errors" some folks were seeing with media uploads appear to have been resolved. I'm going to continue to monitor the logs closely to see if there are any further issues but I'm hopeful we should now be in a good place.

I'm aware of an issue with IPv6 across #MastodonAppUk and #Universeodon which I am working on. I made a config change while on the way back from Brussels to try to fully enable IPv6 support but it doesn't seem to be working so anyone who is primarily using IPv6 may be having connectivity issues. I've only recently got home so will be working on the issue shortly once I've had time to unpack some of my things and exist at home!

Quick update for #MastodonAppUK folks - We're now running the 4.5 release of Mastodon enabling quote posts.

If you want to know more about what's changed and what's in 4.5 checkout the Mastodon blog post here - https://blog.joinmastodon.org/2025/11/mastodon-4.5/

For #Universeodon - I'll be performing the upgrade later today if nothing looks to have broken here on MastodonApp.

Just to note as well for folks on #MastodonAppUK and #Universeodon

I am still looking into this issue with media uploads, I'm so far struggling to pin down a root cause as for most folks it's an intermittent error and I haven't actually found any errors in our logs yet other than what is returned to the apps / clients.

As soon as I can get to the bottom of it I'll get it sorted properly so media uploads work like normal again.

Sorry for the blips there to #MastodonAppUK and #Universeodon - I managed to bork some of our HAProxy configuration in a bit of a stupid way.

MastodonAppUK is now running a single web server on the new cluster so I'm hoping that should make things feel a lot more responsive as I've removed some of the hops we were going through.

Tomorrow I'll get the other two temp web servers stood up, an additional for MastodonApp and an additional for Universeodon and get all the old servers on the old cluster decommissioned which should then mean all traffic is hitting our new owned dedicated hardware in the new environment!

It looks like the #Universeodon relay has gone down due to an issue on the host it's running on. Apologies other #MastoAdmin 's out there. It's rebooting now and I need to do some digging to see why the host restarted in the first place. Apologies for any disruption.

It's also taken down our #FullTextSearch on #MastodonAppUK and some other core services on MastodonAppUK so I'm looking into this all now.