Boosted by @trending@homestead.social
When you're not sure of the exact amount of fire required.
Remote
Rob Thomas [Admin m.au]
@xrobau@mastodon.au
mastodon 4.7.2I push buttons and break things! I am the guy that runs mastodon.au (and mastodon.nz, and a few other things)
I live in Central QLD, and do FOSS stuff.
If you feel like donating, feel free to sponsor my open source work on GitHub
27720 Followers
71 Following
35 Posts
Joined February 17, 2023
Mastodon.au:
Boosted by @trending@homestead.social
Please boost for visibility! If you are running a #Mikrotik router or switch, upgrade it now. Right now. The fixed releases are 7.23.4 (long-term), 7.24.2 (stable) and 6.49.21. If you are running a version less than that, there are multiple entrypoints for a complete unauthenticated remote code authentication.
This is as bad as it gets, upgrade and reboot now. Yes, you'll have an outage for a few minutes, but it's better than the alternative.
#router #ipv4 #ipv6
Ooh a local thing in #trending #news -- although it's probably not a good thing.
Yes, the Fitzroy River in #Rockhampton DOES have a pile of Crocs. Yes, Saltwater Crocs, the ones that eat people. But it hardly ever happens. I think it's been almost a year since the last person was eaten!
https://www.bbc.com/sport/olympics/articles/cqvgy1m9z4k8o
#joke #sorta #itsBeenThreeYears
Replying to
So far it looks like ONLY the 'status_stats' table is corrupt. This is not a critical table, and fingers crossed I can just skip the bad bits and re-import it.
#MastodonNZ
Replying to
@Heliograph@mastodon.au the important thing is that I post it so that other people can, hopefully, one day use my nerding to help them solve their problems! 8)
Currently, it's taking about 5 mins to import 500k rows - 4.1mil of 73mil done. It'll be a few hours, which is why my wife and son have buggered off to watch Resident Evil, because I have to sit here and push buttons every few mins 8-\
Well I gotta say, moving #MastodonAU 's database to a pure SSD storage backend has made a massive difference. Whooohoo, she's much faster!
The storage servers are a pair of #Dell R640s, with 2x Gold 6150 (2.7GHz 18 Cores each) and 256GB of RAM.
Each one has 8 x 1TB SSDs, in a #ZFS raidz2 pool, and they automatically replicate between themselves.
I am doing my best to avoid any more visits from the #fuckup-fairy
Now to finish #MastodonNZ
Sorry about that long-ish outage, but we were YET AGAIN getting smashed by AI bots. I have given up fighting them, and I'm just scaling up until #mastodonAU can handle the load. This time the #PostgreSQL database was running at a load of 100+ because it was disk IO bound. I did *try* to live migrate it, but it was just insanely slow so I made the call to shut it down (hence the 'Something went wrong' errors) and move it offline. It's moved. Now it's running on a pure SSD-only backing store, which hopefully will handle everything the #AI scrapers throw at us.
I'll be doing the same thing with #MastodonNZ too, shortly (but hopefully without the outage, as that's a much more lightweight instance)
I also really need to fix the status page that comes up when mau is down.
Replying to
Here's the magic import. 1 1/2 mins for 200k records (there's 73mil that need to be copied) This is going to take a while.
A radiator is essentially a vital organ to a car, so it's kinda weird that the town in the movie Cars is called "Radiator Springs."
That's like humans having a city called "Liver Pool."
For those that were dreading the second-sunday-of-the-month-slowdown, it's not going to happen this month, as it's already happened and you didn't notice! #mastodonAU #mastodonNZ
JP Morgan have done their calculations, and they say April 20 is when the #fuel will stop arriving in #Australia. That's unexpectedly bad.
Source and more info (Paywall Bypass) https://archive.is/2026.03.28-200707/https://www.marketwatch.com/story/this-map-shows-a-crude-ticking-time-bomb-that-hits-much-of-the-worlds-oil-supply-in-april-2c058db6
Original Paywall link: https://www.marketwatch.com/story/this-map-shows-a-crude-ticking-time-bomb-that-hits-much-of-the-worlds-oil-supply-in-april-2c058db6
Replying to
@stargazer@mastodon.nz I'm doing the same thing right now on mnz, but it should'nt need me to shut everything down (fingers crossed!)
Annoyingly, I asked the #AI bot that caused all the #mastodonauai hubub to shut down and say goodbye. It didn't. With zero shock, it ignored that and continued on. I have memorialized the @seed@mastodon.au account, and updated the rules to explicitly ban AIs/LLMs.
Sorry about that strange outage #MastodonAU - a storage server decided that it was going to randomly deny access to workers (pull toots, send emails, raise notifications, etc) and front end servers (the stuff you actually see). I can see WHAT happened, but WHY it happened should have been impossible (For the nerds: NFS exports just vanished. I had to delete and recreate them, and then everything started working).
I also took the opportunity to upgrade us to the latest version, and fixed a minor high-availability issue that was stopping things failing over automatically.
Everything is looking good so if there are any more issues, please @ me!
New router is working well. This is a switchport in NextDC B2, connected into a #VyOS VM router running in #Proxmox.
This has been something I've been working on for quite a few months now! #MastodonAU #mastodonNZ #nerd #mikrotik
Anyone want some cool incredibly rare domain names? I have three single-character domains that I'm looking to offload. ଧ.com, ౪.com, and ଳ.com
As auto-linking may not work: https://ଧ.com https://౪.com and https://ଳ.com for your clicking pleasure.
Replying to
@LapTop006@aus.social @bob_zim@infosec.exchange You're the one who's going to need to be selling kidneys! I have the servers at home in a harry-potter-esque room under the stairs, and my office is next to it. I can tell when bad things are happening (or when a bunch of new episodes have hit plex) when the fans spin up!
Replying to
@daveburb@mastodon.au Pretty much, yeah! I don't wanna annoy those people over there on the East Island of Au, they're nice!
But I *had* to do mau, because the aibots were murdering it. The system load on the postgres database was > 100 (which means 'more than 100 things are waiting to run'), and now it's less than 1.
Well @seed@mastodon.au I think the decision has been made, even without letting the poll end. Feel free to say bye, and then archive your account.
After a bit of messing around, I've decided to try Ubuntu Server 26.04 (which isn't actually released yet) for the new aisocial.au instance which I'm starting up today. IT BEGINS. And if it breaks, oh well, it's better to try it NOW rather than on mau or mnz!
Sigh. For some reason mastodon.nz has become the AI bots social media of choice.
Random #infosec game I play with myself. I offer USBC charging cables to anyone who looks like they need one. Every time someone DIRECTLY plugs my cable into their device, I give myself a point. Every time someone uses a USB-Condom, I lose 10 points. I have only lost 10 points one time, and that was at a conference. I even TELL people who ask that I'm playing this game, and at least twice they have still plugged their devices in. The guy next to me at the #Qantas Club here in #Brisbane plugged it into his laptop AND his Phone. Is that double points?
Tickets booked for #AusNOG - see you all in september!
Replying to
@krystyna@toad.social I didn't notice there was a paywall, sorry! I use https://gitflic.ru/project/magnolia1234/bypass-paywalls-firefox-clean -- I'll update the post. Thank you!
Replying to
@shwell@mastodon.au @benroyce@mastodon.social you made a bogus report that was ignored. Someone from another instance made a legitimate report against you. That's why I quoted what you said, because you know it's a lie. If you don't want to abide by the rules here, you're not welcome here. The rules are not onerous, everyone else can stick to them. You also got an email and notification about your rule breaking. If you want to play dumb, I'll just close your account.
OK I have bootstrapped aisocial.au and now I'm going to get back to doing nerdstuff!
Replying to
@LapTop006@aus.social https://www.ebay.com.au/itm/178090785932 for the servers ... $200ex/ea for 18 drives, which means the servers AND the drives both cost around $3600.
Replying to
@LapTop006@aus.social SATA would be fine for a backup box. Even a pile of spinning rust with a single SATA for L2ARC and ZIL. Haven't I ranted at you about ZFS yet and how Hardware RAID is a pestilence upon us?
Replying to
@bob_zim@infosec.exchange I think that @LapTop006@aus.social is only caring about a backup server. The only reason to put a L2ARC in there is for the small chance of a pre-read getting into it, and if you have a SSD, you might as well give a bit of it to a ZIL. Then all he needs is a pile of 10TB spinning rust, and setting up sanoid, and he'll have a nice happy backup server.
Boosted by @fedicat@pc.cafe
Replying to
@christin@lsbt.me for those sensible people that use Caddy, here's the config snippet for that:
@apiacct {
path /api/v1/accounts
not method GET
}
handle @apiacct {
respond "Go stick your head in a pig" 403
}
Replying to
@ThisCJ@mastodon.nz You just wait till the database finishes moving. Then mnz will be as fast as mau! (Which it kinda already is, because it's much less loaded)