Another day, another 6ms knocked of Linux boot speed:
Remote
Eric Curtin
@ecurtin@social.treehouse.systems
mastodon 4.6.7+glitch-thDocker Engineer working in AI
0 Followers
0 Following
10 Posts
Joined November 13, 2022
RE: @vvbudh@climatejustice.social
Genuinely I think many of the systemd haters don't know why they hate systemd, just heard someone else say it and followed along
Heading to Brussels for #FOSDEM26 (Jan 31- Feb 1)? Want to learn about Docker Model Runner and other AI offerings at Docker? Dorin and I will be speaking in the AI Plumbers DevRoom on Saturday and hope to see you there
https://www.youtube.com/watch?v=m061eizaEko
Some points to clarify on wayoa. The Metal rendering, that's for the macOS window. We would expect the Linux application and VMM to use GPU acceleration via KosmicKrisp. https://github.com/ericcurtin/wayoa and https://github.com/ericcurtin/vmm are open to contributions.
The world's first inference server with Gemma 4 and TurboQuant:
brew tap ericcurtin/inferrs
brew install inferrs
inferrs run --turbo-quant google/gemma-4-E2B-it
https://github.com/ericcurtin/inferrs
Gemma 4 and TurboQuant coming to Docker Model Runner soon. Gemma 4 is available on Docker Hub.
Replying to
@bagder this is possibly the funniest security vulnerability I have ever read. This effects a wide array of programs 🙂
With murmurings around the Nvidia/Hugging Face deal, ever wonder if it would be cool if we could pull models from Hugging Face or many other types of model registries. The solution exists and is hiding right under our eyes:
https://llmmanorg.github.io/blog/mirror-hugging-face-models-into-any-oci-registry/
Models are just OCI artifacts.
@jorge@hachyderm.io @fatherlinux@noc.social curious what this is😊
Replying to
@whot@fosstodon.org it's funny to see this post, coincidentally we saw this kernel feature was causing a delay in boot time, note we are talking about kernels that boot < 500ms so every ms counts. Do you know of any ways to combat this outside of a karg and just not including in the kernel build?