About me §

Hey! Thanks for stopping by.

I’m Ettore, known online as mudler. I’ve been an open source hacker and hacktivist for nearly two decades — since organizing Linux Days as a teenager — and I hold an MS in Computer Science.

I’m the creator and maintainer of LocalAI, the free, open-source AI engine for running LLMs, vision, voice and image models on hardware you own — no cloud required. Around it I maintain a growing ecosystem: agents (LocalAGI), memory (LocalRecall), and a series of from-scratch C++/ggml ports of modern models — parakeet.cpp, depth-anything.cpp, and friends. I also created Kairos, the immutable Linux meta-distribution for edge Kubernetes, donated to the CNCF, which I still maintain.

Before all of this I was a Gentoo developer and led Sabayon Linux; later I worked at SUSE on openQA (I rewrote its scheduler) and Cloud Foundry, and led the Elemental team at Rancher. Local AI is the way: I believe computing — and especially AI — should answer to the people who own the hardware it runs on.

These days I work as an independent OSS consultant, currently working with Spectro Cloud. If you need help with any of my projects, or with local AI in general, you can sponsor my work or reach me at consulting@localai.io.

Find me on GitHub, X/Twitter, Hugging Face, LinkedIn, and CPAN.

For everything I’ve built, ported, or contributed to, see projects(7).