MUDLER(1)General Commands ManualMUDLER(1)
NAME
mudler — Ettore Di Giacinto; builds AI that runs on hardware you own
SYNOPSIS
mudler [--local] [--no-cloud] [--since 2008] model ...
DESCRIPTION
Local AI is the way. Creator of LocalAI. Builds local-first AI infrastructure, immutable Linux, and from-scratch C++/ggml ports of models that were never meant to leave Python.
Formerly: Gentoo developer, Sabayon lead, SUSE (openQA, Elemental), Rancher. Currently maintains the LocalAI ecosystem and CNCF Kairos.
PROJECTS
LocalAIOpen-source AI engine — LLMs, vision, voice, image and video on any hardware, no GPU required. (Go · MIT · 47k stars)
LocalAGISelf-hostable AI agent platform; drop-in replacement for the OpenAI Responses API. (Go · 1.8k stars)
LocalRecall100% local memory layer and knowledge base for agents, with a web UI. (Go · 900+ stars)
EdgeVPNDecentralized peer-to-peer VPN built on libp2p — no central server, token-based discovery. (Go · 1.9k stars)
KairosImmutable Linux meta-distribution for edge Kubernetes. Donated to the CNCF. (Go · CNCF · 1.7k stars)
depth-anything.cppFrom-scratch C++17/ggml port of ByteDance's Depth Anything 3. No Python at inference. (C++ · 800+ stars)
parakeet.cppNVIDIA Parakeet ASR in C++ with ggml. (C++ · 700+ stars)
POSTS
- 2026-02-28A call to open source maintainers, stop babysitting AI: How I Built a 100% Local Autonomous Dev Team to Maintain LocalAI, and why you should too
- 2024-05-30LocalAI and llama.cpp on Jetson Nano Devkit
- 2023-06-22Create a Question answering bot for Slack on your data, that you can run locally
- 2023-05-12Question Answering on Documents locally with LangChain, LocalAI, Chroma, and GPT4All
- 2023-05-11LocalAI updates