Mudler blog

A call to open source maintainers, stop babysitting AI: How I Built a 100% Local Autonomous Dev Team to Maintain LocalAI, and why you should too

Sat, 28 Feb 2026 00:00:00 +0000

If you’re building software today, you’ve probably felt the new kind of developer burnout.

Things changed drammatically in the last two months.

Even Karpathy sensei could not write it better:

The real pain isn’t writing the code anymore, it’s the brutal cognitive load of context switching between managing agent sessions. You try to scale your output with AI, and suddenly you’re managing a dozen different agents across a sea of split terminal windows, or clicking endlessly through bloated, dedicated UIs just to figure out what broke.

LocalAI and llama.cpp on Jetson Nano Devkit

Thu, 30 May 2024 00:00:00 +0000

If you are a lucky(?) owner of the Jetson Nano Devkit (4GB), and you don’t know anymore on what to do with it, you can try to run LocalAI with llama.cpp on it.

The Jetson Nano Devkit is currently not supported anymore by Nvidia, and receives little to no attention, however, it can still do something, and if you are like me that recycles the board at home, you might want to have fun with it by running AI on top of it. It might be also good candidate for the workload distribution features that LocalAI has (see: https://localai.io/features/distribute/), but leaving that for another post.

Create a Question answering bot for Slack on your data, that you can run locally

Thu, 22 Jun 2023 00:00:00 +0000

There has been a lot of buzz around AI, Langchain, and the possibilities they offer nowadays. In this blog post, I will delve into the process of creating a small assistant for yourself or your team on Slack. This assistant will be able to provide answers related to your documentation.

The problem

I work at Spectro Cloud, and we have an exciting open source project called Kairos (check it out at https://kairos.io if you want to learn more about it!). Kairos is a Meta-Linux, immutable distribution designed for running Kubernetes at the Edge.

Question Answering on Documents locally with LangChain, LocalAI, Chroma, and GPT4All

Fri, 12 May 2023 00:00:00 +0000

Have you ever dreamed of building AI-native applications that can leverage the power of large language models (LLMs) without relying on expensive cloud services or complex infrastructure? If so, you’re not alone. Many developers are looking for ways to create and deploy AI-powered solutions that are fast, flexible, and cost-effective, or just experiment locally. In this blog post, I’m going to show you how you can use three amazing tools and a language model like gpt4all to : LangChain, LocalAI, and Chroma.

LocalAI updates

Thu, 11 May 2023 00:00:00 +0000

LocalAI has been a massive hit! Thanks to everyone who has shown support by following us. Your contribution is helping to democratize AI!

If you’re not familiar with LocalAI, it’s a self-hostable, free, and open-source alternative to the OpenAI API. It simplifies the AI development process and makes it accessible to everyone. You can check it out on Github: https://github.com/go-skynet/LocalAI.

News

We have exciting news to share in the latest release (1.9.0). The GPT4All binding family models have been updated, as we are upstreaming our implementations (https://github.com/nomic-ai/gpt4all/pull/534), and now all models in https://gpt4all.io/index.html should work, including token stream back to the client, for additional glamourous effects :) . Additionally, that means added support for MosaicML MPT models (https://huggingface.co/mosaicml/mpt-7b) and I’ve been looking at adding experimental support for bloomz models with bloomz.cpp.

Whut?! Sabayon Community Repositories is here!

Mon, 18 Apr 2016 06:02:00 -0700

Maaaaaaaaaaaaany dependencies for enman… Still, he…

Tedel - Apr 1, 2016

Maaaaaaaaaaaaany dependencies for enman…
Still, here we go! :D

Whut?! Sabayon Community Repositories is here!

Mon, 18 Apr 2016 06:02:00 -0700

Hello users,

Time passed when i first wrote the article “[Part 1] Building Gentoo and Sabayon packages in your machine locally or remotely with Docker and Cloud Services” that was going to be divided into parts. But things changed amazingly fast and there is better news, I wrote up a suite of tools that makes the whole operation much easier, thanks also to +Ben Roberts (optiz0r) who contributed in the development and he is also kindly sponsoring the buildserver.

Updates: Rpi2 joins to testing boards, Mate testing repository, Sabayon devkit

Sun, 07 Feb 2016 10:22:00 -0800

Updates, TMiD (This Month in the Dev world)

Something landed here! Thanks to +Ben Roberts for the donation!

ARM

Marsala, the board that +Ben Roberts was so kind to donate has just landed here, and i’m very happy about it, because that means that i can test against the board again myself.

I’m glad also to announce that the ROS framework and some other goodies(among of them firefox and libreoffice) have been pushed into our ARM repo.

Tech Preview: Sabayon on RaspberryPi2

Mon, 11 Jan 2016 05:02:00 -0800

hi, this is a really good new are there chances o…

Unknown - Feb 6, 2016

hi, this is a really good new

are there chances of having sabayon on Raspberry PI (not PI2)?

Tech Preview: Sabayon on RaspberryPi2

Mon, 11 Jan 2016 05:02:00 -0800

As anticipated on Sabayon Linux site releases notes, that day was going to be close.
ARM meet Sabayon, Sabayon meet ARM.

The approach to the ARM(hfp) support will be different from the previous attempt, we are not going to support kernels for each different board we intend to build images, instead we will release cutted images with vendor-kernel to avoid incompatibilities and unexpected features. This is what almost every distribution does for tons of reasons, among them i want just to underline that in those years we have seen a lot of new ARM boards out of there and we can’t just support all of them, mantain a kernel branch for each one would results low QA (since our dev-team is small) and probably in hard decision to be made when support will be dropped from vendors (think also on how short is a board lifespan, and how projects dies quickly). In that way, we can still provide support also for legacy devices as well.

[Part 1] Building Gentoo and Sabayon packages in your machine locally or remotely with Docker and Cloud Services

Sun, 15 Nov 2015 07:09:00 -0800

With spawning a compilation, the second line (with…

fusion809 - Nov 4, 2015

With spawning a compilation, the second line (with the package you wish to merge) is it possible to point to a specific version of a package. For example, atm I’d like to merge app-editors/atom-1.2.0 from the Sabayon overlay, do I have to enter it as `app-editors/atom-1.2.0 –overlay sabayon` or `=app-editors/atom-1.2.0 –overlay sabayon`?

#### In section 3 I think you gave incorrect syntax, al... [fusion809](https://www.blogger.com/profile/14316408440182908236 "noreply@blogger.com") - Nov 4, 2015

In section 3 I think you gave incorrect syntax, although it may be because of formatting limitations imposed by blogger. I think the two lines:

[Part 1] Building Gentoo and Sabayon packages in your machine locally or remotely with Docker and Cloud Services

Sun, 15 Nov 2015 07:09:00 -0800

As previously anticipated in the previous blog post, here i explain what’s going on with Sabayon Docker images, and how can the Official Sabayon images help you in developing/deploying your application. In this article, i’ll show how to build Sabayon/Gentoo packages using Docker.

I’ll cover five cases and will be divided in differents articles:

You want to build packages locally
You want to remotely build packages
You want to host an overlay or a Sabayon repository and want your packages to get built on each push to the git repository
You want to track remote repository changes and test (useful if you can’t setup a webhook)
Setup an Entropy repo with a Docker image, and how to mantain packages

In future, i’ll write also a post also on how to track the packages remotely with CircleCi.

Sabayon: testers, testers, testers

Wed, 07 Oct 2015 14:28:00 -0700

I will give it a go installing new motherboard tod…

Unknown - Oct 4, 2015

I will give it a go installing new motherboard today will start testing after thate

#### Thanks for your efforts , please remember to file ... [Ettore](https://www.blogger.com/profile/03411449232588367668 "noreply@blogger.com") - Oct 4, 2015

Thanks for your efforts , please remember to file a bug for whatever problem you will face!

#### I have jut installed a new motherboard,it is a msi... [Unknown](https://www.blogger.com/profile/02509968321297586933 "noreply@blogger.com") - Oct 4, 2015

I have jut installed a new motherboard,it is a msi z97a the only problem so far is I cant install sabayon in uefi mode I am runing 15.10 on the other hard dive fedora 22 xfce installed in uefi mode no problem

Sabayon: testers, testers, testers

Wed, 07 Oct 2015 14:28:00 -0700

Sabayon, official call for testers (and well, developers are welcome too)

Testers, come to us

Probably most of you already have seen Ballmer in show-mode

Also if controversial, it was a quite funny commercial / raindance move, balls included. But i can say that he is wrong, testers are as important as developers.
Consider helping Sabayon in a different way: testing it.

I am here, begging YOU for some help. The more the merrier! What we need are brave folks proud to be bleeding edge, ready to install all the latest updates, capable observers that carries on using their machine normally BUT taking notes on functionality, installation problems, and any other weirdness or lack thereof.
Grab a freshly built image or enable our testing repositories, but more importantly:_ report back_ to our bugzilla or dropping by on our IRC channel (#sabayon on chat.freenode.net).

Sabayon 15.10 press release

Mon, 28 Sep 2015 11:07:00 -0700

Image: an ancient hen-foot print found on Mars (Mars Photo credit to NASA)

Sabayon 15.10 is a modern and easy to use Linux distribution based on Gentoo, following an extreme, yet reliable, rolling release model.

This is a monthly release generated, tested and published to mirrors by our build servers containing the latest and greatest collection of software available in the Entropy repositories.

The ChangeLog files related to this release are available on our mirrors.

Sabayon is moving to KDE Plasma 5.4

Sat, 12 Sep 2015 10:36:00 -0700

Sabayon is officially moving to Plasma 5, please read if you are a KDE Sabayon user.

KDM is going to be removed! migrate to SDDM now!

Yes, finally we are moving on.

While KDE 4 was a pretty stable DM, Plasma 5 brings awesomeness and, if you didn’t noticed, it’s the future.

From KDM to SDDM

We tried to do our best to make the transition as smooth as possible and automatic, but if your system just got broken here is why: the KDE team announced SDDM as the default KDE display manager.

Tech Preview: Sabayon Plasma 5 LiveCD

Wed, 02 Sep 2015 05:46:00 -0700

Thanks, Unfortunately running in VirtualBox 4.3.28…

Unknown - Sep 3, 2015

Thanks, Unfortunately running in VirtualBox 4.3.28, NetworkManager is crashing and can’t access desktop. :(

#### Thanks for your feedback, i run the image on Virtu... [Ettore](https://www.blogger.com/profile/03411449232588367668 "noreply@blogger.com") - Sep 4, 2015

Thanks for your feedback, i run the image on VirtualBox 4.3.28 as well without problems, can you try to change the Network Adaptor type under the image settings, Network-> Advanced -> Card type

Tech Preview: Sabayon Plasma 5 LiveCD

Wed, 02 Sep 2015 05:46:00 -0700

!! WARNING - HERE BE DRAGONS !!

Sabayon Plasma 5 LiveCD Tech preview is available for download

This release is just for testing only, it is just a preview of Plasma5 on Sabayon for those of you that

wants just to snoop on what’s going on without touching your system.

If you want to install Plasma 5 with the community repository, follow those instructions.

Known issues:

Dolphin Shortcut on favorites is not working
Desktop isn’t in folderview so you can’t quickly access to the install icon, but the installer is present (search for “Calamares” or “Installer” in the Plasma menu)
No Sabayon artwork is present, plasma is vanilla

Please, if you encounter other issues let us know, Thank you!

KDE Plasma 5.4, available on Plasma5 Sabayon community repository

Thu, 27 Aug 2015 05:03:00 -0700

I’m glad to announce that Plasma 5.4 is available on Sabayon Plasma5 community repository.

Plasma 5.4

The KDE team announced on 25 August the release of Plasma 5.4:

This release of Plasma brings many nice touches for our users such as much improved high DPI support, KRunner auto-completion and many new beautiful Breeze icons. It also lays the ground for the future with a tech preview of Wayland session available. We’re shipping a few new components such as an Audio Volume Plasma Widget, monitor calibration tool and the User Manager tool comes out beta. Look at the official press release here

on Calamares, Docker and Sabayon

Mon, 10 Aug 2015 04:29:00 -0700

Since i became Sabayon developer, i started to work on customizing it and giving some love to the entropy packages.
A lot as been done in those months, and you can see that picking up a “-dev” image from our mirrors.
After giving to the entropy packages a fullfill of love (systemd was bumped, ati-drivers and nvidia-drivers as well to be in line with upstream, implemented iptables saving rules for systemd, … ) then we decided that the time of Anaconda installer was finished.
Anaconda was buggy and most of the users couldn’t even install Sabayon also if, for now, we loose a lot of nice features like LUKS support and **LVM **we chose to swap it with the new and shiny Calamares .

Google at Home installation [#1 Howto]

Wed, 15 Oct 2014 03:04:00 -0700

The first post of a series that will guide you to install and configure your domotic environment with Google@Home (following updates)

Introduction

I’m starting in the blog a new series of posts illustrating the features of G@H as they are being developed, and how you can start to play with it.

This time we are going to see how to install it correctly, how to handle the basic configuration needed to start and we will install the Wikipedia plugin to allow to query wikipedia with our voice (you can lookup stuff on wikipedia just saying “wikipedia house”).

GitInsight, predicting your github contribs calendar

Sat, 09 Aug 2014 02:59:00 -0700

Predicting github contrib calendar with Perl and PDL

Premise : this is my first time using PDL

Lately i had the chance to put my hands on PDL, i was glad to discover that it’s awesome!

I come from a matlab/octave and Mathematica background, at first was a bit difficult to dig thru the PDL equivalents functions and i have to admit that PyMC has some fancy stuff that require a lot of code to implement in PDL and i wanted to borrow in that case.

Introducing Deeme

Sat, 21 Jun 2014 02:57:00 -0700

Introducing Deeme a database-agnostic driven event emitter base-class.

Deeme is a database-agnostic driven event emitter base-class. Deeme allows you to define binding subs on different points in multiple applications, and execute them later, in another worker with a switchable backend database. It is handy if you have to attach subs to events that are delayed in time and must be fixed. It is strongly inspired by (and a rework of) Mojo::EventEmitter.

G@H updates! (5)

Mon, 16 Jun 2014 02:55:00 -0700

That’s the current status of the project:

The GSoC student :

RPC server integration, fully pluggable with Mojolicious (better than the one was in the proposal, less dependencies since that framework will be used also for the UI)
RPC Parser service, that forward request to the Parser that handles the actions to be made (by voice)
Finished SQLite Schema with DBIx::Class, working on the SQLite Backend, Parser and deployer (using DBIx::Class::DeploymentHandler) facing some bugs encountered in his way

This is what i have done so far:

G@H updates! (4)

Wed, 04 Jun 2014 02:52:00 -0700

This post is an update of the current status of the Google@Home project. Google@Home tries to bring domotic control in your home using Google Services for Speech Synthesis and Text-to-Speech. It is also planned a web interface to control the embedded nodes in the current environment. In this post i’ll report also the work by the GSoC student so far

During this period i haven’t much time to code, due to my knee surgery, but that’s the current status of the project:

love for pushbullet

Thu, 22 May 2014 02:49:00 -0700

Well, if you don’t know what pushbullet is, it’s a free-less-complicated version of what pusher.com does, unifying push’s across all the devices. In this article i’ll show how to implement pushbullet api in perl, in few lines of code.

Pushbullet enables to notify instantly to all your devices a message, a link, a file, an address or even a list of todo’s (and probably more) : that can be quite handy if you don’t want to setup an entire notification system, want to avoid the hassle of email alerts (that’s not a critique, but i hate having my mailbox full of short report status messages ) or if you want that all your clients are notified immediately. I personally needed it to notify myself from simple status report by automatic programs.

Multiple issues in libXfont

Thu, 15 May 2014 02:49:00 -0700

_
These months are full of bugs to put hands on, there are multiple vulnerabilities (3) found in libXfont that trusts the font server protocol data, and not verifying that the values will not overflow or cause other damage._

From the Alan Coopersmith announce:

Ilja van Sprundel, a security researcher with IOActive, has discovered several issues in the way the libXfont library handles the responses it receives from xfs servers, and has worked with X.Org’s security team to analyze, confirm, and fix these issues.

CVE-2014-0196: Linux kernel pty layer race

Thu, 15 May 2014 02:38:00 -0700

Two days ago a temible exploit was released for local privilage escalation in the linux kernel. The bug was found on the 29th of April: memory corruption via a race in pty write handling , affected kernels are 2.6.31 -> 3.14rcX

The n_tty_write function in drivers/tty/n_tty.c in the Linux kernel through 3.14.3 does not properly manage tty driver access in the “LECHO & !OPOST” case, which allows local users to cause a denial of service (memory corruption and system crash) or gain privileges by triggering a race condition involving read and write operations with long strings.

G@H updates! (3)

Sun, 11 May 2014 02:36:00 -0700

During this period i focused on fixing bugs, microphone settings and some structural restyling

This is a small summary of the changes ( for a complete list, check commit diffs in github page) :

About

Wed, 09 Apr 2014 00:00:00 +0000

About me

Hey! Thanks for stepping by!

I’m Ettore and I’m a long-time Open Source hacker and hacktivist. I’ve been involved in the Open Source community for more than 16 years. I’ve studied CS at University, and pursued my degree at full votes with a MS in Computer Science.

I formerly was a Gentoo developer, I did lead Sabayon Linux and contributed to several FOSS projects among openSUSE, Cloud Foundry, openQA, and more that I can’t remember.

G@H updates! (2)

Fri, 04 Apr 2014 02:30:00 -0700

During this week i focused on fixing bug and few structural enhancements

This is a small summary of the changes:

[fix] Plugin can be removed safetly
master now can load node configurations by their backends (e.g. Mongo)
a dump of an example of mongo db
added the model for the node
fixed #1
tuned up SoX
started the prototyping of the listening agent that directly commands GPIO

If you wish to install and try you can just still follow the quick start on the repository page.

Google at Home updates

Sat, 29 Mar 2014 02:15:00 -0700

_
This post is an update of the current status of the Google@Home project. Google@Home tries to bring domotic control in your home using Google Services for Speech Synthesis and Text-to-Speech. It is also planned a web interface to control the embedded nodes in the current environment.
_

For now it’s still required to manually set-up the YAML file to configure which nodes belongs to the network, but if you set up some RaspberryPi on the network and a master node that has installed MongoDB the dispatchment of the commands and of the voice (so you can command everything by issuing commands on one node) works for now.

Welcome!

Sun, 02 Mar 2014 01:40:00 -0800

This is my blog, ~~it’s powered~~ it was powered with Perl and Mojolicious. Enjoy! You will find here some interesting perl posts and updates for the projects where i am involved.

Unfortunately i had to move to blogger, due to time issues. Enjoy!