#MeWriting I’m happy to announce the immediate availability of Mmojo Server for Debian, Ubuntu, and Raspberry Pi 5. Mmojo Server is a Large Language Model (LLM) server that runs on your PC or laptop. It supports the industry standard OpenAI API, so you can connect AI applications to it. It works with an NVIDIA GPU if you have one available on your computer. It also works with your computer’s CPU, albeit a bit slower.
Debian support is intended for stand-alone installations on a PC or virtual machine running Debian Linux or Ubuntu Linux, or on a Raspberry Pi 5. x86_64 and aarch64 (arm64) are offered for download. The linked instructions walk you through setting up Linux, downloading some models, downloading and installing the Mmojo Server software, and making it all run.
Install Mmojo Server for Debian / Ubunutu / Raspberry Pi — Instructions
The Mmojo Server software incorporates the popular llama.cpp LLM server software, and is fully open source to ensure that your data exchanged with Mmojo Server remains private. If you don’t trust me telling you that, you are welcome to inspect and build the source code! Mmojo Server is compatible with many .gguf models you can find on Hugging Face and other web sites.
Installing Mmojo Server is a fun do-it-yourself adventure! I’ve asked non-technical people to test my instructions with good results. Casual and occasional developers should have no problems.
Your PC or virtual machine should have a recent high-end x86_64 or aarch64 (arm64) CPU, with at least 16 GB RAM and 100 GB available storage space. An NVIDIA GPU with 8GB or more of VRAM will make Mmojo Server faster. You can build a custom Mmojo Server with support for Vulkan if your computer has GPUs supported by Vulkan.
If you need assistance via Zoom call and screen sharing, I offer a one-hour hands-on session, for (US) $100. It can be scheduled during extended west coast business hours. You will be working with me, the guy who made this thing work. Email me if interested.
-Brad
—
Brad Hutchings
brad@BradHutchings.com