AI · Agents · Blockchain · Crypto

Submit a project Sign in

Menu

Directory category

Local & Self-hosted AI

Find AI projects that support local or self-hosted deployment. Compare official resources, requirements and limitations.

41 projects

Directory results

Local & Self-hosted AI projects

T Tinyllm Tinyllm is an open-source project for setting up a locally hosted large language model with a ChatGPT-like web interface.

A Apfel Apfel is a Swift command-line tool for accessing Apple Intelligence on-device on Apple Silicon Macs, with an interactive chat interface and an OpenAI-compatible local server.

T TurboFieldfare TurboFieldfare is an open-source Swift and Metal runtime for running Gemma 4 26B-A4B locally on Apple Silicon Macs.

G Geniex GenieX is an on-device inference runtime for running large language and vision-language models on Qualcomm Snapdragon devices through available NPU, GPU or CPU hardware.

L Llmfit Llmfit is an open-source Rust tool that profiles a computer’s CPU, memory, GPUs, VRAM and accelerators to recommend open-source LLMs and quantizations likely to fit, then supports local model serving, throughput measurement and result sharing.

U Unsloth Unsloth is an Apache-2.0-licensed Python project that provides a desktop application, web UI and code-based tooling for running, fine-tuning, exporting and serving AI models locally.

S Self Hosted AI Starter Kit Self Hosted AI Starter Kit is an open-source Docker Compose template that combines self-hosted n8n with Ollama, Qdrant and PostgreSQL to initialize a local AI and low-code workflow development environment.

S Sidekick A native macOS desktop application for chatting with local language models and using local files, folders and websites as context. It combines a built-in llama.cpp backend for modern GGUF models with support for OpenAI-compatible APIs.