OpenViSTAI · Agents · Blockchain · Crypto
Menu
AI Infrastructure & Serving

Lemonade

Lemonade is open-source software for running optimized language and multimodal AI models locally on GPU and NPU hardware. Its server exposes APIs for connected applications, while an embeddable binary lets developers package local inference into their own applications.

Independent OpenViST project profile, based on linked sources.

Lemonade — OpenViST project profile in AI Infrastructure & Serving.
OpenViST project illustration. See the linked sources for product details.
Understand the project

Practical overview

When it fits

Use Lemonade when the task is to run models on local GPU or NPU hardware and make them available to an app, or to bundle local inference into an application.

Who it is for

  • People who want to connect an application to locally served AI models.
  • Developers adding local multimodal inference to an application.

Documented uses

  • Serve local models to applications using OpenAI, Anthropic or Ollama APIs.
  • Browse and download models through the Model Manager.
  • Try models through built-in interfaces for chat, image generation and speech generation.
  • Package local AI capabilities into an application using the embeddable binary.
Before you choose

Requirements & limits

The repository provides installation documentation for Windows, Linux, macOS, Docker and source, and lists Apache-2.0 as the license.

  • Choose the server for a separately installed service accessed by compatible apps; choose the embeddable binary to package inference with an application.
  • The server advertises OpenAI, Anthropic and Ollama API compatibility.
  • The project describes local GPU and NPU inference; consult the installation documentation for platform-specific requirements.

Check current requirements in the official documentation. Source-based guidance does not mean OpenViST has run or independently tested this project.

Source-based practical guide

Prepare an Embeddable Lemonade folder for an application

Customize the portable Lemonade artifact and place the configured folder in an application installer.

Before you start

  • A Lemonade Embeddable release archive for a listed platform, or a build made from source.
  • The archive includes the Lemonade service executable, CLI, and resource files.

Steps

  1. Obtain the Embeddable Lemonade archive from the releases for your platform and unpack it.

  2. Use the included lemonade CLI to set configuration values, or edit config.json manually; lemond’s positional directory argument determines where configuration and runtime files are stored.

  3. Optionally pre-download backends with lemonade backends install, and customize resources/server_models.json and resources/backend_versions.json.

  4. When configuration is complete, optionally remove the CLI and defaults.json, then place the configured Lemonade folder in your application installer.

Expected outcome

A portable, configured Lemonade folder is ready to be included in an application installer.

Guide limitations

  • The guide describes packaging preparation, not how to launch or integrate the service into an application.
  • Release archives are listed for Windows x64, Ubuntu x86_64 and ARM64, and macOS ARM64; other Linux distributions require building from source.
  • Removing the CLI means it will not be available in the shipped application.
Evidence and transparency

Sources & review

Source record details
Source availability
Active
Sources checked
7 October 2026
Original website title
lemonade-sdk/lemonade · Official homepage title · retained in its source language