OpenViSTAI · Agents · Blockchain · Crypto
Submit a project
Menu
Local & Self-hosted AI

LLAMA2 Webui

LLAMA2 Webui is a self-hosted Gradio application for running Llama 2 and Code Llama models locally on CPU or GPU, with chat, code-completion and OpenAI-compatible API options.

Explore the practical guide ↓

Independent OpenViST project profile, based on linked sources.

LLAMA2 Webui — OpenViST project profile in Local & Self-hosted AI.
OpenViST project illustration. See the linked sources for product details.
Understand the project

Practical overview

When it fits

Use it when you want a self-hosted interface or local backend for supported Llama 2 and Code Llama models, and can select and configure the model, backend and hardware for your setup.

Who it is for

  • People who want to run supported Llama-family models locally through a web interface.
  • Developers building applications or generative-agent projects that can use a local Llama 2 backend.
  • Users exploring Code Llama for code completion, filling or instruction-based chat.

Documented uses

  • Run a supported Llama 2 chat model locally through a browser interface.
  • Configure model paths and inference backends for different supported Llama 2 models.
  • Use Code Llama for code completion and filling.
  • Provide an OpenAI-compatible API backed by a Llama 2 model.
  • Connect an application to a local model using llama2-wrapper.
Before you choose

Requirements & limits

The repository specifies an MIT license. Installation instructions cover Linux, Windows and macOS, with inference described for CPU or GPU.

  • Supported model formats include GPTQ, GGML and GGUF, with 8-bit and 4-bit modes described.
  • Available backends include llama.cpp, Transformers, bitsandbytes and AutoGPTQ.
  • The default configuration uses llama.cpp and a quantized 7B chat model.
  • The README flags bitsandbytes installation considerations for older NVIDIA GPUs and Windows.
  • Base Code Llama and Code Llama-Python are described as continuation-focused rather than instruction-following; Code Llama Instruct is the documented chatbot-style option.

Check current requirements in the official documentation. Source-based guidance does not mean OpenViST has run or independently tested this project.

Source-based practical guide

Install LLAMA2 Webui from source

Install the project and its listed Python requirements as the documented setup stage.

Before you start

  • Git
  • Python package installer pip

Steps

  1. Clone the repository with the command below.

    Documented command
    git clone https://github.com/liltom-eth/llama2-webui.git

  2. Change into the llama2-webui directory.

  3. Install dependencies with the command below.

    Documented command
    pip install -r requirements.txt

Expected outcome

The repository and its listed requirements are installed; the README documents running the chat interface as a subsequent usage stage.

Guide limitations

  • This guide covers installation only, not a successful launch.
  • The README documents separate bitsandbytes installation considerations for older NVIDIA GPUs and Windows.
Documentation 1 ↗
COMPARE OPTIONS

Compare options for Model inference and serving

These projects document a common task and share a project role. This is a source-based comparison, not an execution benchmark or a guarantee of interchangeability.

ProjectDocumented purposePlatformAccess and requirements
LLAMA2 WebuiRun a supported Llama 2 chat model locally through a browser interface.Linux, macOS, Self-hosted, WebThe repository specifies an MIT license. Installation instructions cover Linux, Windows and macOS, with inference described for CPU or GPU.
Bodhi AppDiscover and download GGUF models from Hugging Face that suit local hardware.Linux, macOS, Self-hosted, WindowsThe README documents a Mac desktop release and Docker images for CPU, CUDA, ROCm and Vulkan configurations. The project identifies itself as open source.
OfflinellmImport a GGUF model and use it for local multi-turn chat.AndroidThe documented release is an APK available from GitHub Releases. It requires Android 13 or later and arm64-v8a; the Vanilla APK requires users to supply and import their own GGUF model.
Evidence and transparency

Sources & review

Official repository ↗
Source record details
Source availability
Active
Sources checked
14 October 2026
Original website title
liltom-eth/llama2-webui · Official homepage title · retained in its source language
How we review sourcesSuggest a correction