OpenViSTAI · Agents · Blockchain · Crypto
Submit a project
Menu
AI APIs & Platforms

Nllb Serve

Nllb Serve is a Python project that runs Meta’s No Language Left Behind translation models behind a web interface and REST API, with a separate command-line tool for batch translation.

Explore the practical guide ↓

Independent OpenViST project profile, based on linked sources.

Nllb Serve — OpenViST project profile in AI APIs & Platforms.
OpenViST project illustration. See the linked sources for product details.
Understand the project

Practical overview

When it fits

Use Nllb Serve when you want to run an NLLB translation model as a local or server-hosted web service, expose translation through REST, or handle larger files with its batch CLI.

Who it is for

  • Developers who want to connect text translation to an application through a REST endpoint.
  • People who need a web interface for translating text with an NLLB model.
  • Teams processing translation files in batches through a command-line workflow.

Documented uses

  • Translate a string or list of strings through a REST request.
  • Use a browser-based interface to access a served NLLB model.
  • Process larger translation datasets with the `nllb-batch` command-line tool.
Before you choose

Requirements & limits

  • The README describes translation across 200 languages and requires source and target language identifiers in requests.
  • The REST endpoint supports GET and POST; its input may be a single string or a list.
  • The batch CLI is described as optimized for larger files, while the REST API is aimed at individual translations.
  • The default REST source-length limit is 250; the batch tool’s default maximum is 512 characters.
  • The repository code is stated to use Apache License 2.0, while model weights follow the selected model’s license.

Check current requirements in the official documentation. Source-based guidance does not mean OpenViST has run or independently tested this project.

Source-based practical guide

Install Nllb Serve and start its local service

Install the project from GitHub and launch the web interface and REST service using the documented default entry point.

Before you start

  • Python environment with pip.
  • Access to the Nllb Serve GitHub repository.

Steps

  1. Run the command below.

    Documented command
    pip install git+https://github.com/thammegowda/nllb-serve

  2. Start the service with nllb-serve or the command below.

    Documented command
    python -m nllb_serve

  3. Use the documented default address, http://localhost:6060.

Expected outcome

The NLLB service starts on localhost:6060 by default, providing the web interface and REST API.

Guide limitations

  • CUDA and PyTorch version mismatches may affect GPU use; the README recommends matching their CUDA versions as closely as possible.
  • Code and model weights have different licenses; the selected model’s terms apply to its weights.
Documentation 1 ↗
Source-based practical guide

Send a translation request to the REST endpoint

Submit text and source and target language identifiers to the running `/translate` endpoint.

Before you start

  • A running Nllb Serve instance.
  • Source text and NLLB language identifiers for the source and target languages.

Steps

  1. Address the /translate endpoint on the service host and port.

  2. Provide source, src_lang and tgt_lang as query parameters, URL-encoded form fields or a JSON POST body.

  3. For multiple texts, provide source as a list in JSON or send repeated source values using the documented request format.

Expected outcome

The request is submitted to the service for translation; the endpoint supports a single string or a batch of strings.

Guide limitations

  • The default maximum source length is 250, and longer sequences are truncated.
  • The service requires language identifiers, for example eng_Latn and fra_Latn.
Documentation 1 ↗
Evidence and transparency

Sources & review

Official repository ↗
Source record details
Source availability
Active
Sources checked
18 October 2026
Original website title
thammegowda/nllb-serve · Official homepage title · retained in its source language
How we review sourcesSuggest a correction