Practical overview
When it fits
Use Reef when an agent needs a structured loop from serving and feedback through learning, evaluation and delivery, especially when improvement may target model weights or the agent harness.
Who it is for
- Developers building self-improving AI agents
- Teams running self-hosted agent inference and learning infrastructure
- Researchers working on continual learning, model training or reinforcement learning
Documented uses
- Serve agent requests and record interactions
- Match feedback with recorded agent interactions
- Generate and evaluate model or harness updates
- Publish accepted updates through versioned artifacts
- Run inference and training workflows for continual improvement
Requirements & limits
The repository is public and licensed under Apache-2.0. Installation is documented through uv from PyPI or from source. Linux, CLI and self-hosted use are identified platforms; artifact and checkpoint functionality requires git-lfs.
- Choose weight training when you have a trainable model, supported GPU stack and usable feedback.
- Choose harness optimization when you have a model endpoint, representative tasks and an evaluator, without local training GPUs.
- Choose test-time training when you can provide an execution environment, correctness checker and measurable objective.
- The learning recipe determines whether a deployment updates model weights or agent harnesses.
- Reef adds version management and artifact delivery alongside inference and training capabilities.
Check current requirements in the official documentation. Source-based guidance does not mean OpenViST has run or independently tested this project.
Install Reef from PyPI
Create a Python environment and install the Reef package.
Before you start
- Linux, CLI and self-hosted environment
- uv
- Python 3.12 or newer
Steps
Create and activate a virtual environment with uv.
Install the reef-infra package with uv.
Import reef with Python and print its version.
Expected outcome
A local Python environment contains the Reef package and can import it.
Guide limitations
- Artifact and checkpoint functionality requires the git-lfs system package.
- This setup procedure does not document a complete learning deployment.
Sources & review
Source record details
- Source availability
- Active
- Sources checked
- 2 October 2026
- Original website title
- Human-Agent-Society/reef · Official homepage title · retained in its source language

