AI · Agents · Blockchain · Crypto

Submit a project Sign in

Menu

Directory category

AI Infrastructure & Serving

Explore infrastructure for serving models, managing inference and deploying AI workloads. Compare official resources, requirements and limitations.

196 projects

Directory results

AI Infrastructure & Serving projects

D Deepspeed Deepspeed is an open-source Python deep-learning optimization library for making distributed model training and inference more efficient across hardware.

R Ray Ray is an open-source Python framework and distributed runtime for scaling artificial-intelligence and machine-learning workloads.

O Ods Ods is a Python-based, self-hosted deployment project that assembles local AI services on a PC, Mac or Linux system.

T Turbovec Turbovec is an open-source Rust vector-index library with Python bindings. It applies TurboQuant to embedding storage and nearest-neighbor search, with online ingestion and SIMD kernels for ARM and x86 processors.

O Open Platform for AI (OpenPAI) OpenPAI is an open-source, self-hosted infrastructure platform for AI resource scheduling and compute-cluster management.

S Spice An open-source, self-hosted Rust service that combines data federation, accelerated SQL, search, and LLM inference for data-grounded applications and agents.

P Polyaxon An open-source AI infrastructure and orchestration project presented as an AI control plane for machine-learning and deep-learning workloads.

L Litserve Litserve is a Python framework for building custom AI inference servers with control over inference logic, batching, routing, streaming and orchestration.