AI · Agents · Blockchain · Crypto

Submit a project Sign in

Menu

Directory category

AI Infrastructure & Serving

Explore infrastructure for serving models, managing inference and deploying AI workloads. Compare official resources, requirements and limitations.

196 projects

Directory results

AI Infrastructure & Serving projects

K Kserve KServe is an open-source Kubernetes platform for deploying and serving generative and predictive AI models across multiple frameworks.

P Project Chronos Project Chronos is an experimental, open-source Python stack for storage-aware mixture-of-experts inference and training.

S Sageattention SageAttention is an open-source CUDA library of quantized attention implementations designed to accelerate GPU inference for language, image and video models.

L Lemonade Lemonade is open-source software for running optimized language and multimodal AI models locally on GPU and NPU hardware.

Fireworks Fireworks is a cloud AI infrastructure service with APIs for model inference, embedding generation, training and fine-tuning, plus serverless and dedicated compute offerings.

B Bifrost AI Gateway Bifrost is a self-hosted Go-based AI gateway that routes application requests to AI and language-model providers through a common OpenAI-compatible API.

P Powerinfer Powerinfer is a public, MIT-licensed C++ engine for running and serving large language models locally.

K Kubetorch Kubetorch is an open-source Python client and Kubernetes deployment stack for running machine-learning workloads on remote cluster compute.