AI · Agents · Blockchain · Crypto

Submit a project Sign in

Menu

Directory category

AI Infrastructure & Serving

Explore infrastructure for serving models, managing inference and deploying AI workloads. Compare official resources, requirements and limitations.

196 projects

Directory results

AI Infrastructure & Serving projects

kserve.github.io KServe is open-source Kubernetes infrastructure for deploying and serving generative AI and predictive machine-learning models.

Open AI Accelerator Exchange Open AI Accelerator Exchange (OAAX) is an open standard for converting ONNX models into accelerator-specific formats and running them through a unified runtime interface.

A Axonhub AxonHub is an open-source, Go-based AI gateway that routes requests from AI SDKs to multiple LLM providers, with failover, load balancing, cost management and request tracing.

P Paddler Paddler is an open-source LLM and VLM inference serving platform and load balancer for self-managed infrastructure.

E Ezlocalai Ezlocalai is a Python-based local AI server that downloads and configures models for a computer and exposes them through OpenAI-style endpoints.

C Composer Composer is an open-source Python deep-learning training framework built on PyTorch.

Runpod Runpod is a cloud infrastructure service that provides GPU compute for AI training, fine-tuning, inference and batch workloads. Its offerings include dedicated GPU instances, serverless GPU endpoints and multi-node clusters.

Baseten Baseten is cloud infrastructure for deploying and serving open-source, custom and fine-tuned AI models, with inference scaling and performance optimization for production use.