Model Inference Tools

llama2.c

AI Model Inference

Inference Llama 2 in one file of pure C.

Kubeflow

MLOps

The open-source Kubernetes-native platform for scalable MLOps and workflow orchestration.

dstack

Infrastructure

Open-source GPU-native orchestration for AI teams.