Pinned Loading

1. SemiAnalysisAI/InferenceX SemiAnalysisAI/InferenceX Public

   Open Source Continuous Inference Benchmark Research Platform — Kimi K2.7-Code, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究…

   Python 1.3k 237

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 30.7k 7.4k

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 87.1k 19.9k

4. NVIDIA/srt-slurm NVIDIA/srt-slurm Public

   NVIDIA Inference Benchmarks provide recipes in ready-to-use templates for evaluating platform speed. Validate your platform across specific AI use cases across hardware and software combinations.

   Python 40 69

5. ovn-kubernetes/ovn-kubernetes ovn-kubernetes/ovn-kubernetes Public

   A robust Kubernetes networking platform

   Go 1k 467

6. ovn-kubernetes/kubernetes-traffic-flow-tests ovn-kubernetes/kubernetes-traffic-flow-tests Public

   Exercise and validate network traffic paths on a k8s cluster that uses OVN-Kubernetes. For example pod-to-pod, host, multi-network, and related scenarios.

   Python 6 18