Popular repositories Loading

1. stary stary Public

   Software Task Agentic Resolution sYstem

   Python

2. vllm-gaudi vllm-gaudi Public

   Forked from vllm-project/vllm-gaudi

   Community maintained hardware plugin for vLLM on Intel Gaudi

   Python

3. neural-compressor neural-compressor Public

   Forked from intel/neural-compressor

   SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. lm-evaluation-harness lm-evaluation-harness Public

   Forked from EleutherAI/lm-evaluation-harness

   A framework for few-shot evaluation of language models.

   Python

6. ray ray Public

   Forked from ray-project/ray

   Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

   Python