Popular repositories Loading

1. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

2. vllm-v100 vllm-v100 Public

   Forked from 1CatAI/1Cat-vLLM

   Continuation of the 1Cat-vLLM serving stack (based on v1.3.0). Goal: keep Tesla V100 a productive inference platform for current LLM workloads, developed independently of the original project's con…

   Python

3. strix-halo-vllm-cluster strix-halo-vllm-cluster Public

   Python

4. lucebox-halo-cluster lucebox-halo-cluster Public

   Forked from Luce-Org/lucebox

   LLM speculative inference server for heterogeneous hardware & consumer GPUs

   C++