Michael-A-Kuykendall/shimmy
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
Language:Rust
Total stars: 847
Stars trend:
14 Sep 2025
11pm ▏ +1
15 Sep 2025
12am ▏ +1
1am ▍ +3
2am ▎ +2
3am ▌ +4
4am ██▉ +23
5am ███▋ +29
6am ██▊ +22
7am █▏ +9
8am ██ +16
9am █▏ +9
10am ▊ +6
#rust
#apiserver, #commandlinetool, #developertools, #gguf, #huggingface, #huggingfacemodels, #huggingfacetransformers, #inferenceserver, #llama, #llamacpp, #llminference, #localai, #lora, #machinelearning, #ollamaapi, #openaicompatible, #rust, #rustcrate, #transformers