doing something
709 subscribers
906 photos
36 videos
36 files
1.94K links
@smlkw doing something, just my notes to keep updates
Download Telegram
Forwarded from Yehor learning Rust
✅
https://crates.io/crates/skimtoken

> A lightweight, fast token count estimation library written in Rust with Python bindings.

#rust #llm
Alex
https://www.cerebras.ai/blog/introducing-cerebras-code
Other coding models:

- CodeGemma
- Codestral
- Code LLaMA (there variants: Python, instruct, base)

- StarCoder

- DeepSeek Coder

- Mellum (Python, Kotline, Base)

- GLM 4.5
- CodeGeeX
https://github.com/EricLBuehler/mistral.rs

Wanna try it to do local inference with Gemma models

Build with:


MISTRALRS_METAL_PRECOMPILE=0 cargo build --release --features "metal accelerate"


#rust
Hugging Face has a page with available providers and model list they serve

https://huggingface.co/inference/models

It shows the speed in tokens/s so you can choose one for faster inference