Chen-zexi/vllm-cli
A command-line interface tool for serving LLM using vLLM.
Language: Python
#llm #llm_tools #vllm
Stars: 243 Issues: 1 Forks: 5
https://github.com/Chen-zexi/vllm-cli
A command-line interface tool for serving LLM using vLLM.
Language: Python
#llm #llm_tools #vllm
Stars: 243 Issues: 1 Forks: 5
https://github.com/Chen-zexi/vllm-cli
GitHub
GitHub - Chen-zexi/vllm-cli: A command-line interface tool for serving LLM using vLLM.
A command-line interface tool for serving LLM using vLLM. - Chen-zexi/vllm-cli
vllm-project/semantic-router
Intelligent Mixture-of-Models Router for Efficient LLM Inference
Language: Python
#bert_classification #golang #huggingface_candle #huggingface_transformers #mixture_of_models #pii_detection #prompt_guard #python #rust #semantic_router #vllm
Stars: 238 Issues: 1 Forks: 19
https://github.com/vllm-project/semantic-router
Intelligent Mixture-of-Models Router for Efficient LLM Inference
Language: Python
#bert_classification #golang #huggingface_candle #huggingface_transformers #mixture_of_models #pii_detection #prompt_guard #python #rust #semantic_router #vllm
Stars: 238 Issues: 1 Forks: 19
https://github.com/vllm-project/semantic-router
GitHub
GitHub - vllm-project/semantic-router: Intelligent Mixture-of-Models Router for Efficient LLM Inference
Intelligent Mixture-of-Models Router for Efficient LLM Inference - vllm-project/semantic-router