vllm-project/semantic-router
Intelligent Mixture-of-Models Router for Efficient LLM Inference
Language: Python
#bert_classification #golang #huggingface_candle #huggingface_transformers #mixture_of_models #pii_detection #prompt_guard #python #rust #semantic_router #vllm
Stars: 238 Issues: 1 Forks: 19
https://github.com/vllm-project/semantic-router
Intelligent Mixture-of-Models Router for Efficient LLM Inference
Language: Python
#bert_classification #golang #huggingface_candle #huggingface_transformers #mixture_of_models #pii_detection #prompt_guard #python #rust #semantic_router #vllm
Stars: 238 Issues: 1 Forks: 19
https://github.com/vllm-project/semantic-router
GitHub
GitHub - vllm-project/semantic-router: Intelligent Mixture-of-Models Router for Efficient LLM Inference
Intelligent Mixture-of-Models Router for Efficient LLM Inference - vllm-project/semantic-router