vllm-project/semantic-router
Intelligent Mixture-of-Models Router for Efficient LLM Inference
Language: Python
#bert_classification #golang #huggingface_candle #huggingface_transformers #mixture_of_models #pii_detection #prompt_guard #python #rust #semantic_router #vllm
Stars: 238 Issues: 1 Forks: 19
https://github.com/vllm-project/semantic-router
Intelligent Mixture-of-Models Router for Efficient LLM Inference
Language: Python
#bert_classification #golang #huggingface_candle #huggingface_transformers #mixture_of_models #pii_detection #prompt_guard #python #rust #semantic_router #vllm
Stars: 238 Issues: 1 Forks: 19
https://github.com/vllm-project/semantic-router
GitHub
GitHub - vllm-project/semantic-router: Intelligent Router for Mixture-of-Models
Intelligent Router for Mixture-of-Models. Contribute to vllm-project/semantic-router development by creating an account on GitHub.