open-compass/MixtralKit
A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI
Language: Python
#llm #mistral #moe
Stars: 251 Issues: 6 Forks: 21
https://github.com/open-compass/MixtralKit

Writesonic/GPTRouter
Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.
Language: TypeScript
#anthropic #azure_openai #cohere #google_gemini #langchain #llama_index #llm #llmops #llms #mlops #openai #palm_api
Stars: 130 Issues: 6 Forks: 16
https://github.com/Writesonic/GPTRouter

AlexandreSajus/JARVIS
Your own personal voice assistant: Voice to Text to LLM to Speech, displayed in a web interface
Language: Python
#deepgram #elevenlabs #llm #openai #python #taipy #tts #voice_assistant
Stars: 143 Issues: 1 Forks: 5
https://github.com/AlexandreSajus/JARVIS

SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Language: C
#falcon #large_language_models #llama #llm #llm_inference #local_inference
Stars: 792 Issues: 8 Forks: 32
https://github.com/SJTU-IPADS/PowerInfer

hpcaitech/SwiftInfer
Efficient AI Inference & Serving
Language: Python
#artificial_intelligence #deep_learning #gpt #inference #llama #llama2 #llm_inference #llm_serving
Stars: 299 Issues: 3 Forks: 14
https://github.com/hpcaitech/SwiftInfer

leptonai/search_with_lepton
Building a quick conversation-based search demo with Lepton AI.
Language: TypeScript
#ai #ai_applications #leptonai #llm
Stars: 458 Issues: 0 Forks: 49
https://github.com/leptonai/search_with_lepton

databricks/dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
Language: Python
#databricks #gen_ai #generative_ai #llm #llm_inference #llm_training #mosaic_ai
Stars: 1113 Issues: 7 Forks: 86
https://github.com/databricks/dbrx

jina-ai/reader
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Language: TypeScript
#llm #proxy
Stars: 256 Issues: 2 Forks: 13
https://github.com/jina-ai/reader

mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown
Language: TypeScript
#ai #crawler #data #html_to_markdown #llm #markdown #rag #scraper #scraping #web_crawler
Stars: 469 Issues: 8 Forks: 34
https://github.com/mendableai/firecrawl

mishushakov/llm-scraper
Turn any webpage into structured data using LLMs
Language: TypeScript
#ai #browser #browser_automation #gpt #langchain #llama #llm #openai #playwright #puppeteer #scraper
Stars: 332 Issues: 6 Forks: 23
https://github.com/mishushakov/llm-scraper