unslothai/unsloth
5X faster 50% less memory LLM finetuning
Language: Python
#ai #finetuning #llm
Stars: 729 Issues: 8 Forks: 19
https://github.com/unslothai/unsloth
5X faster 50% less memory LLM finetuning
Language: Python
#ai #finetuning #llm
Stars: 729 Issues: 8 Forks: 19
https://github.com/unslothai/unsloth
GitHub
GitHub - unslothai/unsloth: Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory - unslothai/unsloth
SqueezeAILab/LLMCompiler
LLMCompiler: An LLM Compiler for Parallel Function Calling
Language: Python
#efficient_inference #function_calling #large_language_models #llama #llama2 #llm #llm_agent #llm_agents #llm_framework #llms #natural_language_processing #nlp #parallel_function_call #transformer
Stars: 216 Issues: 0 Forks: 11
https://github.com/SqueezeAILab/LLMCompiler
LLMCompiler: An LLM Compiler for Parallel Function Calling
Language: Python
#efficient_inference #function_calling #large_language_models #llama #llama2 #llm #llm_agent #llm_agents #llm_framework #llms #natural_language_processing #nlp #parallel_function_call #transformer
Stars: 216 Issues: 0 Forks: 11
https://github.com/SqueezeAILab/LLMCompiler
GitHub
GitHub - SqueezeAILab/LLMCompiler: [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling - SqueezeAILab/LLMCompiler
open-compass/MixtralKit
A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI
Language: Python
#llm #mistral #moe
Stars: 251 Issues: 6 Forks: 21
https://github.com/open-compass/MixtralKit
A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI
Language: Python
#llm #mistral #moe
Stars: 251 Issues: 6 Forks: 21
https://github.com/open-compass/MixtralKit
GitHub
GitHub - open-compass/MixtralKit: A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI
A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI - open-compass/MixtralKit
Writesonic/GPTRouter
Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.
Language: TypeScript
#anthropic #azure_openai #cohere #google_gemini #langchain #llama_index #llm #llmops #llms #mlops #openai #palm_api
Stars: 130 Issues: 6 Forks: 16
https://github.com/Writesonic/GPTRouter
Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.
Language: TypeScript
#anthropic #azure_openai #cohere #google_gemini #langchain #llama_index #llm #llmops #llms #mlops #openai #palm_api
Stars: 130 Issues: 6 Forks: 16
https://github.com/Writesonic/GPTRouter
GitHub
GitHub - Writesonic/GPTRouter: Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed…
Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability. - Writesonic/GPTRouter
AlexandreSajus/JARVIS
Your own personal voice assistant: Voice to Text to LLM to Speech, displayed in a web interface
Language: Python
#deepgram #elevenlabs #llm #openai #python #taipy #tts #voice_assistant
Stars: 143 Issues: 1 Forks: 5
https://github.com/AlexandreSajus/JARVIS
Your own personal voice assistant: Voice to Text to LLM to Speech, displayed in a web interface
Language: Python
#deepgram #elevenlabs #llm #openai #python #taipy #tts #voice_assistant
Stars: 143 Issues: 1 Forks: 5
https://github.com/AlexandreSajus/JARVIS
GitHub
GitHub - AlexandreSajus/JARVIS: Your own personal voice assistant: Voice to Text to LLM to Speech, displayed in a web interface
Your own personal voice assistant: Voice to Text to LLM to Speech, displayed in a web interface - AlexandreSajus/JARVIS
SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Language: C
#falcon #large_language_models #llama #llm #llm_inference #local_inference
Stars: 792 Issues: 8 Forks: 32
https://github.com/SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Language: C
#falcon #large_language_models #llama #llm #llm_inference #local_inference
Stars: 792 Issues: 8 Forks: 32
https://github.com/SJTU-IPADS/PowerInfer
GitHub
GitHub - SJTU-IPADS/PowerInfer: High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs - SJTU-IPADS/PowerInfer
hpcaitech/SwiftInfer
Efficient AI Inference & Serving
Language: Python
#artificial_intelligence #deep_learning #gpt #inference #llama #llama2 #llm_inference #llm_serving
Stars: 299 Issues: 3 Forks: 14
https://github.com/hpcaitech/SwiftInfer
Efficient AI Inference & Serving
Language: Python
#artificial_intelligence #deep_learning #gpt #inference #llama #llama2 #llm_inference #llm_serving
Stars: 299 Issues: 3 Forks: 14
https://github.com/hpcaitech/SwiftInfer
GitHub
GitHub - hpcaitech/SwiftInfer: Efficient AI Inference & Serving
Efficient AI Inference & Serving. Contribute to hpcaitech/SwiftInfer development by creating an account on GitHub.
leptonai/search_with_lepton
Building a quick conversation-based search demo with Lepton AI.
Language: TypeScript
#ai #ai_applications #leptonai #llm
Stars: 458 Issues: 0 Forks: 49
https://github.com/leptonai/search_with_lepton
Building a quick conversation-based search demo with Lepton AI.
Language: TypeScript
#ai #ai_applications #leptonai #llm
Stars: 458 Issues: 0 Forks: 49
https://github.com/leptonai/search_with_lepton
GitHub
GitHub - leptonai/search_with_lepton: Building a quick conversation-based search demo with Lepton AI.
Building a quick conversation-based search demo with Lepton AI. - leptonai/search_with_lepton
databricks/dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
Language: Python
#databricks #gen_ai #generative_ai #llm #llm_inference #llm_training #mosaic_ai
Stars: 1113 Issues: 7 Forks: 86
https://github.com/databricks/dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
Language: Python
#databricks #gen_ai #generative_ai #llm #llm_inference #llm_training #mosaic_ai
Stars: 1113 Issues: 7 Forks: 86
https://github.com/databricks/dbrx
GitHub
GitHub - databricks/dbrx: Code examples and resources for DBRX, a large language model developed by Databricks
Code examples and resources for DBRX, a large language model developed by Databricks - databricks/dbrx
jina-ai/reader
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Language: TypeScript
#llm #proxy
Stars: 256 Issues: 2 Forks: 13
https://github.com/jina-ai/reader
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Language: TypeScript
#llm #proxy
Stars: 256 Issues: 2 Forks: 13
https://github.com/jina-ai/reader
GitHub
GitHub - jina-ai/reader: Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/ - jina-ai/reader
mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown
Language: TypeScript
#ai #crawler #data #html_to_markdown #llm #markdown #rag #scraper #scraping #web_crawler
Stars: 469 Issues: 8 Forks: 34
https://github.com/mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown
Language: TypeScript
#ai #crawler #data #html_to_markdown #llm #markdown #rag #scraper #scraping #web_crawler
Stars: 469 Issues: 8 Forks: 34
https://github.com/mendableai/firecrawl
GitHub
GitHub - mendableai/firecrawl: 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with…
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API. - mendableai/firecrawl
mishushakov/llm-scraper
Turn any webpage into structured data using LLMs
Language: TypeScript
#ai #browser #browser_automation #gpt #langchain #llama #llm #openai #playwright #puppeteer #scraper
Stars: 332 Issues: 6 Forks: 23
https://github.com/mishushakov/llm-scraper
Turn any webpage into structured data using LLMs
Language: TypeScript
#ai #browser #browser_automation #gpt #langchain #llama #llm #openai #playwright #puppeteer #scraper
Stars: 332 Issues: 6 Forks: 23
https://github.com/mishushakov/llm-scraper
GitHub
GitHub - mishushakov/llm-scraper: Turn any webpage into structured data using LLMs
Turn any webpage into structured data using LLMs. Contribute to mishushakov/llm-scraper development by creating an account on GitHub.
mbzuai-oryx/LLaVA-pp
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
Language: Python
#conversation #llama_3_llava #llama_3_vision #llama3 #llama3_llava #llama3_vision #llava #llava_llama3 #llava_phi3 #llm #lmms #phi_3_llava #phi_3_vision #phi3 #phi3_llava #phi3_vision #vision_language
Stars: 297 Issues: 2 Forks: 13
https://github.com/mbzuai-oryx/LLaVA-pp
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
Language: Python
#conversation #llama_3_llava #llama_3_vision #llama3 #llama3_llava #llama3_vision #llava #llava_llama3 #llava_phi3 #llm #lmms #phi_3_llava #phi_3_vision #phi3 #phi3_llava #phi3_vision #vision_language
Stars: 297 Issues: 2 Forks: 13
https://github.com/mbzuai-oryx/LLaVA-pp
GitHub
GitHub - mbzuai-oryx/LLaVA-pp: 🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3) - mbzuai-oryx/LLaVA-pp
AdityaNG/kan-gpt
The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
Language: Python
#gpt #kanformers #kolmogorov_arnold_networks #kolmogorov_arnold_representation #llm #text_generation #transformers
Stars: 217 Issues: 2 Forks: 11
https://github.com/AdityaNG/kan-gpt
The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
Language: Python
#gpt #kanformers #kolmogorov_arnold_networks #kolmogorov_arnold_representation #llm #text_generation #transformers
Stars: 217 Issues: 2 Forks: 11
https://github.com/AdityaNG/kan-gpt
GitHub
GitHub - AdityaNG/kan-gpt: The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks…
The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling - AdityaNG/kan-gpt
OpenAutoCoder/Agentless
Agentless🐱: an agentless approach to automatically solve software development problems
Language: Python
#agent #artificial_intelligence #llm #software_development
Stars: 281 Issues: 3 Forks: 18
https://github.com/OpenAutoCoder/Agentless
Agentless🐱: an agentless approach to automatically solve software development problems
Language: Python
#agent #artificial_intelligence #llm #software_development
Stars: 281 Issues: 3 Forks: 18
https://github.com/OpenAutoCoder/Agentless
GitHub
GitHub - OpenAutoCoder/Agentless: Agentless🐱: an agentless approach to automatically solve software development problems
Agentless🐱: an agentless approach to automatically solve software development problems - OpenAutoCoder/Agentless
gcui-art/album-ai
AI-First Album: Chat with your gallery using plain language! LLM Vision + RAG + Album/Gallery/.
Language: TypeScript
#ai #album #gpt_4o_mini #haiku #image #llm #rag
Stars: 272 Issues: 1 Forks: 23
https://github.com/gcui-art/album-ai
AI-First Album: Chat with your gallery using plain language! LLM Vision + RAG + Album/Gallery/.
Language: TypeScript
#ai #album #gpt_4o_mini #haiku #image #llm #rag
Stars: 272 Issues: 1 Forks: 23
https://github.com/gcui-art/album-ai
GitHub
GitHub - gcui-art/album-ai: AI-First Album: Chat with your gallery using plain language! LLM Vision + RAG + Album/Gallery.
AI-First Album: Chat with your gallery using plain language! LLM Vision + RAG + Album/Gallery. - gcui-art/album-ai
InternLM/MindSearch
🔍 a LLM-based Multi-agent Framework of Web Search Engine similar to Perplexity.ai Pro and SearchGPT
Language: Python
#ai_search_engine #gpt #llm #llms #multi_agent_systems #perplexity_ai #search #searchgpt #transformer #web_search
Stars: 792 Issues: 9 Forks: 60
https://github.com/InternLM/MindSearch
🔍 a LLM-based Multi-agent Framework of Web Search Engine similar to Perplexity.ai Pro and SearchGPT
Language: Python
#ai_search_engine #gpt #llm #llms #multi_agent_systems #perplexity_ai #search #searchgpt #transformer #web_search
Stars: 792 Issues: 9 Forks: 60
https://github.com/InternLM/MindSearch
GitHub
GitHub - InternLM/MindSearch: 🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT) - InternLM/MindSearch
THUDM/LongWriter
LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
Language: Python
#fine_tuning #llm #long_context #long_text
Stars: 266 Issues: 7 Forks: 19
https://github.com/THUDM/LongWriter
LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
Language: Python
#fine_tuning #llm #long_context #long_text
Stars: 266 Issues: 7 Forks: 19
https://github.com/THUDM/LongWriter
GitHub
GitHub - THUDM/LongWriter: LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs - THUDM/LongWriter
arc53/llm-price-compass
LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table
Language: TypeScript
#benchmark #gpu #inference_comparison #llm #llm_comparison #llm_inference #llm_price
Stars: 138 Issues: 1 Forks: 5
https://github.com/arc53/llm-price-compass
LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table
Language: TypeScript
#benchmark #gpu #inference_comparison #llm #llm_comparison #llm_inference #llm_price
Stars: 138 Issues: 1 Forks: 5
https://github.com/arc53/llm-price-compass
GitHub
GitHub - arc53/llm-price-compass: This project collects GPU benchmarks from various cloud providers and compares them to fixed…
This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provide...
itsOwen/CyberScraper-2077
A Powerful web scraper powered by LLM | Open-AI & Ollama
Language: Python
#ai_scraping #llm #openai #scraper
Stars: 547 Issues: 0 Forks: 43
https://github.com/itsOwen/CyberScraper-2077
A Powerful web scraper powered by LLM | Open-AI & Ollama
Language: Python
#ai_scraping #llm #openai #scraper
Stars: 547 Issues: 0 Forks: 43
https://github.com/itsOwen/CyberScraper-2077
GitHub
GitHub - itsOwen/CyberScraper-2077: A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama - itsOwen/CyberScraper-2077