hpcaitech/SwiftInfer
Efficient AI Inference & Serving
Language:Python
Total stars: 162
Stars trend:
#python
#artificialintelligence, #deeplearning, #gpt, #inference, #llama, #llama2, #llminference, #llmserving
Efficient AI Inference & Serving
Language:Python
Total stars: 162
Stars trend:
8 Jan 2024
1am ▎ +2
2am ▌ +4
3am ███ +24
4am ██▌ +20
5am ████▌ +36
6am ███ +24
7am ██▍ +19
8am ██▉ +23#python
#artificialintelligence, #deeplearning, #gpt, #inference, #llama, #llama2, #llminference, #llmserving
ollama/ollama
Get up and running with Llama 2, Mistral, and other large language models locally.
Language:Go
Total stars: 32731
Stars trend:
#go
#go, #golang, #llama, #llama2, #llm, #llms, #mistral, #ollama
Get up and running with Llama 2, Mistral, and other large language models locally.
Language:Go
Total stars: 32731
Stars trend:
24 Jan 2024
6pm ▊ +6
7pm ▊ +6
8pm ▉ +7
9pm ▋ +5
10pm ▋ +5
11pm ▌ +4
25 Jan 2024
12am ▌ +4
1am █▉ +15
2am ██▏ +17
3am ██▌ +20
4am ████ +32
5am ███▊ +30#go
#go, #golang, #llama, #llama2, #llm, #llms, #mistral, #ollama
moritztng/fltr
Like grep but for natural language questions. Based on Mixtral 8x7B.
Language:Rust
Total stars: 106
Stars trend:
#rust
#cli, #grep, #llama, #llama2, #llm, #localllama, #mistral, #mixtral, #mixtral8x7b, #operatingsystem, #rust
Like grep but for natural language questions. Based on Mixtral 8x7B.
Language:Rust
Total stars: 106
Stars trend:
5 Mar 2024
4pm ▍ +3
5pm ▋ +5
6pm █▍ +11
7pm █▎ +10
8pm ▉ +7
9pm ▉ +7
10pm █ +8#rust
#cli, #grep, #llama, #llama2, #llm, #localllama, #mistral, #mixtral, #mixtral8x7b, #operatingsystem, #rust
langchain4j/langchain4j
Java version of LangChain
Language:Java
Total stars: 2241
Stars trend:
#java
#azureopenai, #chatgpt, #chroma, #embeddings, #gemini, #gpt, #huggingface, #java, #langchain, #langchainjava, #llama, #llama2, #localai, #milvus, #ollama, #onnx, #openai, #pinecone, #vectordatabase, #weaviate
Java version of LangChain
Language:Java
Total stars: 2241
Stars trend:
9 Mar 2024
6am ▋ +5
7am ▎ +2
8am ▌ +4
9am ▊ +6
10am ▋ +5
11am ██▎ +18
12pm ██ +16
1pm █ +8
2pm ▍ +3
3pm ▍ +3
4pm +0
5pm ▋ +5#java
#azureopenai, #chatgpt, #chroma, #embeddings, #gemini, #gpt, #huggingface, #java, #langchain, #langchainjava, #llama, #llama2, #localai, #milvus, #ollama, #onnx, #openai, #pinecone, #vectordatabase, #weaviate
yusufcanb/tlm
Local CLI Copilot, powered by CodeLLaMa. 💻🦙
Language:Go
Total stars: 336
Stars trend:
#go
#cli, #codellama, #llama2, #llm, #terminal
Local CLI Copilot, powered by CodeLLaMa. 💻🦙
Language:Go
Total stars: 336
Stars trend:
14 Mar 2024
1pm ▏ +1
2pm ▍ +3
3pm █ +8
4pm ██▎ +18
5pm ████▎ +34
6pm ██▊ +22#go
#cli, #codellama, #llama2, #llm, #terminal
meta-llama/llama-recipes
Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger
Language:Jupyter Notebook
Total stars: 8361
Stars trend:
#jupyternotebook
#ai, #finetuning, #langchain, #llama, #llama2, #llm, #machinelearning, #python, #pytorch, #vllm
Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger
Language:Jupyter Notebook
Total stars: 8361
Stars trend:
18 Apr 2024
1pm ▏ +1
2pm ▏ +1
3pm +0
4pm ▉ +7
5pm ██▎ +18
6pm █▋ +13
7pm ▋ +5
8pm ▉ +7
9pm █▏ +9
10pm ▌ +4
11pm ▋ +5
19 Apr 2024
12am ▋ +5#jupyternotebook
#ai, #finetuning, #langchain, #llama, #llama2, #llm, #machinelearning, #python, #pytorch, #vllm
LlamaFamily/Llama-Chinese
Llama Chinese community, the best Chinese Llama model, completely open source and commercially available
Language:Python
Total stars: 9530
Stars trend:
#python
#finetune, #llama, #llama2, #llama3, #llm, #pretrain
Llama Chinese community, the best Chinese Llama model, completely open source and commercially available
Language:Python
Total stars: 9530
Stars trend:
21 Apr 2024
5am ▋ +5
6am ▌ +4
7am ▍ +3
8am ▍ +3
9am ▋ +5
10am ▎ +2
11am █▏ +9
12pm ▉ +7
1pm █▋ +13
2pm █▉ +15
3pm █▏ +9
4pm █ +8#python
#finetune, #llama, #llama2, #llama3, #llm, #pretrain
InternLM/xtuner
An efficient, flexible and full-featured toolkit for fine-tuning large models (InternLM, Llama, Baichuan, Qwen, ChatGLM)
Language:Python
Total stars: 1534
Stars trend:
#python
#agent, #baichuan, #chatbot, #chatglm, #chatglm2, #chatglm3, #conversationalai, #internlm, #largelanguagemodels, #llama, #llama2, #llava, #llm, #llmtraining, #mixtral, #msagent, #peft, #qwen, #supervisedfinetuning
An efficient, flexible and full-featured toolkit for fine-tuning large models (InternLM, Llama, Baichuan, Qwen, ChatGLM)
Language:Python
Total stars: 1534
Stars trend:
21 Apr 2024
2pm ▏ +1
3pm ▌ +4
4pm █▌ +12
5pm █ +8
6pm ▍ +3
7pm ▌ +4
8pm +0
9pm ▎ +2
10pm ▋ +5
11pm ██▎ +18
22 Apr 2024
12am █▉ +15
1am ███▏ +25#python
#agent, #baichuan, #chatbot, #chatglm, #chatglm2, #chatglm3, #conversationalai, #internlm, #largelanguagemodels, #llama, #llama2, #llava, #llm, #llmtraining, #mixtral, #msagent, #peft, #qwen, #supervisedfinetuning
rjmacarthy/twinny
The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.
Language:TypeScript
Total stars: 1441
Stars trend:
#typescript
#artificialintelligence, #codechat, #codecompletion, #codegeneration, #codellama, #copilot, #free, #llama2, #llamacpp, #ollama, #ollamaapi, #ollamachat, #private, #vscodeextension
The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.
Language:TypeScript
Total stars: 1441
Stars trend:
25 Apr 2024
1am ▎ +2
2am ▌ +4
3am ▍ +3
4am ▊ +6
5am ██ +16
6am ▋ +5
7am ▌ +4
8am █ +8
9am █▎ +10
10am █▏ +9
11am ▋ +5
12pm ▌ +4#typescript
#artificialintelligence, #codechat, #codecompletion, #codegeneration, #codellama, #copilot, #free, #llama2, #llamacpp, #ollama, #ollamaapi, #ollamachat, #private, #vscodeextension
ymcui/Chinese-LLaMA-Alpaca-3
中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3
Language:Python
Total stars: 363
Stars trend:
#python
#alpaca, #largelanguagemodels, #llama, #llama2, #llama3, #llama3, #llm, #nlp
中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3
Language:Python
Total stars: 363
Stars trend:
1 May 2024
6pm ▏ +1
7pm ▌ +4
8pm ▌ +4
9pm ▎ +2
10pm ▊ +6
11pm █ +8
2 May 2024
12am █▎ +10
1am █▌ +12
2am █▍ +11
3am ██ +16
4am █▎ +10
5am █▊ +14#python
#alpaca, #largelanguagemodels, #llama, #llama2, #llama3, #llama3, #llm, #nlp
h2oai/h2ogpt
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
Language:Python
Total stars: 10596
Stars trend:
#python
#ai, #chatgpt, #embeddings, #generative, #gpt, #gpt4all, #llama2, #llm, #mixtral, #pdf, #private, #privategpt, #vectorstore
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
Language:Python
Total stars: 10596
Stars trend:
12 May 2024
2pm ▏ +1
3pm ██▍ +19
4pm █▍ +11
5pm █▌ +12
6pm █ +8
7pm ▍ +3
8pm ▋ +5
9pm ▍ +3
10pm ▏ +1
11pm +0
13 May 2024
12am █▎ +10
1am ▍ +3#python
#ai, #chatgpt, #embeddings, #generative, #gpt, #gpt4all, #llama2, #llm, #mixtral, #pdf, #private, #privategpt, #vectorstore
AugustDev/enchanted
Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
Language:Swift
Total stars: 2407
Stars trend:
#swift
#ios, #largelanguagemodel, #llama, #llama2, #llm, #mistral, #ollama, #ollamaapp, #swift
Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
Language:Swift
Total stars: 2407
Stars trend:
11 Jul 2024
10pm ▎ +2
11pm +0
12 Jul 2024
12am ▏ +1
1am ▏ +1
2am █▍ +11
3am ▊ +6
4am █▉ +15
5am ██▏ +17
6am █▍ +11
7am ▉ +7
8am ▌ +4
9am ▌ +4#swift
#ios, #largelanguagemodel, #llama, #llama2, #llm, #mistral, #ollama, #ollamaapp, #swift
aws-samples/generative-ai-use-cases-jp
Implementation of a secure generative AI app with a collection of business use cases that can be used immediately for business purposes
Language:TypeScript
Total stars: 521
Stars trend:
#typescript
#aws, #bedrock, #chatbot, #claude, #claude3, #commandr, #generativeai, #imagegeneration, #lambda, #llama2, #llama3, #llm, #mistral, #rag, #react, #sagemaker, #typescript
Implementation of a secure generative AI app with a collection of business use cases that can be used immediately for business purposes
Language:TypeScript
Total stars: 521
Stars trend:
18 Jul 2024
4am ██████▏ +49
5am ███▋ +29#typescript
#aws, #bedrock, #chatbot, #claude, #claude3, #commandr, #generativeai, #imagegeneration, #lambda, #llama2, #llama3, #llm, #mistral, #rag, #react, #sagemaker, #typescript
Dicklesworthstone/llm_aided_ocr
Enhance Tesseract OCR output for scanned PDFs by applying Large Language Model (LLM) corrections.
Language:Python
Total stars: 1576
Stars trend:
#python
#aiassist, #llama2, #llm, #ocr, #ocrcorrection, #tesseract
Enhance Tesseract OCR output for scanned PDFs by applying Large Language Model (LLM) corrections.
Language:Python
Total stars: 1576
Stars trend:
9 Aug 2024
1pm ▏ +1
2pm +0
3pm +0
4pm ▍ +3
5pm ██████▊ +54
6pm ███████▏ +57
7pm ██████ +48
8pm ████▍ +35
9pm ████▊ +38#python
#aiassist, #llama2, #llm, #ocr, #ocrcorrection, #tesseract
twinnydotdev/twinny
The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.
Language:TypeScript
Total stars: 2708
Stars trend:
#typescript
#artificialintelligence, #codechat, #codecompletion, #codegeneration, #codellama, #copilot, #decentralized, #free, #llama2, #llamacpp, #ollama, #ollamaapi, #ollamachat, #p2p, #private, #symmetry, #vscodeextension
The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.
Language:TypeScript
Total stars: 2708
Stars trend:
21 Sep 2024
12pm ▎ +2
1pm +0
2pm +0
3pm +0
4pm +0
5pm █▋ +13
6pm ██▌ +20
7pm █▌ +12
8pm ██ +16
9pm █▍ +11
10pm ▌ +4#typescript
#artificialintelligence, #codechat, #codecompletion, #codegeneration, #codellama, #copilot, #decentralized, #free, #llama2, #llamacpp, #ollama, #ollamaapi, #ollamachat, #p2p, #private, #symmetry, #vscodeextension
RahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
Language:JavaScript
Total stars: 878
Stars trend:
#javascript
#ggml, #gpu, #huggingface, #languagemodel, #llama, #llama2, #llamacpp, #llm, #pytorch, #quantization
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
Language:JavaScript
Total stars: 878
Stars trend:
5 Oct 2024
9am ▋ +5
10am ▏ +1
11am ▉ +7
12pm ▌ +4
1pm █▎ +10
2pm █▏ +9
3pm █▏ +9
4pm █▍ +11
5pm ▊ +6
6pm █▎ +10
7pm █▍ +11#javascript
#ggml, #gpu, #huggingface, #languagemodel, #llama, #llama2, #llamacpp, #llm, #pytorch, #quantization
ollama/ollama
Get up and running with Llama 3.3, Phi 4, Gemma 2, and other large language models.
Language:Go
Total stars: 107404
Stars trend:
#go
#gemma, #gemma2, #go, #golang, #llama, #llama2, #llama3, #llava, #llm, #llms, #mistral, #ollama, #phi3, #phi4
Get up and running with Llama 3.3, Phi 4, Gemma 2, and other large language models.
Language:Go
Total stars: 107404
Stars trend:
13 Jan 2025
3pm █▍ +11
4pm █ +8
5pm ▊ +6
6pm ▊ +6
7pm █▎ +10
8pm █ +8
9pm ▍ +3
10pm ▍ +3
11pm ▌ +4
14 Jan 2025
12am ▊ +6
1am ▉ +7
2am ██ +16#go
#gemma, #gemma2, #go, #golang, #llama, #llama2, #llama3, #llava, #llm, #llms, #mistral, #ollama, #phi3, #phi4
sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
Language:Python
Total stars: 8931
Stars trend:
#python
#cuda, #deepseek, #deepseekllm, #deepseekv3, #inference, #llama, #llama2, #llama3, #llama31, #llava, #llm, #llmserving, #moe, #pytorch, #transformer, #vlm
SGLang is a fast serving framework for large language models and vision language models.
Language:Python
Total stars: 8931
Stars trend:
7 Feb 2025
10pm ▊ +6
11pm ▊ +6
8 Feb 2025
12am ▍ +3
1am █ +8
2am █▋ +13
3am █▎ +10
4am ▌ +4
5am █▊ +14
6am █▋ +13
7am █ +8
8am █▊ +14
9am █▊ +14#python
#cuda, #deepseek, #deepseekllm, #deepseekv3, #inference, #llama, #llama2, #llama3, #llama31, #llava, #llm, #llmserving, #moe, #pytorch, #transformer, #vlm
b4rtaz/distributed-llama
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Language:C++
Total stars: 1786
Stars trend:
#cplusplus
#distributedcomputing, #distributedllm, #llama2, #llama3, #llm, #llminference, #llms, #neuralnetwork, #openllm
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Language:C++
Total stars: 1786
Stars trend:
15 Feb 2025
3pm ▏ +1
4pm █▋ +13
5pm █▊ +14
6pm ██▎ +18
7pm █▎ +10
8pm ▌ +4
9pm ▊ +6
10pm ▋ +5
11pm ▍ +3
16 Feb 2025
12am ▏ +1
1am +0
2am ▏ +1#cplusplus
#distributedcomputing, #distributedllm, #llama2, #llama3, #llm, #llminference, #llms, #neuralnetwork, #openllm
meta-llama/llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Language:Jupyter Notebook
Total stars: 16761
Stars trend:
#jupyternotebook
#ai, #finetuning, #langchain, #llama, #llama2, #llm, #machinelearning, #python, #pytorch, #vllm
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Language:Jupyter Notebook
Total stars: 16761
Stars trend:
7 Apr 2025
7am ▋ +5
8am ▎ +2
9am +0
10am ▍ +3
11am █▎ +10
12pm █▋ +13
1pm █▏ +9
2pm █ +8
3pm ▉ +7
4pm ▉ +7
5pm ▋ +5
6pm █▏ +9#jupyternotebook
#ai, #finetuning, #langchain, #llama, #llama2, #llm, #machinelearning, #python, #pytorch, #vllm