PreternaturalAI/mlx-swift-chat
A multi-platform SwiftUI app to test out LLMs with mlx-swift.
Language:Swift
Total stars: 68
Stars trend:
#swift
#ios, #llminference, #macos, #mlx, #mlxswift, #swiftui
A multi-platform SwiftUI app to test out LLMs with mlx-swift.
Language:Swift
Total stars: 68
Stars trend:
3 Mar 2024
7am █ +8
8am █▌ +12
9am █▏ +9
10am ▏ +1
11am ▌ +4
12pm ▎ +2
1pm ▉ +7
2pm ██ +16#swift
#ios, #llminference, #macos, #mlx, #mlxswift, #swiftui
microsoft/aici
AICI: Prompts as (Wasm) Programs
Language:Rust
Total stars: 213
Stars trend:
#rust
#ai, #inference, #languagemodel, #llm, #llmframework, #llminference, #llmserving, #llmops, #modelserving, #rust, #transformer, #wasm, #wasmtime
AICI: Prompts as (Wasm) Programs
Language:Rust
Total stars: 213
Stars trend:
11 Mar 2024
6pm ██▏ +17
7pm ███▎ +26
8pm ████▊ +38#rust
#ai, #inference, #languagemodel, #llm, #llmframework, #llminference, #llmserving, #llmops, #modelserving, #rust, #transformer, #wasm, #wasmtime
databricks/dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
Language:Python
Total stars: 157
Stars trend:
#python
#databricks, #genai, #generativeai, #llm, #llminference, #llmtraining, #mosaicai
Code examples and resources for DBRX, a large language model developed by Databricks
Language:Python
Total stars: 157
Stars trend:
27 Mar 2024
11am ▋ +5
12pm █▌ +12
1pm ██▍ +19
2pm ███▊ +30
3pm ████▋ +37
4pm ████▎ +34#python
#databricks, #genai, #generativeai, #llm, #llminference, #llmtraining, #mosaicai
ghimiresunil/LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
Language:Jupyter Notebook
Total stars: 370
Stars trend:
#jupyternotebook
#bert, #huggingface, #largelanguagemodels, #llminference, #llmtraining, #llmtutorials, #opensource, #opensourcellm, #transformers
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
Language:Jupyter Notebook
Total stars: 370
Stars trend:
12 May 2024
2pm ▍ +3
3pm █▎ +10
4pm ███▋ +29
5pm ██▋ +21
6pm █▎ +10
7pm █▌ +12#jupyternotebook
#bert, #huggingface, #largelanguagemodels, #llminference, #llmtraining, #llmtutorials, #opensource, #opensourcellm, #transformers
beam-cloud/beta9
The open-source serverless GPU container runtime.
Language:Go
Total stars: 82
Stars trend:
#go
#cuda, #distributedcomputing, #finetuning, #generativeai, #gpu, #largelanguagemodels, #llm, #llminference, #mlplatform, #selfhosted
The open-source serverless GPU container runtime.
Language:Go
Total stars: 82
Stars trend:
13 May 2024
5pm █▎ +10
6pm ███▎ +26
7pm ██▋ +21
8pm ▉ +7
9pm ▊ +6
10pm █▍ +11#go
#cuda, #distributedcomputing, #finetuning, #generativeai, #gpu, #largelanguagemodels, #llm, #llminference, #mlplatform, #selfhosted
codelion/optillm
Optimizing inference proxy for LLMs
Language:Python
Total stars: 512
Stars trend:
#python
#agent, #agenticai, #agenticframework, #agenticworkflow, #agents, #apigateway, #genai, #largelanguagemodels, #llm, #llminference, #llmapi, #mixtureofexperts, #moa, #openai, #openaiapi, #optimization, #proxyserver
Optimizing inference proxy for LLMs
Language:Python
Total stars: 512
Stars trend:
17 Sep 2024
4am ▊ +6
5am ▎ +2
6am ▊ +6
7am █▏ +9
8am ▋ +5
9am ▎ +2
10am ▉ +7
11am ▊ +6
12pm ▏ +1
1pm ▋ +5
2pm █▌ +12
3pm ██ +16#python
#agent, #agenticai, #agenticframework, #agenticworkflow, #agents, #apigateway, #genai, #largelanguagemodels, #llm, #llminference, #llmapi, #mixtureofexperts, #moa, #openai, #openaiapi, #optimization, #proxyserver
PySpur-Dev/PySpur
Graph-Based Editor for LLM Workflows
Language:Python
Total stars: 263
Stars trend:
#python
#agent, #ai, #javascript, #llm, #llminference, #openai, #python, #react, #workflow, #ycombinator
Graph-Based Editor for LLM Workflows
Language:Python
Total stars: 263
Stars trend:
17 Dec 2024
11pm ▌ +4
18 Dec 2024
12am ▍ +3
1am ▎ +2
2am +0
3am ▌ +4
4am █ +8
5am █▎ +10
6am ▉ +7
7am █▋ +13
8am ▊ +6
9am █▌ +12
10am █▎ +10#python
#agent, #ai, #javascript, #llm, #llminference, #openai, #python, #react, #workflow, #ycombinator
FellouAI/eko
Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai
Language:TypeScript
Total stars: 305
Stars trend:
#typescript
#agent, #agenticai, #agenticaidevelopment, #agenticframework, #agenticworkflow, #agents, #aiagents, #browserautomation, #browseruse, #chainofthought, #computerautomation, #computeruse, #genai, #llmagents, #llminference, #llmapi, #naturallanguageinference, #promptengineering, #rag, #workflow
Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai
Language:TypeScript
Total stars: 305
Stars trend:
14 Jan 2025
5pm ▏ +1
6pm ▏ +1
7pm ▏ +1
8pm +0
9pm ▏ +1
10pm ▍ +3
11pm ▍ +3
15 Jan 2025
12am █▎ +10
1am ██▌ +20
2am ██ +16
3am █▍ +11
4am █▏ +9#typescript
#agent, #agenticai, #agenticaidevelopment, #agenticframework, #agenticworkflow, #agents, #aiagents, #browserautomation, #browseruse, #chainofthought, #computerautomation, #computeruse, #genai, #llmagents, #llminference, #llmapi, #naturallanguageinference, #promptengineering, #rag, #workflow
sauravpanda/BrowserAI
Run local LLMs inside your browser
Language:TypeScript
Total stars: 196
Stars trend:
#typescript
#agents, #ai, #llm, #llminference, #localllm, #tts, #webgpu
Run local LLMs inside your browser
Language:TypeScript
Total stars: 196
Stars trend:
22 Jan 2025
3pm ▏ +1
4pm +0
5pm █ +8
6pm ████▎ +34
7pm ▊ +6
8pm ▉ +7
9pm ▎ +2
10pm ▌ +4
11pm ▊ +6
23 Jan 2025
12am ▌ +4
1am ▍ +3#typescript
#agents, #ai, #llm, #llminference, #localllm, #tts, #webgpu
👍1
b4rtaz/distributed-llama
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Language:C++
Total stars: 1786
Stars trend:
#cplusplus
#distributedcomputing, #distributedllm, #llama2, #llama3, #llm, #llminference, #llms, #neuralnetwork, #openllm
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Language:C++
Total stars: 1786
Stars trend:
15 Feb 2025
3pm ▏ +1
4pm █▋ +13
5pm █▊ +14
6pm ██▎ +18
7pm █▎ +10
8pm ▌ +4
9pm ▊ +6
10pm ▋ +5
11pm ▍ +3
16 Feb 2025
12am ▏ +1
1am +0
2am ▏ +1#cplusplus
#distributedcomputing, #distributedllm, #llama2, #llama3, #llm, #llminference, #llms, #neuralnetwork, #openllm
Lizonghang/prima.cpp
prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
Language:C++
Total stars: 101
Stars trend:
#cplusplus
#distributedai, #llamacpp, #llminference, #ondevicellms
prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
Language:C++
Total stars: 101
Stars trend:
15 Apr 2025
2am ██ +16
3am ██▋ +21
4am █ +8
5am ▌ +4
6am █ +8
7am ▌ +4
8am ▍ +3
9am ▍ +3
10am ▏ +1
11am ▋ +5
12pm ▋ +5#cplusplus
#distributedai, #llamacpp, #llminference, #ondevicellms
stanford-mast/blast
Browser-LLM Auto-Scaling Technology
Language:Python
Total stars: 198
Stars trend:
#python
#aiagents, #browserautomation, #llminference, #python
Browser-LLM Auto-Scaling Technology
Language:Python
Total stars: 198
Stars trend:
2 May 2025
5pm █ +8
6pm ████▊ +38
7pm ████▋ +37
8pm ████▏ +33
9pm ██▊ +22#python
#aiagents, #browserautomation, #llminference, #python
codelion/openevolve
Open-source implementation of AlphaEvolve
Language:Python
Total stars: 570
Stars trend:
#python
#alphaevolve, #alphacode, #alphaevolve, #codingagent, #deepmind, #deepmindlab, #discovery, #distributedevolutionaryalgorithms, #evolutionaryalgorithms, #evolutionarycomputation, #geneticalgorithm, #geneticalgorithms, #iterativemethods, #iterativerefinement, #llmengineering, #llmensemble, #llminference, #openevolve, #optimize
Open-source implementation of AlphaEvolve
Language:Python
Total stars: 570
Stars trend:
22 May 2025
1am ▋ +5
2am ▌ +4
3am ▋ +5
4am +0
5am ▉ +7
6am ▎ +2
7am ▋ +5
8am ▍ +3
9am █ +8
10am ██ +16
11am ███▎ +26
12pm ████▍ +35#python
#alphaevolve, #alphacode, #alphaevolve, #codingagent, #deepmind, #deepmindlab, #discovery, #distributedevolutionaryalgorithms, #evolutionaryalgorithms, #evolutionarycomputation, #geneticalgorithm, #geneticalgorithms, #iterativemethods, #iterativerefinement, #llmengineering, #llmensemble, #llminference, #openevolve, #optimize
gitleaks/gitleaks
Find secrets with Gitleaks 🔑
Language:Go
Total stars: 20816
Stars trend:
#go
#aipowered, #cicd, #cicd, #cli, #datalossprevention, #devsecops, #dlp, #git, #gitleaks, #go, #golang, #hacktoberfest, #llm, #llminference, #llmtraining, #opensource, #secret, #security, #securitytools
Find secrets with Gitleaks 🔑
Language:Go
Total stars: 20816
Stars trend:
26 Jun 2025
12pm ▉ +7
1pm ▌ +4
2pm ▌ +4
3pm ▋ +5
4pm ▉ +7
5pm ▋ +5
6pm █▌ +12
7pm ▍ +3
8pm █▋ +13
9pm ▌ +4
10pm ▉ +7
11pm ▉ +7#go
#aipowered, #cicd, #cicd, #cli, #datalossprevention, #devsecops, #dlp, #git, #gitleaks, #go, #golang, #hacktoberfest, #llm, #llminference, #llmtraining, #opensource, #secret, #security, #securitytools
cactus-compute/cactus
Cross-platform framework for deploying LLM/VLM/TTS models locally on smartphones.
Language:C++
Total stars: 1481
Stars trend:
#cplusplus
#ai, #android, #dart, #edge, #flutter, #framework, #ios, #javascript, #kotlin, #library, #llamacpp, #llm, #llminference, #llms, #mobile, #reactnative, #smartphone, #swift, #transformer, #typescript
Cross-platform framework for deploying LLM/VLM/TTS models locally on smartphones.
Language:C++
Total stars: 1481
Stars trend:
10 Jul 2025
11am ▎ +2
12pm ▋ +5
1pm ▎ +2
2pm ▏ +1
3pm ▏ +1
4pm ▎ +2
5pm ▍ +3
6pm ▊ +6
7pm ▊ +6
8pm █▎ +10
9pm ███▎ +26
10pm ██▉ +23#cplusplus
#ai, #android, #dart, #edge, #flutter, #framework, #ios, #javascript, #kotlin, #library, #llamacpp, #llm, #llminference, #llms, #mobile, #reactnative, #smartphone, #swift, #transformer, #typescript
nomic-ai/gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Language:C++
Total stars: 74285
Stars trend:
#cplusplus
#aichat, #llminference
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Language:C++
Total stars: 74285
Stars trend:
10 Aug 2025
2pm █ +8
3pm ▊ +6
4pm ▉ +7
5pm ▌ +4
6pm ▍ +3
7pm ▌ +4
8pm ▊ +6
9pm ▋ +5
10pm ▉ +7
11pm ▋ +5
11 Aug 2025
12am ▊ +6
1am ██ +16#cplusplus
#aichat, #llminference
❤2
Michael-A-Kuykendall/shimmy
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
Language:Rust
Total stars: 847
Stars trend:
#rust
#apiserver, #commandlinetool, #developertools, #gguf, #huggingface, #huggingfacemodels, #huggingfacetransformers, #inferenceserver, #llama, #llamacpp, #llminference, #localai, #lora, #machinelearning, #ollamaapi, #openaicompatible, #rust, #rustcrate, #transformers
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
Language:Rust
Total stars: 847
Stars trend:
14 Sep 2025
11pm ▏ +1
15 Sep 2025
12am ▏ +1
1am ▍ +3
2am ▎ +2
3am ▌ +4
4am ██▉ +23
5am ███▋ +29
6am ██▊ +22
7am █▏ +9
8am ██ +16
9am █▏ +9
10am ▊ +6#rust
#apiserver, #commandlinetool, #developertools, #gguf, #huggingface, #huggingfacemodels, #huggingfacetransformers, #inferenceserver, #llama, #llamacpp, #llminference, #localai, #lora, #machinelearning, #ollamaapi, #openaicompatible, #rust, #rustcrate, #transformers
🔥1