bentoml/OpenLLM
An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
Language: Python
Total stars: 1192
Stars trend:
19 Jun 2023

12am  +1

 1am  +0

 2am  +1

 3am  +1

 4am  +1

 5am ▎ +3

 6am  +0

 7am █▏ +10

 8am ████████████▍ +108

 9am ██████████████████▊ +163

#python
#ai, #chatglm, #deployment, #developertools, #dolly, #easytouse, #falcon, #finetuning, #llm, #llmops, #lmops, #machinelearning, #modelinference, #stablelm, #t5model

SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Language:C
Total stars: 259
Stars trend:
19 Dec 2023
10am █ +8
11am ▏ +1
12pm ▎ +2
1pm ▊ +6
2pm ██▌ +20
3pm █ +8
4pm █▋ +13
5pm █▎ +10
6pm ███▏ +25
7pm █▊ +14
8pm ██▋ +21
9pm ████▉ +39
#c
#falcon, #largelanguagemodels, #llama, #llm, #llminference, #localinference

mudler/LocalAI
:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.
Language:C++
Total stars: 16900
Stars trend:
26 Feb 2024
10am ▌ +4
11am ▏ +1
12pm ▎ +2
1pm ▎ +2
2pm ▎ +2
3pm ▎ +2
4pm ▏ +1
5pm ▊ +6
6pm █ +8
7pm ▌ +4
8pm █▍ +11
9pm ▉ +7
#cplusplus
#ai, #alpaca, #api, #apirest, #audiogeneration, #coqui, #falcon, #gpt4all, #imagegeneration, #kubernetes, #llama, #llm, #mamba, #musicgen, #rwkv, #stablediffusion, #textgeneration, #tts

huggingface/text-generation-inference
Large Language Model Text Generation Inference
Language:Python
Total stars: 7640
Stars trend:
9 Apr 2024
9pm ▊ +6
10pm ▊ +6
11pm ▍ +3
10 Apr 2024
12am ▋ +5
1am ▌ +4
2am █▎ +10
3am █▌ +12
4am ▉ +7
5am ▊ +6
6am ▋ +5
7am ▊ +6
8am ▉ +7
#python
#bloom, #deeplearning, #falcon, #gpt, #inference, #nlp, #pytorch, #starcoder, #transformer