🔥 Trending Repository: vllm

📝 Description: A high-throughput and memory-efficient inference and serving engine for LLMs

🔗 Repository URL: https://github.com/vllm-project/vllm

🌐 Website: https://docs.vllm.ai

📖 Readme: https://github.com/vllm-project/vllm#readme

📊 Statistics:
🌟 Stars: 55.5K stars
👀 Watchers: 428
🍴 Forks: 9.4K forks

💻 Programming Languages: Python - Cuda - C++ - Shell - C - CMake

🏷️ Related Topics:

#amd #cuda #inference #pytorch #transformer #llama #gpt #rocm #model_serving #tpu #hpu #mlops #xpu #llm #inferentia #llmops #llm_serving #qwen #deepseek #trainium

==================================
🧠 By: https://t.me/DataScienceM

🔥 Trending Repository: transformerlab-app

📝 Description: Open Source Application for Advanced LLM + Diffusion Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.

🔗 Repository URL: https://github.com/transformerlab/transformerlab-app

🌐 Website: https://transformerlab.ai/

📖 Readme: https://github.com/transformerlab/transformerlab-app#readme

📊 Statistics:
🌟 Stars: 3.9K stars
👀 Watchers: 31
🍴 Forks: 363 forks

💻 Programming Languages: TypeScript - JavaScript

🏷️ Related Topics:

#electron #transformers #llama #lora #diffusion #mlx #diffusion_models #llms #stability_diffusion #rlhf

==================================
🧠 By: https://t.me/DataScienceM