vllm
A high-throughput and memory-efficient inference and serving engine for LLMs.
https://github.com/vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs.
https://github.com/vllm-project/vllm
GitHub
GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs
A high-throughput and memory-efficient inference and serving engine for LLMs - vllm-project/vllm
Django LiveView
Framework for creating a complete HTML over the Wire site or LiveView.
https://github.com/Django-LiveView/starter-template
Framework for creating a complete HTML over the Wire site or LiveView.
https://github.com/Django-LiveView/starter-template
GitHub
GitHub - Django-LiveView/starter-template: Django LiveView: Framework for creating Realtime SPAs using HTML over the Wire technology
Django LiveView: Framework for creating Realtime SPAs using HTML over the Wire technology - Django-LiveView/starter-template
Problems faced when downstream testing Python packages
The article explores the importance of downstream testing in Python package development, focusing on the challenges and strategies for ensuring reliable and compatible software dependencies. It provides insights into various testing techniques and tools to enhance the quality and compatibility of Python packages in real-world scenarios.
https://mgorny.pl/articles/downstream-testing-python-packages.html
The article explores the importance of downstream testing in Python package development, focusing on the challenges and strategies for ensuring reliable and compatible software dependencies. It provides insights into various testing techniques and tools to enhance the quality and compatibility of Python packages in real-world scenarios.
https://mgorny.pl/articles/downstream-testing-python-packages.html
mgorny.pl
Problems faced when downstream testing Python packages
Lightning-AI / lit-gpt
Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
https://github.com/Lightning-AI/lit-gpt
Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
https://github.com/Lightning-AI/lit-gpt
GitHub
GitHub - Lightning-AI/litgpt: 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. - Lightning-AI/litgpt
Django: Flush out test flakiness by randomly ordering QuerySets
https://adamj.eu/tech/2023/07/04/django-test-random-order-querysets/
https://adamj.eu/tech/2023/07/04/django-test-random-order-querysets/
adamj.eu
Django: Flush out test flakiness by randomly ordering QuerySets - Adam Johnson
Sometimes code depends on the order of a QuerySet whilst not specifying an order. This can lead to random, flaky test failures because databases can return rows in any order when none is specified. The problem is made worse by some databases, notably PostgreSQL…
100% Offline ChatGPT Alternative?
In this video I show I was able to install an open source Large Language Model (LLM) called h2oGPT on my local computer for 100% private, 100% local chat with a GPT.
https://www.youtube.com/watch?v=Coj72EzmX20
In this video I show I was able to install an open source Large Language Model (LLM) called h2oGPT on my local computer for 100% private, 100% local chat with a GPT.
https://www.youtube.com/watch?v=Coj72EzmX20
YouTube
100% Offline ChatGPT Alternative?
In this video I show I was able to install an open source Large Language Model (LLM) called h2oGPT on my local computer for 100% private, 100% local chat with a GPT.
Links
* h2o website: https://h2o.ai/
* h2oGPT UI: https://falcon.h2o.ai/
* h2oGPT GM-UI…
Links
* h2o website: https://h2o.ai/
* h2oGPT UI: https://falcon.h2o.ai/
* h2oGPT GM-UI…
Automating Deployment of Applications using Kubernetes Python SDK
https://www.faizanbashir.me/automating-deployment-of-python-applications-kubernetes-sdk
https://www.faizanbashir.me/automating-deployment-of-python-applications-kubernetes-sdk
Faizan Bashir
Automating Deployment of Applications using Kubernetes Python SDK
Learn how to use the Python Kubernetes SDK to automate application deployments, including creating Kubernetes resources like deployments, services, secrets, config maps, and ingress.
Organizing Database Queries: Managers vs. QuerySets
In this article Mariusz Felisiak introduces concepts of Django's Managers and QuerySet to organize common database queries.
https://fly.io/django-beats/organizing-database-queries-managers-vs-querysets/
In this article Mariusz Felisiak introduces concepts of Django's Managers and QuerySet to organize common database queries.
https://fly.io/django-beats/organizing-database-queries-managers-vs-querysets/
Fly
Organizing Database Queries: Managers vs. QuerySets
Introducing concepts of Django's Managers and QuerySet to organize common database queries
Building a Toy Programming Language in Python - Part 1
The first installment of this series shows how to implement the lexer, parser and interpreter for a very simple version of the language that did only one thing: print numbers.
https://blog.miguelgrinberg.com/post/building-a-toy-programming-language-in-python
The first installment of this series shows how to implement the lexer, parser and interpreter for a very simple version of the language that did only one thing: print numbers.
https://blog.miguelgrinberg.com/post/building-a-toy-programming-language-in-python
Miguelgrinberg
Building a Toy Programming Language in Python
I thought it would be fun to go outside of my comfort zone of web development topics and write about something completely different and new, something I have never written about before. So today, I'm…
The easiest way to speed up Python with Rust
If you want to speed up some existing Python code, writing a compiled extension in Rust can be ...
https://pythonspeed.com/articles/easiest-rust-python/
If you want to speed up some existing Python code, writing a compiled extension in Rust can be ...
https://pythonspeed.com/articles/easiest-rust-python/
Python⇒Speed
The easiest way to speed up Python with Rust
Rust can make your Python code much faster; here’s how to start using it as quickly as possible.
Python in 2023 still sucks at importing modules from another folder
https://stackoverflow.com/questions/714063/importing-modules-from-parent-folder/50194143#50194143
https://stackoverflow.com/questions/714063/importing-modules-from-parent-folder/50194143#50194143
Stack Overflow
Importing modules from parent folder
I am running Python 2.5.
This is my folder tree:
ptdraft/
nib.py
simulations/
life/
life.py
(I also have __init__.py in each folder, omitted here for readability)
How do I import ...
This is my folder tree:
ptdraft/
nib.py
simulations/
life/
life.py
(I also have __init__.py in each folder, omitted here for readability)
How do I import ...
vlite
A blazing fast, lightweight, and simple vector database written in less than 200 lines of code.
https://github.com/sdan/vlite
A blazing fast, lightweight, and simple vector database written in less than 200 lines of code.
https://github.com/sdan/vlite
GitHub
GitHub - sdan/vlite: fast vector database made in numpy
fast vector database made in numpy. Contribute to sdan/vlite development by creating an account on GitHub.
CLI tools hidden in the Python standard library
A comprehensive collection of practical tips and examples showcasing various command-line interface (CLI) tools available in the Python Standard Library, providing valuable guidance for developers looking to leverage these built-in functionalities for efficient scripting and automation.
https://til.simonwillison.net/python/stdlib-cli-tools
A comprehensive collection of practical tips and examples showcasing various command-line interface (CLI) tools available in the Python Standard Library, providing valuable guidance for developers looking to leverage these built-in functionalities for efficient scripting and automation.
https://til.simonwillison.net/python/stdlib-cli-tools
Simon Willison’s TILs
CLI tools hidden in the Python standard library
Seth Michael Larson pointed out that the Python gzip module can be used as a CLI tool like this: