PyTorch Memory Tuning

This article will focus on minimizing GPU memory footprint — for both optimization and inference workloads. Throughput and latency usually get all the attention, but reducing memory consumption without making architecture sacrifices is often just as valuable.

https://paulbridger.com/posts/pytorch-memory-tuning/

Patterns for Building LLM-based Systems & Products

This post is about practical patterns for integrating large language models (LLMs) into systems and products. We’ll draw from academic research, industry resources, and practitioner know-how, and try to distill them into key ideas and practices.

https://eugeneyan.com/writing/llm-patterns/

devlooper

A program synthesis agent that autonomously fixes its output by running tests!

https://github.com/modal-labs/devlooper

The GIL Was Removed From Python!?

The GIL has been removed from Python! Has it though? Okay, let me clear some things up: Okay, allow ...

https://superfastpython.com/gil-removed-from-python/

Behind "Hello World" on Linux

When you run a simple "Hello World" Python program on Linux, a lot more happens behind the scenes than you might think. This post explores the different steps that take place when you run a "Hello World" program, from parsing the command line to executing the code.

https://jvns.ca/blog/2023/08/03/behind--hello-world/

Llama from scratch

A tutorial on how to implement a paper and debug your model.

https://blog.briankitano.com/llama-from-scratch/

Parameters, options and flags for Python scripts

SummaryWhile there are various ways of making a script configurable in Python, argparse is a very ...

https://www.bitecode.dev/p/parameters-options-and-flags-for

PokerKit

An open-source Python library for poker simulations and hand evaluations.

https://github.com/uoftcprg/pokerkit

Creating a context manager in Python

Objects with __enter__ and __exit__ methods can be used as context managers in Python. This article discusses most of what you'll want to know when creating your own context managers.

https://www.pythonmorsels.com/creating-a-context-manager/

Python SDK for the Uniswap Universal Router

The object of this library is to easily decode & encode the transaction input sent to the latest Uniswap router.

https://github.com/Elnaril/uniswap-universal-router-decoder

Killing the ProcessPoolExecutor

A story about the Python GIL, threading, and fixing code that already works.

https://www.tinybird.co/blog-posts/killing-the-processpoolexecutor

Building and Evaluating Medical AI Models

Learn how to build and evaluate medical AI models with TensorFlow. This is a great, real world project for improving your machine learning skills. You will use TensorFlow to evaluate chest x-rays.

https://www.youtube.com/watch?v=8m3LvPg8EuI

Function Calling: Integrate Your GPT Chatbot With Anything

Learn about GPT new function calling feature which allows chatbots to interact with anything, opening up new possibilities for AI-powered applications.

https://semaphoreci.com/blog/function-calling

Python in Visual Studio Code – August 2023 Release

This release includes the following announcements:

https://devblogs.microsoft.com/python/python-in-visual-studio-code-august-2023-release/