Beyond Self-Attention: How a Small Language Model Predicts the Next Token
A deep dive into the internals of a small transformer model to learn how it turns self-attention calculations into accurate predictions for the next token.
https://shyam.blog/posts/beyond-self-attention
A deep dive into the internals of a small transformer model to learn how it turns self-attention calculations into accurate predictions for the next token.
https://shyam.blog/posts/beyond-self-attention
shyam.blog
Beyond Self-Attention: How a Small Language Model Predicts the Next Token | Shyam's Blog
A deep dive into the internals of a small transformer model to learn how it turns self-attention calculations into accurate predictions for the next token.
A search engine in 80 lines of Python
https://www.alexmolas.com/2024/02/05/a-search-engine-in-80-lines.html
https://www.alexmolas.com/2024/02/05/a-search-engine-in-80-lines.html
Alexmolas
A search engine in 80 lines of Python
In this post I explain how I built a search engine from scratch using python. The resulting search engine is used to search in the posts of the blogs I follow.
RLHF a LLM in <50 lines of Python
https://datadreamer.dev/docs/latest/pages/get_started/quick_tour/aligning.html
https://datadreamer.dev/docs/latest/pages/get_started/quick_tour/aligning.html
datadreamer.dev
GPTAuthor
GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.
https://github.com/dylanhogg/gptauthor
GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.
https://github.com/dylanhogg/gptauthor
GitHub
GitHub - dylanhogg/gptauthor: GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.
GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt. - dylanhogg/gptauthor
metavoice-src
Foundational model for human-like, expressive TTS.
https://github.com/metavoiceio/metavoice-src
Foundational model for human-like, expressive TTS.
https://github.com/metavoiceio/metavoice-src
GitHub
GitHub - metavoiceio/metavoice-src: Foundational model for human-like, expressive TTS
Foundational model for human-like, expressive TTS. Contribute to metavoiceio/metavoice-src development by creating an account on GitHub.
django-queryhunter
Hunt down the lines of your Django application code which are responsible for executing the most queries.
https://github.com/PaulGilmartin/django-queryhunter
Hunt down the lines of your Django application code which are responsible for executing the most queries.
https://github.com/PaulGilmartin/django-queryhunter
GitHub
GitHub - PaulGilmartin/django-queryhunter: Hunt down the lines of your Django application code which are responsible for executing…
Hunt down the lines of your Django application code which are responsible for executing the most queries. - PaulGilmartin/django-queryhunter
Everything You Can Do with Python's textwrap Module
Python has many options for formatting strings and text, including f-strings, format() function, templates and more. There's however one module that few people know about and it's called textwrap. This module is specifically built to help you with line-wrapping, indentation, trimming and more, and in this article we will look at all the things you can use it for.
https://martinheinz.dev/blog/108
Python has many options for formatting strings and text, including f-strings, format() function, templates and more. There's however one module that few people know about and it's called textwrap. This module is specifically built to help you with line-wrapping, indentation, trimming and more, and in this article we will look at all the things you can use it for.
https://martinheinz.dev/blog/108
martinheinz.dev
Everything You Can Do with Python's textwrap Module
<p>
Python has many options for formatting strings and text, including f-strings, <code class="inline">format()</code> function, templates and more. There'...
Python has many options for formatting strings and text, including f-strings, <code class="inline">format()</code> function, templates and more. There'...
👍1
Not just NVIDIA: GPU programming that runs everywhere
If you want to run GPU programs in CI, on Macs, and more, wgu-py is a good option.
https://pythonspeed.com/articles/gpu-without-cuda/
If you want to run GPU programs in CI, on Macs, and more, wgu-py is a good option.
https://pythonspeed.com/articles/gpu-without-cuda/
Python⇒Speed
Not just NVIDIA: GPU programming that runs everywhere
If you want to run GPU programs in CI, on Macs, and more, wgu-py is a good option.
👍1
Everything You Can Do with Python’s textwrap Module
https://towardsdatascience.com/everything-you-can-do-with-pythons-textwrap-module-0d82c377a4c8
https://towardsdatascience.com/everything-you-can-do-with-pythons-textwrap-module-0d82c377a4c8
Medium
Everything You Can Do with Python’s textwrap Module
Learn about all the things you can do with Python’s textwrap module, including formatting, text wrapping, trimming and more
Codium-ai / AlphaCodium
Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""
https://github.com/Codium-ai/AlphaCodium
Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""
https://github.com/Codium-ai/AlphaCodium
GitHub
GitHub - Codium-ai/AlphaCodium: Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering…
Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering"" - Codium-ai/AlphaCodium
Recording and visualising the 20k system calls it takes to "import seaborn"
https://www.reddit.com/r/Python/comments/1asjcnm/recording_and_visualising_the_20k_system_calls_it/
https://www.reddit.com/r/Python/comments/1asjcnm/recording_and_visualising_the_20k_system_calls_it/
Reddit
From the Python community on Reddit
Explore this post and more from the Python community
Engineering Practices for LLM Application Development
LLM engineering involves much more than just prompt design or prompt engineering. In this article, we share a set of engineering practices that helped us deliver a prototype LLM application rapidly and reliably in a recent project. We'll share techniques for automated testing and adversarial testing of LLM applications, refactoring, as well as considerations for architecting LLM applicat...
https://martinfowler.com/articles/engineering-practices-llm.html
LLM engineering involves much more than just prompt design or prompt engineering. In this article, we share a set of engineering practices that helped us deliver a prototype LLM application rapidly and reliably in a recent project. We'll share techniques for automated testing and adversarial testing of LLM applications, refactoring, as well as considerations for architecting LLM applicat...
https://martinfowler.com/articles/engineering-practices-llm.html
martinfowler.com
Engineering Practices for LLM Application Development
Experiences of using ChatGPT on a range of technical writing
Adopt-ruff: find uncobfigured rules easily
Adopt ruff faster into your existing repo: find the easiest rules to start with
https://github.com/ScDor/adopt-ruff
Adopt ruff faster into your existing repo: find the easiest rules to start with
https://github.com/ScDor/adopt-ruff
GitHub
GitHub - ScDor/adopt-ruff: Adopt Ruff easily
Adopt Ruff easily. Contribute to ScDor/adopt-ruff development by creating an account on GitHub.