Let's build the GPT Tokenizer
The Tokenizer, essential for Large Language Models (LLMs), translates between strings and tokens, operating as a distinct stage with separate training sets and algorithms. This lecture builds the GPT series Tokenizer from scratch, uncovering peculiar behaviors in LLMs linked to tokenization. We explore these issues, attributing them to tokenization, and consider the ideal scenario of eli...
https://www.youtube.com/watch?v=zduSFxRajkE
The Tokenizer, essential for Large Language Models (LLMs), translates between strings and tokens, operating as a distinct stage with separate training sets and algorithms. This lecture builds the GPT series Tokenizer from scratch, uncovering peculiar behaviors in LLMs linked to tokenization. We explore these issues, attributing them to tokenization, and consider the ideal scenario of eli...
https://www.youtube.com/watch?v=zduSFxRajkE
YouTube
Let's build the GPT Tokenizer
The Tokenizer is a necessary and pervasive component of Large Language Models (LLMs), where it translates between strings and tokens (text chunks). Tokenizers are a completely separate stage of the LLM pipeline: they have their own training sets, training…
Using IPython Jupyter Magic Commands to Improve the Notebook Experience
A post on creating a custom IPython Jupyter Magic command.
https://towardsdatascience.com/using-ipython-jupyter-magic-commands-to-improve-the-notebook-experience-f2c870cab356
A post on creating a custom IPython Jupyter Magic command.
https://towardsdatascience.com/using-ipython-jupyter-magic-commands-to-improve-the-notebook-experience-f2c870cab356
Medium
Using IPython Jupyter Magic Commands to Improve the Notebook Experience
A post on creating a custom IPython Jupyter Magic command
explodinggradients / ragas
Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
https://github.com/explodinggradients/ragas
Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
https://github.com/explodinggradients/ragas
GitHub
GitHub - explodinggradients/ragas: Supercharge Your LLM Application Evaluations 🚀
Supercharge Your LLM Application Evaluations 🚀. Contribute to explodinggradients/ragas development by creating an account on GitHub.
OS-Copilot
An self-improving embodied conversational agent seamlessly integrated into the operating system to automate our daily tasks.
https://github.com/OS-Copilot/FRIDAY
An self-improving embodied conversational agent seamlessly integrated into the operating system to automate our daily tasks.
https://github.com/OS-Copilot/FRIDAY
GitHub
GitHub - OS-Copilot/OS-Copilot: An self-improving embodied conversational agent seamlessly integrated into the operating system…
An self-improving embodied conversational agent seamlessly integrated into the operating system to automate our daily tasks. - GitHub - OS-Copilot/OS-Copilot: An self-improving embodied conversati...
Note Map: Effortlessly organize, visualize and chat about textual notes. Search, chat and brainstorm ideas with ease.
https://github.com/SudoACoder/note_map
https://github.com/SudoACoder/note_map
GitHub
GitHub - SudoACoder/note_map: Note Map: Effortlessly organize, visualize and chat about textual notes. Search, chat and brainstorm…
Note Map: Effortlessly organize, visualize and chat about textual notes. Search, chat and brainstorm ideas with ease. - GitHub - SudoACoder/note_map: Note Map: Effortlessly organize, visualize and...
So Google's Gemini Doesn't Like Python Programming and Sanskrit?
https://new.pythonforengineers.com/blog/so-evidently/
https://new.pythonforengineers.com/blog/so-evidently/
Python for Engineers
So Google's Gemini Doesn't Like Python Programming and Sanskrit?
I have been playing around with Googles Gemini Pro.
Recently, I wanted to write a blog on Python's decorators and wanted to get some ideas for practical projects I could build with them. Tried GPT4 first, it gave me the standard "log analyser" that all blogs…
Recently, I wanted to write a blog on Python's decorators and wanted to get some ideas for practical projects I could build with them. Tried GPT4 first, it gave me the standard "log analyser" that all blogs…
uv
An extremely fast Python package installer and resolver, written in Rust. Here is a
https://github.com/astral-sh/uv
An extremely fast Python package installer and resolver, written in Rust. Here is a
https://github.com/astral-sh/uv
GitHub
GitHub - astral-sh/uv: An extremely fast Python package and project manager, written in Rust.
An extremely fast Python package and project manager, written in Rust. - astral-sh/uv
minbpe
Minimal, clean, code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
https://github.com/karpathy/minbpe
Minimal, clean, code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
https://github.com/karpathy/minbpe
GitHub
GitHub - karpathy/minbpe: Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. - karpathy/minbpe
Python Dependencies Are Fixable
The article critiques the current state of Python's dependency management, emphasizing the need for better defaults and user experience. Drawing parallels with Golang's successful design, the author advocates for a shift in mentality within the Pypa ecosystem to improve the default behavior of tools like Pip and suggests exploring alternatives if necessary.
https://matduggan.com/everyone-is-wrong-but-you/
The article critiques the current state of Python's dependency management, emphasizing the need for better defaults and user experience. Drawing parallels with Golang's successful design, the author advocates for a shift in mentality within the Pypa ecosystem to improve the default behavior of tools like Pip and suggests exploring alternatives if necessary.
https://matduggan.com/everyone-is-wrong-but-you/
matduggan.com
Python Dependencies Are Fixable
I like Python. I've had a lot of success with it on projects large and small. It is fast enough for most of the things I need and when it isn't, migrating from it to a more performant language isn't challenging. The depth of the standard library has been…
A completely free and open-source GitHub Copilot-like Project With VS Code extension.
CodeXpert is your coding companion, providing advanced language models and a privacy-centric, open-source environment for an effortless coding experience.
https://github.com/SudoACoder/CodeXpert
CodeXpert is your coding companion, providing advanced language models and a privacy-centric, open-source environment for an effortless coding experience.
https://github.com/SudoACoder/CodeXpert
GitHub
GitHub - SudoACoder/CodeXpert: Code Xpert: A completely free and open-source GitHub Copilot-like Project With VS Code extension.
Code Xpert: A completely free and open-source GitHub Copilot-like Project With VS Code extension. - SudoACoder/CodeXpert
justpath
Inspect and refine PATH environment variable on both Windows and Linux.
https://github.com/epogrebnyak/justpath
Inspect and refine PATH environment variable on both Windows and Linux.
https://github.com/epogrebnyak/justpath
GitHub
GitHub - epogrebnyak/justpath: Inspect and refine PATH environment variable on Windows, Linux and MacOS.
Inspect and refine PATH environment variable on Windows, Linux and MacOS. - epogrebnyak/justpath
Modguard - a lightweight python tool for enforcing modular design
https://www.reddit.com/r/Python/comments/1aqtjyx/modguard_a_lightweight_python_tool_for_enforcing/
https://www.reddit.com/r/Python/comments/1aqtjyx/modguard_a_lightweight_python_tool_for_enforcing/
Reddit
From the Python community on Reddit: Modguard - a lightweight python tool for enforcing modular design
Explore this post and more from the Python community
frappe / frappe
Low code web framework for real world applications, in Python and Javascript
https://github.com/frappe/frappe
Low code web framework for real world applications, in Python and Javascript
https://github.com/frappe/frappe
GitHub
GitHub - frappe/frappe: Low code web framework for real world applications, in Python and Javascript
Low code web framework for real world applications, in Python and Javascript - frappe/frappe
AutoPrompt
Auto Prompt is a prompt optimization framework designed to enhance and perfect your prompts for real-world use cases.
https://github.com/Eladlev/AutoPrompt
Auto Prompt is a prompt optimization framework designed to enhance and perfect your prompts for real-world use cases.
https://github.com/Eladlev/AutoPrompt
GitHub
GitHub - Eladlev/AutoPrompt: A framework for prompt tuning using Intent-based Prompt Calibration
A framework for prompt tuning using Intent-based Prompt Calibration - GitHub - Eladlev/AutoPrompt: A framework for prompt tuning using Intent-based Prompt Calibration