Building RAG-based LLM Applications for Production (Part 1)

In this guide, we will learn how to develop and productionize a retrieval augmented generation (RAG) based LLM application, with a focus on scale, evaluation and routing.

https://www.anyscale.com/blog/a-comprehensive-guide-for-building-rag-based-llm-applications-part-1

Logparser

Logparser provides a machine learning toolkit and benchmarks for automated log parsing, which is a crucial step for structured log analytics

https://github.com/logpai/logparser

QuasiQueue

QuasiQueue is a MultiProcessing library for Python that makes it super easy to have long running MultiProcess jobs. QuasiQueue handles process creation and cleanup, signal management, cross process communication, and all the other garbage that makes people hate dealing with multiprocessing.

https://github.com/tedivm/quasiqueue

HTTP-Shell

MultiPlatform HTTP Reverse Shell.

https://github.com/JoelGMSec/HTTP-Shell

EvoDiff

Generation of protein sequences and evolutionary alignments via discrete diffusion models.

https://github.com/microsoft/evodiff

Compiling ML models to C for fun

ML models can be compiled to graphs, which can be traversed to perform forward and backward passes. This approach can improve performance and make it easier to debug ML models.

https://bernsteinbear.com/blog/compiling-ml-models/

Temporian

Temporian is a Python library for feature engineering and data augmentation of temporal data (e.g. time-series, transactions) in machine learning applications.

https://github.com/google/temporian

Simulate the Monty Hall problem in Python

Use Python to solve this classic probability puzzle that has stumped mathematicians and Nobel Prize winners!

https://www.dataschool.io/python-probability-simulation/

PyLLMCore

A pythonic library providing light-weighted interface with LLMs

https://github.com/paschembri/py-llm-core

KillianLucas / open-interpreter

OpenAI's Code Interpreter in your terminal, running locally

https://github.com/KillianLucas/open-interpreter

Medical_Intake

Automated pipeline for medical intake, diagnosis, tests, etc.

https://github.com/daveshap/Medical_Intake

Building A RisingWave Connector for Django ORM

Ever wanted to connect a streaming database to Django ORM. Learn how with Django and RisingWave.

https://bas.codes/posts/django-risingwave

pythex

pythex is a quick way to test your Python regular expressions.

https://pythex.org/

rustworkx

A high performance Python graph library implemented in Rust.

https://github.com/Qiskit/rustworkx

OpenBMB / ChatDev

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)

https://github.com/OpenBMB/ChatDev