This Python tool looks super useful to crawl websites and convert data into LLM-ready markdown or structured data.

I find myself doing this a lot and most of the time it is a tedious effort. Great to see a service that does data extraction catered for LLM-based pipelines.

https://github.com/mendableai/firecrawl


#framework
#python
#Python_tricks
#DataScience

🆔 @Python4all_pro

Dancing with Python: Learn to code with Python and Quantum Computing
Robert S. Sutor
2022

Dancing with Python will help you get hands-on with Python and quantum computing. This will help you learn how to work with numbers, strings, collections, iterators, and files.
The book goes beyond functions and classes and teaches you to use Python and Qiskit to create logic gates and circuits for classical and quantum computing. Learn how quantum extends traditional methods using Grover's search algorithm and the code that implements it.

#python #pdf


🆔 @Python4all_pro

🖥 Check Internet speed using Python


#python #programming
#code

🆔 @Python4all_pro

🖥 Email Archiver —is an efficient Python tool for archiving emails across multiple accounts.

It allows you to add, update, and delete accounts, search through archived emails, and view detailed information about each message.


https://github.com/bandundu/email-archiver


#python
#Python_tricks


🆔 @Python4all_pro

🖥 Stay Undetected While Scraping the Web

How to Easily Send HTTP Requests That Simulate a Browser

Simulate browser data when scraping websites to remain undetected
- Mask TLS request fingerprints using the curl_cffi package
- Automatically extract metadata from HTML responses, including page title, description, author and more.
- Easily convert HTML responses to lxml and BeautifulSoup objects.


pip install stealth_requests

📌 Github


#python
#Python_tricks


🆔 @Python4all_pro

🖥 reCAPTCHAv2

A Python tool that solves 100% of the problems and beats the success rates of previous tools, which ranged from 68% to 71%.

repo: https://github.com/aplesner/Breaking-reCAPTCHAv2

abs: https://arxiv.org/abs/2409.08831


#python
#Python_tricks


🆔 @Python4all_pro

📸 Kazam2: Linux screen recording software

Kazam 2.0 is a versatile Python tool for screen recording, broadcasting, and optical character recognition (OCR).


pip install -U kazam

▪Github


#python
#Python_tricks


🆔 @Python4all_pro

🖥 Create a table using Python


#python
#Python_tricks
#code

🆔 @Python4all_pro

Convert CSV to JSON using Python


#python
#Python_tricks
#code

🆔 @Python4all_pro

🖥 DualStyleGAN

A neural network in Python for creating portraits in different styles from photographs of people

git clone https://github.com/williamyang1991/DualStyleGAN.git
cd DualStyleGAN


▪Github: https://github.com/williamyang1991/DualStyleGAN

▪Paper: https://arxiv.org/abs/2203.13248v1

▪Video: https://www.youtube.com/watch?v=scZTu77jixI

▪Project: https://www.mmlab-ntu.com/project/dualstylegan/

▪Dataset: https://paperswithcode.com/dataset/ffhq



#python
#Python_tricks


🆔 @Python4all_pro

Convert PDFs to Excel Files Using Python


#python
#Python_tricks
#code

🆔 @Python4all_pro

🖥 ده کتابخانه کوچک پایتون برای کار با داده ها

• PyGWalker: PyGWalker simplifies the workflow for analyzing and visualizing data in Jupyter Notebook by turning a pandas data frame (or polars data frame) into a Tableau-style user interface for visual exploration.

• SciencePlots: Creates professional matplotlib plots for presentations, research papers, and more.

• CleverCSV: Eliminates parsing errors when reading CSV files with Pandas.
•
• Fastparquet: Speeds up pandas I/O by 5x.

• Bottleneck: Speeds up NumPy methods by 25x. Especially if the array has NaN values.

• Multipledispatch: Provides methods for overloading functions in Python.

• Aquarel: Additional matplotlib plot styles.

• Modelstore: A library of machine learning models for better tracking of model performance.

• Pigeon: Helps you annotate data with mouse clicks in Jupyter notebook.

• Nbcommands: Helps you easily search code in Jupyter notebooks instead of doing it manually.

📌More details with code examples


#python
#Python_tricks
#library
#علم_داده
🆔 @Python4all_pro

🖥 تبدیل ارز با استفاده از پایتون



#python
#Python_tricks
#code

🆔 @Python4all_pro

"LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance."

https://github.com/ModelTC/lightllm


#python
#Python_tricks


🆔 @Python4all_pro

🖥 کتابخانه draw_scatter - به شما امکان می دهد توزیع مورد نظر را در پایتون رسم کنید

اگر به خوشه هایی با شکل دلخواه نیاز دارید (به عنوان مثال، می خواهید الگوریتم های مختلف خوشه بندی را با هم مقایسه کنید) - مشکلی نیست، برای این کار کتابخانه drawdata ( یه ابزار قدرتمنده که کمک می‌کنه با خلاقیت بیشتری داده‌های سفارسی تولید کنید و مدل‌هاش رو تست کنید . حتی می‌تونید داده‌هایی که ساختید رو به فرمت CSV یا JSON دانلود کنید و برای استفاده‌های بعدی ذخیره کنید) و تابع draw_scatter() وجود دارد.

# cell 1
import pandas as pd
import seaborn as sns
from drawdata import draw_scatter
draw_scatter()


# cell 2
df = pd.read_clipboard(sep=',')
sns.scatterplot(data=df, x='x', y='y', hue='z')

#library #Python
🆔 @Python4all_pro

🖥 تکنولوژی جدید در برنامه نویسی پایتون – LangChain

؛LangChain یک کتابخانه قدرتمند است که ایجاد برنامه های کاربردی بر اساس مدل های زبان را آسان می کند و به شما امکان می دهد اجزای مختلفی را ادغام کنید: از کار با API ها تا پردازش متن و ایجاد  گفتگوهای پویا تا LLM از طریق API.



💡 با LangChain می توانید به راحتی دستیار، چت ربات و موارد دیگر ایجاد کنید.

LangChain


#python
#Python_tricks


🆔 @Python4all_pro