doing something

Sail – Built in Rust, 4x Faster Than Spark, 94% Lower Costs, PySpark-Compatible

GitHub - lakehq/sail: Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute…

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads. - lakehq/sail

97 views09:42

doing something

Forwarded from Yehor Smoliakov

https://twitter.com/jramapuram/status/1833137053766177031

86 views14:15

doing something

Forwarded from Hacker News

Tutorial on diffusion models for imaging and vision (Score: 150+ in 11 hours)

Link: https://readhacker.news/s/6ekYF
Comments: https://readhacker.news/c/6ekYF

arXiv.org

Tutorial on Diffusion Models for Imaging and Vision

The astonishing growth of generative tools in recent years has empowered many exciting applications in text-to-image generation and text-to-video generation. The underlying principle behind these...

86 views08:24

Read 12+ Comments

doing something

Useful packages:

https://github.com/arokettu/composer-license-manager
https://github.com/composer/pcre
https://github.com/clementtalleu/php-redis-om

#php #opensource

98 views12:31

doing something

Just use a faster tokenizer in transformers

https://github.com/egorsmkv/optimized-whisper/issues/2

#asr #ai

281 views13:15

doing something

https://github.com/huggingface/transformers/pull/33141

#hqq #ai #quantization

GitHub

Hqq serialization by mobicham · Pull Request #33141 · huggingface/transformers

Follow-up to #32379
The goal of this PR is to add full support to save/load HQQ-quantized models directly in transformers. So far, serialization was done on the hqq-lib side via the .pt format whic...

103 views13:22

doing something

Scraping website with LLMs

https://jina.ai/news/reader-lm-small-language-models-for-cleaning-and-converting-html-to-markdown/?nocache=1

#llm #nlp #ai

jina.ai

Reader-LM: Small Language Models for Cleaning and Converting HTML to Markdown

Reader-LM-0.5B and Reader-LM-1.5B are two novel small language models inspired by Jina Reader, designed to convert raw, noisy HTML from the open web into clean markdown.

140 views16:31

doing something

Forwarded from Feed-Master

This Week in Rust 564

this-week-in-rust.org

This Week in Rust 564 · This Week in Rust

109 views07:29

doing something

Scraping website with LLMs https://jina.ai/news/reader-lm-small-language-models-for-cleaning-and-converting-html-to-markdown/?nocache=1 #llm #nlp #ai

Wrote a colab to test this model:

https://colab.research.google.com/drive/1GuCG-3r0mhEkN87fKuxYz6ZthwsJOhwN?usp=sharing

#llm #ai

Google

Convert HTML to Markdown using VLLM.ipynb

Colab notebook

110 views15:52

doing something

Hacker News

Tutorial on diffusion models for imaging and vision (Score: 150+ in 11 hours) Link: https://readhacker.news/s/6ekYF Comments: https://readhacker.news/c/6ekYF

https://keras.io/examples/generative/ddim/

#diffusion

keras.io

Keras documentation: Denoising Diffusion Implicit Models

100 views17:23

doing something

https://github.com/HJ-Ok/AudioBERT

#ai

GitHub

GitHub - HJ-Ok/AudioBERT: AudioBERT 📢 : Audio Knowledge Augmented Language Model (ICASSP 2025)

AudioBERT 📢 : Audio Knowledge Augmented Language Model (ICASSP 2025) - HJ-Ok/AudioBERT

96 views08:50

doing something

https://github.com/mikel-brostrom/boxmot

#ai #cv

GitHub

GitHub - mikel-brostrom/boxmot: BoxMOT: Pluggable Python and C++ SOTA multi-object tracking modules with support for axis-aligned…

BoxMOT: Pluggable Python and C++ SOTA multi-object tracking modules with support for axis-aligned and oriented bounding boxes - mikel-brostrom/boxmot

100 views20:30

doing something

Nice library to read videos https://github.com/dmlc/decord #cv #ai

> Note that only CPU versions are provided with PYPI now. Please build from source to enable GPU acclerator.

🙃

84 views10:52

doing something

> Note that only CPU versions are provided with PYPI now. Please build from source to enable GPU acclerator. 🙃

Building like this

#cv

77 views11:42

doing something

Building like this #cv

CPU vs. GPU decoding + bridging to torch

w/o bridging:

GPU: 12.21 s
CPU: 21.51 s

#cv #decord

453 viewsedited 11:52

doing something

Forwarded from Feed-Master

Let's build and optimize a Rust extension for Python

Python⇒Speed

Let’s build and optimize a Rust extension for Python

Python code too slow? You can quickly create a Rust extension to speed it up.

72 views13:40

doing something

https://github.com/mainmatter/100-exercises-to-learn-rust

#rust

GitHub

GitHub - mainmatter/100-exercises-to-learn-rust: A self-paced course to learn Rust, one exercise at a time.

A self-paced course to learn Rust, one exercise at a time. - mainmatter/100-exercises-to-learn-rust

72 views16:28

doing something

Forwarded from Feed-Master

Show HN: RustyNum – Fast Rust-Powered NumPy Alternative

GitHub

GitHub - IgorSusmelj/rustynum: RustyNum: A NumPy Alternative powered by Rust’s Portable SIMD

RustyNum: A NumPy Alternative powered by Rust’s Portable SIMD - IgorSusmelj/rustynum

74 views21:11

doing something

An example how you can use R code with modern Gradio app to do better apps

https://github.com/egorsmkv/r-with-gradio

#gradio #r #docker

414 views09:14

doing something

Fast image processing

- https://github.com/libvips/libvips
- https://github.com/libvips/pyvips

#cv #c #python

GitHub

GitHub - libvips/libvips: A fast image processing library with low memory needs.

A fast image processing library with low memory needs. - libvips/libvips

71 views16:21

About

Blog

Apps

Platform