Vendor-agnostic ML inference on production edge devices
https://www.reddit.com/r/programming/comments/1v8wl5t/vendoragnostic_ml_inference_on_production_edge/
<!-- SC_OFF -->I work on PostSlate, a video editing tool, and this comes out of our own work. We run ML models on-device, face detection and embedding among other things, which means we can't assume anything about the user's GPU. NVIDIA discrete, AMD, Intel integrated, Apple Silicon, all of it. That rules out CUDA immediately, we needed one backend that runs everywhere. We landed on ncnn's Vulkan backend. Numbers on a 4070, fp16: ArcFace R50 (face embedding): 30 ms on ONNX CPU → 3 ms on ncnn Vulkan SCRFD (face detection): 25 ms → 2.5 ms Model size: ArcFace 174 MB (ONNX fp32) → 87 MB (ncnn fp16 weight storage) Of course the real speedup comes from offloading compute to the GPU, but this wouldn't be possible without the power of Vulkan. The speed wasn't even the deciding factor, it's that Vulkan drivers already exist on every machine we ship to. This means that we don't have to force the user to download a specific runtime and no vendor-specific installs. Full writeup with the rest of the numbers: https://getpostslate.com/blog/faster-local-inference <!-- SC_ON --> submitted by /u/ppchaos (https://www.reddit.com/user/ppchaos)
[link] (https://getpostslate.com/blog/faster-local-inference) [comments] (https://www.reddit.com/r/programming/comments/1v8wl5t/vendoragnostic_ml_inference_on_production_edge/)
https://www.reddit.com/r/programming/comments/1v8wl5t/vendoragnostic_ml_inference_on_production_edge/
<!-- SC_OFF -->I work on PostSlate, a video editing tool, and this comes out of our own work. We run ML models on-device, face detection and embedding among other things, which means we can't assume anything about the user's GPU. NVIDIA discrete, AMD, Intel integrated, Apple Silicon, all of it. That rules out CUDA immediately, we needed one backend that runs everywhere. We landed on ncnn's Vulkan backend. Numbers on a 4070, fp16: ArcFace R50 (face embedding): 30 ms on ONNX CPU → 3 ms on ncnn Vulkan SCRFD (face detection): 25 ms → 2.5 ms Model size: ArcFace 174 MB (ONNX fp32) → 87 MB (ncnn fp16 weight storage) Of course the real speedup comes from offloading compute to the GPU, but this wouldn't be possible without the power of Vulkan. The speed wasn't even the deciding factor, it's that Vulkan drivers already exist on every machine we ship to. This means that we don't have to force the user to download a specific runtime and no vendor-specific installs. Full writeup with the rest of the numbers: https://getpostslate.com/blog/faster-local-inference <!-- SC_ON --> submitted by /u/ppchaos (https://www.reddit.com/user/ppchaos)
[link] (https://getpostslate.com/blog/faster-local-inference) [comments] (https://www.reddit.com/r/programming/comments/1v8wl5t/vendoragnostic_ml_inference_on_production_edge/)
Dependency Cultures - Richard Feldman
https://www.reddit.com/r/programming/comments/1v8ynjn/dependency_cultures_richard_feldman/
<!-- SC_OFF -->Excellent talk by Richard Feldman about how different programming communities approach dependencies. <!-- SC_ON --> submitted by /u/isaacvando (https://www.reddit.com/user/isaacvando)
[link] (https://youtu.be/E82ly38YEEQ) [comments] (https://www.reddit.com/r/programming/comments/1v8ynjn/dependency_cultures_richard_feldman/)
https://www.reddit.com/r/programming/comments/1v8ynjn/dependency_cultures_richard_feldman/
<!-- SC_OFF -->Excellent talk by Richard Feldman about how different programming communities approach dependencies. <!-- SC_ON --> submitted by /u/isaacvando (https://www.reddit.com/user/isaacvando)
[link] (https://youtu.be/E82ly38YEEQ) [comments] (https://www.reddit.com/r/programming/comments/1v8ynjn/dependency_cultures_richard_feldman/)
Finding bugs in Raft implementations
https://www.reddit.com/r/programming/comments/1v90kmd/finding_bugs_in_raft_implementations/
submitted by /u/f311a (https://www.reddit.com/user/f311a)
[link] (https://antithesis.com/blog/2026/finding-bugs-in-raft-implementations/) [comments] (https://www.reddit.com/r/programming/comments/1v90kmd/finding_bugs_in_raft_implementations/)
https://www.reddit.com/r/programming/comments/1v90kmd/finding_bugs_in_raft_implementations/
submitted by /u/f311a (https://www.reddit.com/user/f311a)
[link] (https://antithesis.com/blog/2026/finding-bugs-in-raft-implementations/) [comments] (https://www.reddit.com/r/programming/comments/1v90kmd/finding_bugs_in_raft_implementations/)
A shell colon does nothing. Use it anyway. | Filip Roséen
https://www.reddit.com/r/programming/comments/1v90z1b/a_shell_colon_does_nothing_use_it_anyway_filip/
submitted by /u/f311a (https://www.reddit.com/user/f311a)
[link] (https://refp.se/articles/your-shell-and-the-magic-colon) [comments] (https://www.reddit.com/r/programming/comments/1v90z1b/a_shell_colon_does_nothing_use_it_anyway_filip/)
https://www.reddit.com/r/programming/comments/1v90z1b/a_shell_colon_does_nothing_use_it_anyway_filip/
submitted by /u/f311a (https://www.reddit.com/user/f311a)
[link] (https://refp.se/articles/your-shell-and-the-magic-colon) [comments] (https://www.reddit.com/r/programming/comments/1v90z1b/a_shell_colon_does_nothing_use_it_anyway_filip/)
Inside Zig's Incremental Compilation
https://www.reddit.com/r/programming/comments/1v93h07/inside_zigs_incremental_compilation/
submitted by /u/f311a (https://www.reddit.com/user/f311a)
[link] (https://mlugg.co.uk/posts/incremental-compilation-internals/) [comments] (https://www.reddit.com/r/programming/comments/1v93h07/inside_zigs_incremental_compilation/)
https://www.reddit.com/r/programming/comments/1v93h07/inside_zigs_incremental_compilation/
submitted by /u/f311a (https://www.reddit.com/user/f311a)
[link] (https://mlugg.co.uk/posts/incremental-compilation-internals/) [comments] (https://www.reddit.com/r/programming/comments/1v93h07/inside_zigs_incremental_compilation/)
The Elevator Glitch: How One Function Destroyed Public Lobbies in CoD4
https://www.reddit.com/r/programming/comments/1v94mgb/the_elevator_glitch_how_one_function_destroyed/
<!-- SC_OFF -->Walk with me inside one of the most influential game's code and discover the secret of elevators! Turns out the bug comes down to a single line buried in the engine's collision code. Went through the decompiled source (thanks to KisakCOD) and traced the whole thing back. Let me know your thoughts! ✨ <!-- SC_ON --> submitted by /u/Rex109 (https://www.reddit.com/user/Rex109)
[link] (https://www.youtube.com/watch?v=U0kAwjFuxoo) [comments] (https://www.reddit.com/r/programming/comments/1v94mgb/the_elevator_glitch_how_one_function_destroyed/)
https://www.reddit.com/r/programming/comments/1v94mgb/the_elevator_glitch_how_one_function_destroyed/
<!-- SC_OFF -->Walk with me inside one of the most influential game's code and discover the secret of elevators! Turns out the bug comes down to a single line buried in the engine's collision code. Went through the decompiled source (thanks to KisakCOD) and traced the whole thing back. Let me know your thoughts! ✨ <!-- SC_ON --> submitted by /u/Rex109 (https://www.reddit.com/user/Rex109)
[link] (https://www.youtube.com/watch?v=U0kAwjFuxoo) [comments] (https://www.reddit.com/r/programming/comments/1v94mgb/the_elevator_glitch_how_one_function_destroyed/)
Your Recursion Is Lying to You
https://www.reddit.com/r/programming/comments/1v99xvl/your_recursion_is_lying_to_you/
submitted by /u/fagnerbrack (https://www.reddit.com/user/fagnerbrack)
[link] (https://blog.gaborkoos.com/posts/2026-05-09-Your-Recursion-Is-Lying-to-You/) [comments] (https://www.reddit.com/r/programming/comments/1v99xvl/your_recursion_is_lying_to_you/)
https://www.reddit.com/r/programming/comments/1v99xvl/your_recursion_is_lying_to_you/
submitted by /u/fagnerbrack (https://www.reddit.com/user/fagnerbrack)
[link] (https://blog.gaborkoos.com/posts/2026-05-09-Your-Recursion-Is-Lying-to-You/) [comments] (https://www.reddit.com/r/programming/comments/1v99xvl/your_recursion_is_lying_to_you/)
Detection-as-Code in One GitHub Action with RSigma
https://www.reddit.com/r/programming/comments/1v9a099/detectionascode_in_one_github_action_with_rsigma/
submitted by /u/Happycodeine (https://www.reddit.com/user/Happycodeine)
[link] (https://mostafa.dev/detection-as-code-in-one-github-action-with-rsigma-0ebfb4c857fa?source=friends_link&sk=3bfa053c8011acf6b14caf57d50a783e) [comments] (https://www.reddit.com/r/programming/comments/1v9a099/detectionascode_in_one_github_action_with_rsigma/)
https://www.reddit.com/r/programming/comments/1v9a099/detectionascode_in_one_github_action_with_rsigma/
submitted by /u/Happycodeine (https://www.reddit.com/user/Happycodeine)
[link] (https://mostafa.dev/detection-as-code-in-one-github-action-with-rsigma-0ebfb4c857fa?source=friends_link&sk=3bfa053c8011acf6b14caf57d50a783e) [comments] (https://www.reddit.com/r/programming/comments/1v9a099/detectionascode_in_one_github_action_with_rsigma/)
What Every Programmer Should Know About Twists of Elliptic Curves
https://www.reddit.com/r/programming/comments/1vax1q4/what_every_programmer_should_know_about_twists_of/
submitted by /u/DataBaeBee (https://www.reddit.com/user/DataBaeBee)
[link] (https://leetarxiv.substack.com/p/twists-of-elliptic-curves) [comments] (https://www.reddit.com/r/programming/comments/1vax1q4/what_every_programmer_should_know_about_twists_of/)
https://www.reddit.com/r/programming/comments/1vax1q4/what_every_programmer_should_know_about_twists_of/
submitted by /u/DataBaeBee (https://www.reddit.com/user/DataBaeBee)
[link] (https://leetarxiv.substack.com/p/twists-of-elliptic-curves) [comments] (https://www.reddit.com/r/programming/comments/1vax1q4/what_every_programmer_should_know_about_twists_of/)
Stacked pull requests are now in public preview - GitHub Changelog
https://www.reddit.com/r/programming/comments/1vayhxm/stacked_pull_requests_are_now_in_public_preview/
submitted by /u/tomzorzhu (https://www.reddit.com/user/tomzorzhu)
[link] (https://github.blog/changelog/2026-07-30-stacked-pull-requests-are-now-in-public-preview/) [comments] (https://www.reddit.com/r/programming/comments/1vayhxm/stacked_pull_requests_are_now_in_public_preview/)
https://www.reddit.com/r/programming/comments/1vayhxm/stacked_pull_requests_are_now_in_public_preview/
submitted by /u/tomzorzhu (https://www.reddit.com/user/tomzorzhu)
[link] (https://github.blog/changelog/2026-07-30-stacked-pull-requests-are-now-in-public-preview/) [comments] (https://www.reddit.com/r/programming/comments/1vayhxm/stacked_pull_requests_are_now_in_public_preview/)
Manual reification on the JVM
https://www.reddit.com/r/programming/comments/1vb18kc/manual_reification_on_the_jvm/
submitted by /u/farnoy (https://www.reddit.com/user/farnoy)
[link] (https://farnoy.dev/posts/manual-reification-on-the-jvm) [comments] (https://www.reddit.com/r/programming/comments/1vb18kc/manual_reification_on_the_jvm/)
https://www.reddit.com/r/programming/comments/1vb18kc/manual_reification_on_the_jvm/
submitted by /u/farnoy (https://www.reddit.com/user/farnoy)
[link] (https://farnoy.dev/posts/manual-reification-on-the-jvm) [comments] (https://www.reddit.com/r/programming/comments/1vb18kc/manual_reification_on_the_jvm/)
The Mystery on DuckLake: A Time-Travelling Whodunit Story
https://www.reddit.com/r/programming/comments/1vb8u5y/the_mystery_on_ducklake_a_timetravelling_whodunit/
submitted by /u/pdoherty926 (https://www.reddit.com/user/pdoherty926)
[link] (https://peterdohertys.website/blog-posts/the-mystery-on-duck-lake.html) [comments] (https://www.reddit.com/r/programming/comments/1vb8u5y/the_mystery_on_ducklake_a_timetravelling_whodunit/)
https://www.reddit.com/r/programming/comments/1vb8u5y/the_mystery_on_ducklake_a_timetravelling_whodunit/
submitted by /u/pdoherty926 (https://www.reddit.com/user/pdoherty926)
[link] (https://peterdohertys.website/blog-posts/the-mystery-on-duck-lake.html) [comments] (https://www.reddit.com/r/programming/comments/1vb8u5y/the_mystery_on_ducklake_a_timetravelling_whodunit/)
JEP 401: Value Objects And JEP 539: Strict Field Initialization Merged Into JDK
https://www.reddit.com/r/programming/comments/1vbocji/jep_401_value_objects_and_jep_539_strict_field/
submitted by /u/joemwangi (https://www.reddit.com/user/joemwangi)
[link] (https://github.com/openjdk/jdk/commit/cc278dbb8a1ca0754d5842708b9029441055d361) [comments] (https://www.reddit.com/r/programming/comments/1vbocji/jep_401_value_objects_and_jep_539_strict_field/)
https://www.reddit.com/r/programming/comments/1vbocji/jep_401_value_objects_and_jep_539_strict_field/
submitted by /u/joemwangi (https://www.reddit.com/user/joemwangi)
[link] (https://github.com/openjdk/jdk/commit/cc278dbb8a1ca0754d5842708b9029441055d361) [comments] (https://www.reddit.com/r/programming/comments/1vbocji/jep_401_value_objects_and_jep_539_strict_field/)
Methinks it is a weasel
https://www.reddit.com/r/programming/comments/1vbofod/methinks_it_is_a_weasel/
submitted by /u/_fourzerofour (https://www.reddit.com/user/_fourzerofour)
[link] (https://diatone.net/methinks) [comments] (https://www.reddit.com/r/programming/comments/1vbofod/methinks_it_is_a_weasel/)
https://www.reddit.com/r/programming/comments/1vbofod/methinks_it_is_a_weasel/
submitted by /u/_fourzerofour (https://www.reddit.com/user/_fourzerofour)
[link] (https://diatone.net/methinks) [comments] (https://www.reddit.com/r/programming/comments/1vbofod/methinks_it_is_a_weasel/)
Canvas path animations: Animating anything along a curve with Canvas + SVG
https://www.reddit.com/r/programming/comments/1vbogt3/canvas_path_animations_animating_anything_along_a/
submitted by /u/ykadosh (https://www.reddit.com/user/ykadosh)
[link] (https://yoavik.com/posts/canvas-path-animation) [comments] (https://www.reddit.com/r/programming/comments/1vbogt3/canvas_path_animations_animating_anything_along_a/)
https://www.reddit.com/r/programming/comments/1vbogt3/canvas_path_animations_animating_anything_along_a/
submitted by /u/ykadosh (https://www.reddit.com/user/ykadosh)
[link] (https://yoavik.com/posts/canvas-path-animation) [comments] (https://www.reddit.com/r/programming/comments/1vbogt3/canvas_path_animations_animating_anything_along_a/)
On Type Inference
https://www.reddit.com/r/programming/comments/1vbp0vm/on_type_inference/
submitted by /u/radekmie (https://www.reddit.com/user/radekmie)
[link] (https://radekmie.dev/blog/on-type-inference/) [comments] (https://www.reddit.com/r/programming/comments/1vbp0vm/on_type_inference/)
https://www.reddit.com/r/programming/comments/1vbp0vm/on_type_inference/
submitted by /u/radekmie (https://www.reddit.com/user/radekmie)
[link] (https://radekmie.dev/blog/on-type-inference/) [comments] (https://www.reddit.com/r/programming/comments/1vbp0vm/on_type_inference/)
Pwnd Blaster: Hacking your PC using your speaker without ever touching it
https://www.reddit.com/r/programming/comments/1vc25gi/pwnd_blaster_hacking_your_pc_using_your_speaker/
submitted by /u/fagnerbrack (https://www.reddit.com/user/fagnerbrack)
[link] (https://blog.nns.ee/2026/06/03/katana-badusb/) [comments] (https://www.reddit.com/r/programming/comments/1vc25gi/pwnd_blaster_hacking_your_pc_using_your_speaker/)
https://www.reddit.com/r/programming/comments/1vc25gi/pwnd_blaster_hacking_your_pc_using_your_speaker/
submitted by /u/fagnerbrack (https://www.reddit.com/user/fagnerbrack)
[link] (https://blog.nns.ee/2026/06/03/katana-badusb/) [comments] (https://www.reddit.com/r/programming/comments/1vc25gi/pwnd_blaster_hacking_your_pc_using_your_speaker/)
The Bedrock of Software Design
https://www.reddit.com/r/programming/comments/1vcl5bj/the_bedrock_of_software_design/
<!-- SC_OFF -->I drafted this post years ago but didn’t finish it until now. The concept I write about has shaped the way I design software more than anything else, and I believe every software engineer should be introduced to it early in their career. P.S. I don’t want the title to come across as clickbait: the post is about ADT. <!-- SC_ON --> submitted by /u/alex35mil (https://www.reddit.com/user/alex35mil)
[link] (https://alex.draftist.io/blog/the-bedrock-of-software-design-ycqvcedsj) [comments] (https://www.reddit.com/r/programming/comments/1vcl5bj/the_bedrock_of_software_design/)
https://www.reddit.com/r/programming/comments/1vcl5bj/the_bedrock_of_software_design/
<!-- SC_OFF -->I drafted this post years ago but didn’t finish it until now. The concept I write about has shaped the way I design software more than anything else, and I believe every software engineer should be introduced to it early in their career. P.S. I don’t want the title to come across as clickbait: the post is about ADT. <!-- SC_ON --> submitted by /u/alex35mil (https://www.reddit.com/user/alex35mil)
[link] (https://alex.draftist.io/blog/the-bedrock-of-software-design-ycqvcedsj) [comments] (https://www.reddit.com/r/programming/comments/1vcl5bj/the_bedrock_of_software_design/)
The History of Pets vs Cattle and How to Use the Analogy Properly
https://www.reddit.com/r/programming/comments/1vcsm8w/the_history_of_pets_vs_cattle_and_how_to_use_the/
submitted by /u/fagnerbrack (https://www.reddit.com/user/fagnerbrack)
[link] (https://cloudscaling.com/blog/cloud-computing/the-history-of-pets-vs-cattle/) [comments] (https://www.reddit.com/r/programming/comments/1vcsm8w/the_history_of_pets_vs_cattle_and_how_to_use_the/)
https://www.reddit.com/r/programming/comments/1vcsm8w/the_history_of_pets_vs_cattle_and_how_to_use_the/
submitted by /u/fagnerbrack (https://www.reddit.com/user/fagnerbrack)
[link] (https://cloudscaling.com/blog/cloud-computing/the-history-of-pets-vs-cattle/) [comments] (https://www.reddit.com/r/programming/comments/1vcsm8w/the_history_of_pets_vs_cattle_and_how_to_use_the/)
Variations on a theme of sorting
https://www.reddit.com/r/programming/comments/1vd5q3j/variations_on_a_theme_of_sorting/
<!-- SC_OFF -->Semisort Reorder an array so that identical keys are grouped contiguously Keys do not need to be in sorted order Stable Partition
Group by predicate, preserve order K-smallest selection, single Get the k-smallest key from the array K-smallest selection, list Get the k-smallest key from the array, and everything smaller (or equal), in any order K-smallest selection, list sorted Get the k-smallest key from the array, and everything smaller (or equal), in sorted order <!-- SC_ON --> submitted by /u/Grouchy-Trade-7250 (https://www.reddit.com/user/Grouchy-Trade-7250)
[link] (https://jshun.csail.mit.edu/6506-s24/lectures/lecture6-2.pdf) [comments] (https://www.reddit.com/r/programming/comments/1vd5q3j/variations_on_a_theme_of_sorting/)
https://www.reddit.com/r/programming/comments/1vd5q3j/variations_on_a_theme_of_sorting/
<!-- SC_OFF -->Semisort Reorder an array so that identical keys are grouped contiguously Keys do not need to be in sorted order Stable Partition
Group by predicate, preserve order K-smallest selection, single Get the k-smallest key from the array K-smallest selection, list Get the k-smallest key from the array, and everything smaller (or equal), in any order K-smallest selection, list sorted Get the k-smallest key from the array, and everything smaller (or equal), in sorted order <!-- SC_ON --> submitted by /u/Grouchy-Trade-7250 (https://www.reddit.com/user/Grouchy-Trade-7250)
[link] (https://jshun.csail.mit.edu/6506-s24/lectures/lecture6-2.pdf) [comments] (https://www.reddit.com/r/programming/comments/1vd5q3j/variations_on_a_theme_of_sorting/)
Quantum Computers May Put Internet Traffic at Risk. NIST Is Safeguarding Computers With New Standards.
https://www.reddit.com/r/programming/comments/1vd7jnr/quantum_computers_may_put_internet_traffic_at/
submitted by /u/donutloop (https://www.reddit.com/user/donutloop)
[link] (https://www.nist.gov/blogs/taking-measure/quantum-computers-may-put-internet-traffic-risk-nist-safeguarding-computers-new) [comments] (https://www.reddit.com/r/programming/comments/1vd7jnr/quantum_computers_may_put_internet_traffic_at/)
https://www.reddit.com/r/programming/comments/1vd7jnr/quantum_computers_may_put_internet_traffic_at/
submitted by /u/donutloop (https://www.reddit.com/user/donutloop)
[link] (https://www.nist.gov/blogs/taking-measure/quantum-computers-may-put-internet-traffic-risk-nist-safeguarding-computers-new) [comments] (https://www.reddit.com/r/programming/comments/1vd7jnr/quantum_computers_may_put_internet_traffic_at/)