Reddit Programming
197 subscribers
1.22K photos
127K links
I will send you newest post from subreddit /r/programming
Download Telegram
Vendor-agnostic ML inference on production edge devices
https://www.reddit.com/r/programming/comments/1v8wl5t/vendoragnostic_ml_inference_on_production_edge/

<!-- SC_OFF -->I work on PostSlate, a video editing tool, and this comes out of our own work. We run ML models on-device, face detection and embedding among other things, which means we can't assume anything about the user's GPU. NVIDIA discrete, AMD, Intel integrated, Apple Silicon, all of it. That rules out CUDA immediately, we needed one backend that runs everywhere. We landed on ncnn's Vulkan backend. Numbers on a 4070, fp16: ArcFace R50 (face embedding): 30 ms on ONNX CPU → 3 ms on ncnn Vulkan SCRFD (face detection): 25 ms → 2.5 ms Model size: ArcFace 174 MB (ONNX fp32) → 87 MB (ncnn fp16 weight storage) Of course the real speedup comes from offloading compute to the GPU, but this wouldn't be possible without the power of Vulkan. The speed wasn't even the deciding factor, it's that Vulkan drivers already exist on every machine we ship to. This means that we don't have to force the user to download a specific runtime and no vendor-specific installs. Full writeup with the rest of the numbers: https://getpostslate.com/blog/faster-local-inference <!-- SC_ON --> submitted by /u/ppchaos (https://www.reddit.com/user/ppchaos)
[link] (https://getpostslate.com/blog/faster-local-inference) [comments] (https://www.reddit.com/r/programming/comments/1v8wl5t/vendoragnostic_ml_inference_on_production_edge/)
Dependency Cultures - Richard Feldman
https://www.reddit.com/r/programming/comments/1v8ynjn/dependency_cultures_richard_feldman/

<!-- SC_OFF -->Excellent talk by Richard Feldman about how different programming communities approach dependencies. <!-- SC_ON --> submitted by /u/isaacvando (https://www.reddit.com/user/isaacvando)
[link] (https://youtu.be/E82ly38YEEQ) [comments] (https://www.reddit.com/r/programming/comments/1v8ynjn/dependency_cultures_richard_feldman/)
The Elevator Glitch: How One Function Destroyed Public Lobbies in CoD4
https://www.reddit.com/r/programming/comments/1v94mgb/the_elevator_glitch_how_one_function_destroyed/

<!-- SC_OFF -->Walk with me inside one of the most influential game's code and discover the secret of elevators! Turns out the bug comes down to a single line buried in the engine's collision code. Went through the decompiled source (thanks to KisakCOD) and traced the whole thing back. Let me know your thoughts! <!-- SC_ON --> submitted by /u/Rex109 (https://www.reddit.com/user/Rex109)
[link] (https://www.youtube.com/watch?v=U0kAwjFuxoo) [comments] (https://www.reddit.com/r/programming/comments/1v94mgb/the_elevator_glitch_how_one_function_destroyed/)
The Bedrock of Software Design
https://www.reddit.com/r/programming/comments/1vcl5bj/the_bedrock_of_software_design/

<!-- SC_OFF -->I drafted this post years ago but didn’t finish it until now. The concept I write about has shaped the way I design software more than anything else, and I believe every software engineer should be introduced to it early in their career. P.S. I don’t want the title to come across as clickbait: the post is about ADT. <!-- SC_ON --> submitted by /u/alex35mil (https://www.reddit.com/user/alex35mil)
[link] (https://alex.draftist.io/blog/the-bedrock-of-software-design-ycqvcedsj) [comments] (https://www.reddit.com/r/programming/comments/1vcl5bj/the_bedrock_of_software_design/)
Variations on a theme of sorting
https://www.reddit.com/r/programming/comments/1vd5q3j/variations_on_a_theme_of_sorting/

<!-- SC_OFF -->Semisort Reorder an array so that identical keys are grouped contiguously Keys do not need to be in sorted order Stable Partition
Group by predicate, preserve order K-smallest selection, single Get the k-smallest key from the array K-smallest selection, list Get the k-smallest key from the array, and everything smaller (or equal), in any order K-smallest selection, list sorted Get the k-smallest key from the array, and everything smaller (or equal), in sorted order <!-- SC_ON --> submitted by /u/Grouchy-Trade-7250 (https://www.reddit.com/user/Grouchy-Trade-7250)
[link] (https://jshun.csail.mit.edu/6506-s24/lectures/lecture6-2.pdf) [comments] (https://www.reddit.com/r/programming/comments/1vd5q3j/variations_on_a_theme_of_sorting/)