Forwarded from Hacker News (yahnc_bot)
Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM https://www.nvidia.com/en-us/data-center/grace-hopper-superchip/
NVIDIA
Introducing the NVIDIA Grace Hopper Superchip
A breakthrough accelerated CPU designed from the ground up for giant-scale AI and HPC applications.
Forwarded from Hacker News (yahnc_bot)
Deepmind Alphadev: Faster sorting algorithms discovered using deep RL https://www.nature.com/articles/s41586-023-06004-9
Nature
Faster sorting algorithms discovered using deep reinforcement learning
Nature - Artificial intelligence goes beyond the current state of the art by discovering unknown, faster sorting algorithms as a single-player game using a deep reinforcement learning agent. These...
Forwarded from Hacker News (yahnc_bot)
Average color of the NYC sky every 5 minutes https://nskyc.com/
NSKYC
The average color of the New York City sky, updated every 5 minutes. By Mike Bodge
Forwarded from Hacker News (yahnc_bot)
Llama.cpp: Full CUDA GPU Acceleration https://github.com/ggerganov/llama.cpp/pull/1827
GitHub
CUDA full GPU acceleration, KV cache in VRAM by JohannesGaessler · Pull Request #1827 · ggerganov/llama.cpp
This PR adds GPU acceleration for all remaining ggml tensors that didn't yet have it. Especially for long generations this makes a large difference because the KV cache is still CPU only on mas...