HPC & Quantum
27 subscribers
11.4K photos
668 videos
3 files
30.7K links
Download Telegram
HPC Guru (Twitter)

RT @thoefler: Prof. David Keyes from @KAUST_ECRC concludes his great @siag_sc talk on approximate matrix representations with a nice tiled-precision block format in #HPC. This is very related to quantization in #AI/#DeepLearning. We should learn from each other :-)!

https://siag-sc.org/supercomputing-spotlights-webinar-series-3.html https://twitter.com/thoefler/status/1587820473945145348/photo/1
HPC Guru (Twitter)

RT @thoefler: 2.5 bits per weight are enough to run inference on extremely large language models! Using a simple blocked scaling scheme and moderate block sizes.

Meet GPTQ: https://arxiv.org/abs/2210.17323

#DeepLearning #TinyML @DAlistarh @elias_frantar @AshkboosSaleh https://twitter.com/thoefler/status/1599653546483408896/photo/1
HPC Guru (Twitter)

RT @thoefler: Submitting a #DataScience, #AI, or #DeepLearning paper to @Supercomputing? Check the performance fallacies in "benchmarking data science".

Twelve ways to lie with statistics and performance - just to make sure your work doesn't fall for any of them ;-).

http://htor.inf.ethz.ch/publications/index.php?pub=473 https://twitter.com/thoefler/status/1643120712474038272/photo/1
HPC Guru (Twitter)

ICYMI: Designing network support for High-Performance #DeepLearning Systems

Network and memory bandwidth is the new oil in #AI #supercomputing

Keynote by @thoefler at #HPC Advisory Council, April 2023, Lugano, Switzerland

https://www.hpcadvisorycouncil.com/events/2023/swiss-conference/pdf/day2/ETH.pdf
HPC Guru (Twitter)

#DeepLearning pioneer Geoffrey Hinton quits Google

@geoffreyhinton says he has new fears about the technology he helped usher in and wants to speak openly about them, and that a part of him now regrets his life’s work

https://t.co/MGw895E3wX

#AI via @techreview