HPC & Quantum
27 subscribers
11.4K photos
668 videos
3 files
30.7K links
Download Telegram
HPC Guru (Twitter)

RT @ID_AA_Carmack: Interesting to consider error correcting codes that spend the overhead bits in a precision aware manner, allowing the less significant bits to be unprotected, while protecting and monitoring the more significant. If the traffic is floating point for ML work, just protecting the sign and exponent might be sufficient.

I can imagine dedicated future hardware networks operating as isochronous streams, just accepting rare bit errors without any attempt at retransmission.
HPC Guru (Twitter)

RT @_akhaliq: GPT Can Solve Mathematical Problems Without a Calculator

paper page: huggingface.co/papers/2309.0…

Previous studies have typically assumed that large language models are unable to accurately perform arithmetic operations, particularly multiplication of >8 digits, and operations involving decimals and fractions, without the use of calculator tools. This paper aims to challenge this misconception. With sufficient training data, a 2 billion-parameter language model can accurately perform multi-digit arithmetic operations with almost 100% accuracy without data leakage, significantly surpassing GPT-4 (whose multi-digit multiplication accuracy is only 4.3%). We also demonstrate that our MathGLM, fine-tuned from GLM-10B on a dataset with additional multi-step arithmetic operations and math problems described in text, achieves similar performance to GPT-4 on a 5,000-samples Chinese math problem test set.
HPC Guru (Twitter)

👇Interesting 🧵 by @jeremyphoward on interacting with an anonymous account

Posted by another anonymous account, who is way past 10th grade and who still needs to focus on their English 🤪
HPC Guru (Twitter)

RT @TheSeaMouse: A priori looks like diminishing returns to go from Llama 2 70B to Falcon 180B, especially given the extra resource requirements.
HPCwire (Twitter)

@NVIDIAAI is banned from selling the #A100 and #H100 #GPUs to China. However, the U.S. government is introducing an additional licensing requirement for other countries. Learn more about the restriction: ow.ly/kLOo50PHYph
HPCwire (Twitter)

Discover two remarkable #WomenInHPC who are revolutionizing the fields of #GreenEnergy and #medicine. Dr. Melissa Kozul is pushing boundaries, and Professor Andrea Townsend-Nicholson is leveraging HPC in health and medicine. Learn more: ow.ly/jEmS50PEPEs #STEM #IamHPC
HPCwire (Twitter)

Quantum Hopeful Zapata to go Public and Pivot to “Industrial Generative AI” #AI @ZapataComputing

ow.ly/kMBi50PJ3nk
insideHPC.com (Twitter)

Micron CEO Sanjay Mehrotra to Receive SIA's Robert Noyce Award
wp.me/p3RLHQ-o0o
@MicronTech @SIAAmerica #HPC twitter.com/i/web/status/169…