HPC Guru (Twitter)
RT @thoefler: 2.5 bits per weight are enough to run inference on extremely large language models! Using a simple blocked scaling scheme and moderate block sizes.
Meet GPTQ: https://arxiv.org/abs/2210.17323
#DeepLearning #TinyML @DAlistarh @elias_frantar @AshkboosSaleh https://twitter.com/thoefler/status/1599653546483408896/photo/1
RT @thoefler: 2.5 bits per weight are enough to run inference on extremely large language models! Using a simple blocked scaling scheme and moderate block sizes.
Meet GPTQ: https://arxiv.org/abs/2210.17323
#DeepLearning #TinyML @DAlistarh @elias_frantar @AshkboosSaleh https://twitter.com/thoefler/status/1599653546483408896/photo/1
HPC Guru (Twitter)
In a fireside chat at #GTC23, @NVIDIA’s founder and CEO and @OpenAI co-founder Ilya Sutskever (@ilyasut) discussed GPT-4, #ChatGPT, deep learning’s future and how it all began
https://t.co/8B1BHyYHPp
#AI #DeepLearning #GPU
In a fireside chat at #GTC23, @NVIDIA’s founder and CEO and @OpenAI co-founder Ilya Sutskever (@ilyasut) discussed GPT-4, #ChatGPT, deep learning’s future and how it all began
https://t.co/8B1BHyYHPp
#AI #DeepLearning #GPU
NVIDIA Blog
AI Opener: OpenAI’s Sutskever in Conversation With Jensen Huang
In a fireside chat at GTC, NVIDIA’s founder and CEO and OpenAI co-founder Ilya Sutskever discussed GPT-4, ChatGPT, deep learning’s future and how it all began.
insideHPC.com (Twitter)
Quantum on Wall Street: JPMorgan Chase and QC Ware Report on 'Deep Hedging' with Quantum-Classical
https://t.co/hD2UCjfYV7
@jpmorgan @QCWare #QuantumComputing #quantumclassical #financialservices #HPC #supercomputing #DeepLearning
Quantum on Wall Street: JPMorgan Chase and QC Ware Report on 'Deep Hedging' with Quantum-Classical
https://t.co/hD2UCjfYV7
@jpmorgan @QCWare #QuantumComputing #quantumclassical #financialservices #HPC #supercomputing #DeepLearning
High-Performance Computing News Analysis | insideHPC
Quantum on Wall Street: JPMorgan Chase and QC Ware Report on ‘Deep Hedging’ with Quantum-Classical
New York and Palo Alto, CA — March 30, 2023 — JPMorgan Chase and quantum and classical computing software and services company QC Ware [...]
HPC Guru (Twitter)
RT @thoefler: Submitting a #DataScience, #AI, or #DeepLearning paper to @Supercomputing? Check the performance fallacies in "benchmarking data science".
Twelve ways to lie with statistics and performance - just to make sure your work doesn't fall for any of them ;-).
http://htor.inf.ethz.ch/publications/index.php?pub=473 https://twitter.com/thoefler/status/1643120712474038272/photo/1
RT @thoefler: Submitting a #DataScience, #AI, or #DeepLearning paper to @Supercomputing? Check the performance fallacies in "benchmarking data science".
Twelve ways to lie with statistics and performance - just to make sure your work doesn't fall for any of them ;-).
http://htor.inf.ethz.ch/publications/index.php?pub=473 https://twitter.com/thoefler/status/1643120712474038272/photo/1
HPC Guru (Twitter)
ICYMI: Designing network support for High-Performance #DeepLearning Systems
Network and memory bandwidth is the new oil in #AI #supercomputing
Keynote by @thoefler at #HPC Advisory Council, April 2023, Lugano, Switzerland
https://www.hpcadvisorycouncil.com/events/2023/swiss-conference/pdf/day2/ETH.pdf
ICYMI: Designing network support for High-Performance #DeepLearning Systems
Network and memory bandwidth is the new oil in #AI #supercomputing
Keynote by @thoefler at #HPC Advisory Council, April 2023, Lugano, Switzerland
https://www.hpcadvisorycouncil.com/events/2023/swiss-conference/pdf/day2/ETH.pdf
HPC Guru (Twitter)
#DeepLearning pioneer Geoffrey Hinton quits Google
@geoffreyhinton says he has new fears about the technology he helped usher in and wants to speak openly about them, and that a part of him now regrets his life’s work
https://t.co/MGw895E3wX
#AI via @techreview
#DeepLearning pioneer Geoffrey Hinton quits Google
@geoffreyhinton says he has new fears about the technology he helped usher in and wants to speak openly about them, and that a part of him now regrets his life’s work
https://t.co/MGw895E3wX
#AI via @techreview
MIT Technology Review
Deep learning pioneer Geoffrey Hinton quits Google
Hinton will be speaking at EmTech Digital on Wednesday.
HPC Guru (Twitter)
RT @EuroCC_project: 📢 Workshop Alert! 📢
The 3rd @FF4EuroHPC #workshop on #HPC, #ml, and #DeepLearning in #industry is this Friday!
Come hear about 5 success stories spanning sectors from #manufacturing to #medicine.
🗓️ 9 June, 9:00-12:00
👉 https://www.ff4eurohpc.eu/en/news-and-events/news/2023053016061698/ff4eurohpc_oc2_success_stories_premiere__workshop_3
RT @EuroCC_project: 📢 Workshop Alert! 📢
The 3rd @FF4EuroHPC #workshop on #HPC, #ml, and #DeepLearning in #industry is this Friday!
Come hear about 5 success stories spanning sectors from #manufacturing to #medicine.
🗓️ 9 June, 9:00-12:00
👉 https://www.ff4eurohpc.eu/en/news-and-events/news/2023053016061698/ff4eurohpc_oc2_success_stories_premiere__workshop_3
www.ff4eurohpc.eu
FF4EuroHPC OC2 Success Stories Premiere - Workshop #3
FF4EuroHPC is a European initiative that helps facilitate access to supercomputers and all high-performance computing (HPC)-related technologies for SMEs
HPC Guru (Twitter)
Velocity Bench is an open-source benchmark suite that covers various industry domains including #HPC & #DeepLearning
The goal is to provide a fair performance comparison across #GPU platforms and parallel programming languages
https://t.co/LhR0j9F2WP
#HPC #AI via @HPCwire
Velocity Bench is an open-source benchmark suite that covers various industry domains including #HPC & #DeepLearning
The goal is to provide a fair performance comparison across #GPU platforms and parallel programming languages
https://t.co/LhR0j9F2WP
#HPC #AI via @HPCwire
HPCwire
The New Velocity Bench for GPU Offload Performance Data
Performance benchmarking is the hallmark of HPC. One need to look no further than the Top500 list which has been recording HPC performance since 1993. Historically the Top500 list is […]
HPC Guru (Twitter)
RT @AndrewYNg: I'm happy to be on the Time AI 100 list of influential people in AI, and thrilled that 8 others from my Stanford group or other teams I led are also named!
Congratulations to my former advisees and team members:
- Sam Altman @sama (as undergrad, interned with me on RL research at Stanford)
- Dario Amodei @Dario_Amodei (worked with me on DeepSpeech and scaling laws at Baidu)
- Alison Darcy @alisonmdarcy (AI+mental health at Stanford)
- Geoff Hinton @geoffreyhinton (member of my team at Google Brain)
- Lila Ibrahim @lilaibrahim (once my COO at Coursera)
- Neal Khosla @nealkhosla (undergrad advisee at Stanford)
- Richard Socher @RichardSocher (PhD advisee with Chris Manning)
- Ilya Sutskever @ilyasut (postdoc at Stanford)
It's thrilling to see the ongoing impact of everyone's work! ❤️
RT @AndrewYNg: I'm happy to be on the Time AI 100 list of influential people in AI, and thrilled that 8 others from my Stanford group or other teams I led are also named!
Congratulations to my former advisees and team members:
- Sam Altman @sama (as undergrad, interned with me on RL research at Stanford)
- Dario Amodei @Dario_Amodei (worked with me on DeepSpeech and scaling laws at Baidu)
- Alison Darcy @alisonmdarcy (AI+mental health at Stanford)
- Geoff Hinton @geoffreyhinton (member of my team at Google Brain)
- Lila Ibrahim @lilaibrahim (once my COO at Coursera)
- Neal Khosla @nealkhosla (undergrad advisee at Stanford)
- Richard Socher @RichardSocher (PhD advisee with Chris Manning)
- Ilya Sutskever @ilyasut (postdoc at Stanford)
It's thrilling to see the ongoing impact of everyone's work! ❤️
X (formerly Twitter)
Andrew Ng (@AndrewYNg) on X
Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
HPC Guru (Twitter)
RT @AndrewYNg: I'm happy to be on the Time AI 100 list of influential people in AI, and thrilled that 8 others from my Stanford group or other teams I led are also named!
Congratulations to my former advisees and team members:
- Sam Altman @sama (as undergrad, interned with me on RL research at Stanford)
- Dario Amodei @Dario_Amodei (worked with me on DeepSpeech and scaling laws at Baidu)
- Alison Darcy @alisonmdarcy (AI+mental health at Stanford)
- Geoff Hinton @geoffreyhinton (member of my team at Google Brain)
- Lila Ibrahim @lilaibrahim (once my COO at Coursera)
- Neal Khosla @nealkhosla (undergrad advisee at Stanford)
- Richard Socher @RichardSocher (PhD advisee with Chris Manning)
- Ilya Sutskever @ilyasut (postdoc at Stanford)
It's thrilling to see the ongoing impact of everyone's work! ❤️
RT @AndrewYNg: I'm happy to be on the Time AI 100 list of influential people in AI, and thrilled that 8 others from my Stanford group or other teams I led are also named!
Congratulations to my former advisees and team members:
- Sam Altman @sama (as undergrad, interned with me on RL research at Stanford)
- Dario Amodei @Dario_Amodei (worked with me on DeepSpeech and scaling laws at Baidu)
- Alison Darcy @alisonmdarcy (AI+mental health at Stanford)
- Geoff Hinton @geoffreyhinton (member of my team at Google Brain)
- Lila Ibrahim @lilaibrahim (once my COO at Coursera)
- Neal Khosla @nealkhosla (undergrad advisee at Stanford)
- Richard Socher @RichardSocher (PhD advisee with Chris Manning)
- Ilya Sutskever @ilyasut (postdoc at Stanford)
It's thrilling to see the ongoing impact of everyone's work! ❤️
X (formerly Twitter)
Andrew Ng (@AndrewYNg) on X
Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
HPC Guru (Twitter)
Bill Dally's #HotChips2023 keynote "Hardware for #DeepLearning" is now publicly available, thanks to @hotchipsorg
youtube.com/watch?v=rsxCZAE8…
#AI #HPC #GPU
Bill Dally's #HotChips2023 keynote "Hardware for #DeepLearning" is now publicly available, thanks to @hotchipsorg
youtube.com/watch?v=rsxCZAE8…
#AI #HPC #GPU
X (formerly Twitter)
HPC Guru on X
Bill Dally's #HotChips2023 keynote "Hardware for #DeepLearning" is now publicly available, thanks to @hotchipsorg
https://t.co/MfFrFZLUCs
#AI #HPC #GPU
https://t.co/MfFrFZLUCs
#AI #HPC #GPU
HPC Guru (Twitter)
RT @thoefler: The HammingMesh talk from #SC22 - a flexible and cost-effective network topology for #DeepLearning on #AI #Supercomputers.
https://www.youtube.com/watch?v=4_Ma01QtttQ
10-15x cheaper than Fat Tree networks, higher flexibility than Torus, fault-tolerant and reproducible!
Best Repro Award @ #SC23!
RT @thoefler: The HammingMesh talk from #SC22 - a flexible and cost-effective network topology for #DeepLearning on #AI #Supercomputers.
https://www.youtube.com/watch?v=4_Ma01QtttQ
10-15x cheaper than Fat Tree networks, higher flexibility than Torus, fault-tolerant and reproducible!
Best Repro Award @ #SC23!
HPCwire (Twitter)
One of this year’s #PeopletoWatch is Yann Lecun. He is best known for his work in #deeplearning and the invention of the convolutional network method. Yann is currently a part-time professor at NYU and a VP and Chief #AI Scientist for Facebook AI Research. ow.ly/LHn450RhfHW
One of this year’s #PeopletoWatch is Yann Lecun. He is best known for his work in #deeplearning and the invention of the convolutional network method. Yann is currently a part-time professor at NYU and a VP and Chief #AI Scientist for Facebook AI Research. ow.ly/LHn450RhfHW
HPCwire (Twitter)
Artificial intelligence encompasses a set of emerging technologies that are transforming the world as we know it. Get the articles that matter most in TECHwire UPDATE: #ArtificialIntelligence delivered monthly directly to your inbox.
ow.ly/QNUE50SiqUO
#deeplearning
Artificial intelligence encompasses a set of emerging technologies that are transforming the world as we know it. Get the articles that matter most in TECHwire UPDATE: #ArtificialIntelligence delivered monthly directly to your inbox.
ow.ly/QNUE50SiqUO
#deeplearning
HPCwire (Twitter)
With AI and #HPC pushing the limits of computational power, the choice of software stack can significantly impact performance, efficiency, and developer productivity. Delve into the intricacies of the leading software stacks: ow.ly/xi0e50SnUwo.
#deeplearning #GenAI
With AI and #HPC pushing the limits of computational power, the choice of software stack can significantly impact performance, efficiency, and developer productivity. Delve into the intricacies of the leading software stacks: ow.ly/xi0e50SnUwo.
#deeplearning #GenAI
HPCwire (Twitter)
MIT researchers, using NSF ACCESS-funded resources at SDSC, have developed a cutting-edge #machinelearning method to analyze chemical patterns in metallic alloys. This breakthrough in computational models offers unprecedented insights. ow.ly/6mKx50SxwAA #deeplearning
MIT researchers, using NSF ACCESS-funded resources at SDSC, have developed a cutting-edge #machinelearning method to analyze chemical patterns in metallic alloys. This breakthrough in computational models offers unprecedented insights. ow.ly/6mKx50SxwAA #deeplearning
HPC Guru (Twitter)
In the next couple of decades, we will be able to do things that would have seemed like magic to our grandparents
@sama touts “The Intelligence Age”
#DeepLearning worked, got predictably better with scale, and we dedicated increasing resources to it
ia.samaltman.com
In the next couple of decades, we will be able to do things that would have seemed like magic to our grandparents
@sama touts “The Intelligence Age”
#DeepLearning worked, got predictably better with scale, and we dedicated increasing resources to it
ia.samaltman.com
HPC Guru (Twitter)
How a stubborn computer scientist accidentally launched the #DeepLearning boom
"You’ve taken this idea way too far," a mentor told Prof. Fei-Fei Li (@drfeifei)
https://arstechnica.com/ai/2024/11/how-a-stubborn-computer-scientist-accidentally-launched-the-deep-learning-boom/
#AI
How a stubborn computer scientist accidentally launched the #DeepLearning boom
"You’ve taken this idea way too far," a mentor told Prof. Fei-Fei Li (@drfeifei)
https://arstechnica.com/ai/2024/11/how-a-stubborn-computer-scientist-accidentally-launched-the-deep-learning-boom/
#AI
HPCwire (Twitter)
HPCwire reports on DIMON, a groundbreaking #artificialintelligence framework capable of solving complex equations at speeds that rival supercomputers — without requiring HPC infrastructure. #machinelearning #deeplearning #quantumphysics #HPCwire
ow.ly/YFn750UGms1
HPCwire reports on DIMON, a groundbreaking #artificialintelligence framework capable of solving complex equations at speeds that rival supercomputers — without requiring HPC infrastructure. #machinelearning #deeplearning #quantumphysics #HPCwire
ow.ly/YFn750UGms1
HPCwire (Twitter)
Quantum expert John Preskill shifts the focus from NISQ systems to a bold new target: the “MegaQuop” machine. Explore Preskill’s vision for the future of #QuantumComputing and what it means for research and industry. #SuperComputing #HPCwire #DeepLearning
ow.ly/6agI50UBA9K
Quantum expert John Preskill shifts the focus from NISQ systems to a bold new target: the “MegaQuop” machine. Explore Preskill’s vision for the future of #QuantumComputing and what it means for research and industry. #SuperComputing #HPCwire #DeepLearning
ow.ly/6agI50UBA9K