HPC & Quantum
27 subscribers
11.4K photos
668 videos
3 files
30.6K links
Download Telegram
HPC Guru (Twitter)

#OGHPC Panel: @trish_damkroger mentioned the challenge of improving IO bottlenecks in #HPC

I agree and I think @intelhpc efforts with #DAOS are commendable
HPC Guru (Twitter)

Intel (@intelhpc) #DAOS Roadmap

o 2.6 in Sep 2023 will support HPE Slingshot, OmniPath Express, and non-PMem storage (due to Optane going away)

o 3.0 in 2024 will have #Lustre integration

#HPC #Storage via @glennklockwood
HPC Guru (Twitter)

The #memory & #storage subsystems of #Aurora are incredible!

👇Capacity & (Peak bandwidth) numbers

o 10.9 PB DDR5 (5.95 PB/s)

o 1.36 PB CPU HBM (30.5 PB/s)

o 8.16 PB GPU HBM (208.9 PB/s)

o Storage: 230PB #DAOS (31 TB/s)

#HPC #AI #Exascale
This media is not supported in your browser
VIEW IN TELEGRAM
HPC Guru (Twitter)

👇31 TB/sec achieved by #Aurora #DAOS @argonne_lcf

Congratulations, @intelhpc!

To me this is perhaps more exciting than the 1+ EF compute performance

I don't say 2EF as that is a peak number - and you know my views on peak #s

#HPC #Storage #Exascale via @tonymongkolsmai
HPC Guru (Twitter)

.@googlecloud #Parallelstore is a high-performing parallel file #storage solution for #AI/#ML and #HPC workloads

Parallelstore is based on Intel #DAOS and delivers up to 6.3x read performance over comparable #Lustre solutions

cloud.google.com/parallelsto…

via @glennklockwood
HPC Guru (Twitter)

Also congratulations to the rest of the @IO500benchmark Production List #Top10 after the top 2 #DAOS systems
#3: Shaheen III @KAUST_News
#4: Leonarodo @Cineca1969
#5: IRIS @MSKCancerCenter
...
#10: Altair @pcss_psnc
#SC23 #HPC #Storage #Lustre #GPFS
HPC Guru (Twitter)

#Parallelstore @googlecloud based on #DAOS delivers up to 6.3x greater read throughput performance compared to competitive #Lustre *scratch* offerings

@glennklockwood emphasizes it really is scratch as metadata is kept in RAM

cloud.google.com/parallelsto…

#HPC #Storage via @hei_nyan
HPC Guru (Twitter)

#3

#HPC #Storage: #DAOS shines on the #IO500

@daos_io is #1 and #2 on the @IO500benchmark
production list

#Aurora @argonne may not be the fastest #supercomputer, but it definitely has the fastest storage - 👏👏@intelhpc @HPE_Cray @argonne_lcf

#SC23 #AI
HPC Guru (Twitter)

While a lot of focus is on #Aurora's compute performance, not enough attention is on Aurora's #storage systems

#DAOS delivers 31 TB/s performance on 230PB capacity

It would be a shame if DAOS is one of the projects that gets chopped during @intel's cost cutting

#HPC #AI
HPC Guru (Twitter)

Big news in the world of #HPC #Storage

#DAOS development team moves from @intel to @HPE

Code base still managed through the independent DAOS foundation

The shrinking of Intel continues....

#SC24 via @adrianjhpc
HPC Guru (Twitter)

RT @daos_io: Attend an informative DAOS tutorial, at ISC’25 in Hamburg on June 13th. Check out the full description of the tutorial and plan to attend | tinyurl.com/y954xnzn
#ISC25 #DAOS #Storage #OpenSource