按年被提到
20222022 · 1 次2026
系统、数据库与网络›计算机体系结构与硬件·arXiv:2208.04817 · cs.DC

Exploring GPU Stream-Aware Message Passing using Triggered Operations

Naveen Namashivayam, Krishna Kandalla, Trey White, Nick Radcliffe, Larry Kaplan, Mark Pagel · 2022
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2022-08-12 · 最近 2024-04-14
2不同的人
2活跃月份
2讨论串
11被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Modern heterogeneous supercomputing systems are comprised of compute blades that offer CPUs and GPUs. On such systems, it is essential to move data efficiently between these different compute engines across a high-speed network. While current generation scientific applications and systems software stacks are GPU-aware, CPU threads are still required to orchestrate data moving communication operations and inter-process synchronization operations. A new GPU stream-aware MPI communication strategy called stream-triggered (ST) communication is explored to allow offloading both computation and communication control paths to the GPU. The proposed ST communication strategy is implemented on HPE Slingshot Interconnects over a new proprietary HPE Slingshot NIC (Slingshot 11) using the supported triggered operations feature. Performance of the proposed new communication strategy is evaluated using a microbenchmark kernel called Faces, based on the nearest-neighbor communication pattern in the CORAL-2 Nekbone benchmark, over a heterogeneous node architecture consisting of AMD CPUs and GPUs.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论westurner · 2024-04

“https://www.windowscentral.com/hardware/computers-desktops/nvidia-kills-off-nvlink-on-rtx-4090: > "The reason why we took [NVLink] out was because we needed the we needed the I/Os for something else, and so, so we use the I/O area to cram in as much as much AI processing as we could," Huang confirmed and explained of NVLink's absence. > For gamers, cre…”

Jim Keller suggests Nvidia should have used Ethernet to link Blackwell GPUs原评论 ↗
被提交为 story · 1 次