James C. Phillips, Yanhua Sun, Nikhil Jain, Eric J. Bohm, and Laximant V.
Kalé.
Mapping to irregular torus topologies and other techniques for
petascale biomolecular simulation.
In Proceedings of the International Conference on High
Performance Computing, Networking, Storage and Analysis, SC '14, pp. 81-91.
IEEE Press, 2014.
(PMC: PMC4292797)
PHIL2014-LK
Currently deployed petascale supercomputers typically use toroidal network topologies in
three or more dimensions. While these networks perform well for topology-agnostic codes
on a few thousand nodes, leadership machines with 20,000 nodes require topology
awareness to avoid network contention for communication-intensive codes. Topology
adaptation is complicated by irregular node allocation shapes and holes due to dedicated
input/output nodes or hardware failure. In the context of the popular molecular dynamics
program NAMD, we present methods for mapping a periodic 3-D grid of fixed-size spatial
decomposition domains to 3-D Cray Gemini and 5-D IBM Blue Gene/Q toroidal networks to
enable hundred-million atom full machine simulations, and to similarly partition node
allocations into compact domains for smaller simulations using multiple-copy algorithms.
Additional enabling techniques are discussed and performance is reported for NCSA Blue
Waters, ORNL Titan, ANL Mira, TACC Stampede, and NERSC Edison.
Download Full Text
The manuscripts available on our site are provided for your personal
use only and may not be retransmitted or redistributed without written
permissions from the paper's publisher and author. You may not upload any
of this site's material to any public server, on-line service, network, or
bulletin board without prior written permission from the publisher and
author. You may not make copies for any commercial purpose. Reproduction
or storage of materials retrieved from this web site is subject to the
U.S. Copyright Act of 1976, Title 17 U.S.C.