[2211.05118] Mapping Out the HPC Dependency Chaos
source link: https://arxiv.org/abs/2211.05118
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
[Submitted on 22 Oct 2022]
Mapping Out the HPC Dependency Chaos
High Performance Computing~(HPC) software stacks have become complex, with the dependencies of some applications numbering in the hundreds. Packaging, distributing, and administering software stacks of that scale is a complex undertaking anywhere. HPC systems deal with esoteric compilers, hardware, and a panoply of uncommon combinations. In this paper, we explore the mechanisms available for packaging software to find its own dependencies in the context of a taxonomy of software distribution, and discuss their benefits and pitfalls. We discuss workarounds for some common problems caused by using these composed stacks and introduce Shrinkwrap: A solution to producing binaries that directly load their dependencies from precise locations and in a precise order. Beyond simplifying the use of the binaries, this approach also speeds up loading as much as 7x for a large dynamically-linked MPI application in our evaluation.
| Comments: | Presented at SuperComputing 2022 (this https URL) |
| Subjects: | Software Engineering (cs.SE); Mathematical Software (cs.MS) |
| Cite as: | arXiv:2211.05118 [cs.SE] |
| (or arXiv:2211.05118v1 [cs.SE] for this version) | |
| https://doi.org/10.48550/arXiv.2211.05118 |
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK