Replication Data for: Distributing Higher-Dimensional Simulations Across Compute Systems: A Widely Distributed Combination Technique

DOI

Scripts to run the weak, strong and remote strong scaling tests described in

"Distributing Higher-Dimensional Simulations Across Compute Systems: A Widely Distributed Combination Technique",

as well as measurements obtained on the Machines HAWK and our Institute's epyc machine.

To reproduce, follow the build procedure detailed in the scripts repository , making sure that the flags passed in DisCoTec/distributedcombigrid/examples/distributed_third_level/Makefile.template match the ones passed during library compilation.

Observe the folder structure for the different tests performed: To run a specific test case, the executable combi_example was linked into a folder, and the parameter file ctparam was provided. The files called run.sh are batch system submission scripts. generate_test_folders_and_submit.sh automates the process for a series of weak scaling runs, which can be adjusted by modifying the script. Time measurement outputs are given as timers.json files, where each process wrote a portion of the file at the end (can get very large for many processes and many time steps). The plot_* files in discotec-scaling-scripts help extract the relevant information from the timers.json files.

DisCoTec, 358faf47a108ed1b5ab

discotec-scaling-scripts, 177d33ba94ba2c7da91e

Accepted at HiPar 2021, accepted regular papers will be published in the workshop proceedings in cooperation with IEEE TCHPC (pending acceptance).

Identifier
DOI	https://doi.org/10.18419/darus-2123
Metadata Access	https://darus.uni-stuttgart.de/oai?verb=GetRecord&metadataPrefix=oai_datacite&identifier=doi:10.18419/darus-2123

Provenance
Creator	Pollinger, Theresa (Universität Stuttgart)
Publisher	DaRUS
Contributor	Pollinger, Theresa; Chair for Scientific Computing
Publication Year	2021
Funding Reference	High Performance Computing Center Stuttgart (HLRS), 12985; DFG, 230862074
Rights	CC BY Waiver; info:eu-repo/semantics/openAccess; https://creativecommons.org/licenses/by/4.0/
OpenAccess	true
Contact	Pollinger, Theresa (Universität Stuttgart)

Representation
Resource Type	HPC measurement data; Dataset
Format	application/json; text/plain; text/csv; text/tab-separated-values; text/x-fixed-field; application/octet-stream; application/x-sh; application/x-shellscript; text/plain; charset=US-ASCII; text/x-python; image/svg+xml
Size	2494948; 49609539; 34939114; 38845909; 31598593; 15757276; 1357130; 269156; 453195; 8504777; 250742; 24810116; 68536610; 324408; 16893766; 755517; 28681331; 106514889; 184811452; 4376488; 18927; 39187; 16961; 1173; 132449; 536; 8513; 695; 33319; 65914; 2283; 4047; 486964; 4376960; 288927; 33972622; 38844582; 324306; 1251362; 24798893; 49606916; 8011859; 255791; 2242098; 177728121; 68537381; 28816573; 31817665; 15988613; 16894037; 2168090; 16936635; 269100; 38845258; 49607440; 33973404; 31160107; 1179462; 453169; 24813967; 8505018; 68535325; 324402; 539; 1179277; 38844925; 324310; 103117112; 24814171; 269224; 49953626; 4377402; 176619133; 453055; 16894029; 704838; 31598143; 16935611; 28878366; 66302184; 250988; 8504611; 132396; 16950; 4030; 2288; 8492; 1171; 33305; 696; 537; 65892; 31598359; 28641605; 269228; 8235434; 38845645; 107840415; 2168130; 16894324; 324384; 655401; 34709172; 68538662; 49606393; 16935291; 250732; 331; 9268; 7633; 1556; 1340; 6228; 5000; 1301; 1026; 10374; 8504; 1812; 770; 7141; 737; 30570; 6661; 27773; 1889; 1694; 8773; 184; 183; 182; 186; 180; 181; 185; 188; 177; 189; 522; 523; 524; 521; 348; 259049; 251168; 258746; 133997; 257079; 227672; 258595; 243133; 255413; 196900; 258140; 305; 15918; 7883; 1972; 31379; 62151; 3638; 911; 456; 125054; 956; 0; 11824; 122; 6273208; 2053; 2403; 2731; 2431; 847; 1194; 9403; 69; 299; 139; 547; 2404; 47; 4757; 3763; 7888; 7829; 3705; 458; 399; 219; 220; 284772; 285581; 285482; 284582; 285704; 285766; 284645; 285407; 285461; 285402; 284747; 285434; 285446; 1485; 57; 303203; 3801; 1768; 47484; 1776; 47121; 1781; 46406; 1772; 46408; 1805; 48177; 47126; 47476; 16969; 2284; 697; 1174; 33302; 65811; 3633; 2060; 11768; 300; 904; 53; 612; 142; 21583; 440; 941; 1024; 1031; 1030; 1044; 1951; 1032; 1043; 1029; 1035; 1033; 1041; 322; 1034; 1042; 495; 1038; 1045; 1046; 1931; 174; 25087; 889; 1162; 610; 481; 430; 266; 267; 77; 441438; 396909; 403221; 396881; 432863; 379963; 405285; 420140; 90611; 506814; 265; 295725; 293477; 293437; 293507; 293500; 293445; 293482; 24; 81; 285917; 268265; 287206; 293484; 268397; 268306; 268377; 268295; 268407; 268411; 306678; 305904; 305791; 305810; 305866; 305834; 305824; 284802; 176; 287192; 278500; 278733; 278502; 278572; 278523; 278552; 278538; 278483; 284733; 216299; 216268; 216358; 216439; 216318; 216330; 329072; 328710; 328659; 328752; 328729; 328663; 328760; 45308; 328773; 289910; 286158; 285918; 285929; 286192; 285946; 286186; 285935; 285933; 285300; 250590; 250698; 250548; 250541; 250563; 55; 146997; 147010; 147011; 146960; 147096; 678; 3082; 31324675; 56933569; 556360758; 32944935; 2059217; 65623717; 1049553; 42615607; 146739226; 272925691; 269140; 32144777; 16210492; 544320; 1112692826; 4082291; 32475636; 32389103; 31147787; 8124566; 36104789; 133221029; 2071740; 289043; 15758170; 16896879
Version	1.0
Discipline	Other
Spatial Coverage	Stuttgart