Fri Aug 23 10:35:53 CEST 2024 ====================== ALLOCATED NODES ====================== gcn73: flags=0x11 slots=64 max_slots=0 slots_inuse=0 state=UP gcn74: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn75: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn76: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn77: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn78: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn79: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn80: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn81: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn82: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn83: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn84: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn85: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn86: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn87: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn88: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn89: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn90: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn91: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn92: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn93: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn94: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn95: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn96: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn97: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn98: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn99: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn100: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn101: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn102: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn103: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn104: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn105: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn106: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn107: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn108: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn109: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn110: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn111: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn112: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn113: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn114: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn115: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn116: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn117: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn118: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn119: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn120: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn121: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn122: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn123: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn124: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn125: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn126: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn127: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn128: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn129: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn130: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn131: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn132: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn133: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn134: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn135: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn136: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn137: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn138: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn139: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn140: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn141: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn142: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn143: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn144: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn145: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn146: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn147: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn148: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn149: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn150: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn151: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn152: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn153: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn154: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn155: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn156: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn157: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn158: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn159: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN gcn160: flags=0x13 slots=64 max_slots=0 slots_inuse=0 state=UNKNOWN ================================================================= App launch reported: 88 (out of 88) daemons - 348 (out of 352) procs HPCG-NVIDIA 24.3.0 -- NVIDIA accelerated HPCG benchmark -- NVIDIA Build v0.2.1 Start of application (GPU-Only) ... Initial Residual = 67824.5 Iteration = 1 Scaled Residual = 0.18393 Iteration = 2 Scaled Residual = 0.100636 Iteration = 3 Scaled Residual = 0.0694128 Iteration = 4 Scaled Residual = 0.0530289 Iteration = 5 Scaled Residual = 0.0429059 Iteration = 6 Scaled Residual = 0.0360239 Iteration = 7 Scaled Residual = 0.0310456 Iteration = 8 Scaled Residual = 0.0272855 Iteration = 9 Scaled Residual = 0.0243522 Iteration = 10 Scaled Residual = 0.0220016 Iteration = 11 Scaled Residual = 0.0200728 Iteration = 12 Scaled Residual = 0.0184556 Iteration = 13 Scaled Residual = 0.0170734 Iteration = 14 Scaled Residual = 0.0158751 Iteration = 15 Scaled Residual = 0.0148272 Iteration = 16 Scaled Residual = 0.0139067 Iteration = 17 Scaled Residual = 0.0130969 Iteration = 18 Scaled Residual = 0.0123835 Iteration = 19 Scaled Residual = 0.011752 Iteration = 20 Scaled Residual = 0.0111889 Iteration = 21 Scaled Residual = 0.0106811 Iteration = 22 Scaled Residual = 0.0102179 Iteration = 23 Scaled Residual = 0.00979258 Iteration = 24 Scaled Residual = 0.00940228 Iteration = 25 Scaled Residual = 0.0090464 Iteration = 26 Scaled Residual = 0.00872566 Iteration = 27 Scaled Residual = 0.00843996 Iteration = 28 Scaled Residual = 0.00818705 Iteration = 29 Scaled Residual = 0.00796276 Iteration = 30 Scaled Residual = 0.00776098 Iteration = 31 Scaled Residual = 0.00757517 Iteration = 32 Scaled Residual = 0.00740031 Iteration = 33 Scaled Residual = 0.00723293 Iteration = 34 Scaled Residual = 0.00707039 Iteration = 35 Scaled Residual = 0.00690964 Iteration = 36 Scaled Residual = 0.00674583 Iteration = 37 Scaled Residual = 0.00657378 Iteration = 38 Scaled Residual = 0.00639102 Iteration = 39 Scaled Residual = 0.00619978 Iteration = 40 Scaled Residual = 0.00600753 Iteration = 41 Scaled Residual = 0.0058242 Iteration = 42 Scaled Residual = 0.00565808 Iteration = 43 Scaled Residual = 0.00551373 Iteration = 44 Scaled Residual = 0.00539136 Iteration = 45 Scaled Residual = 0.00528733 Iteration = 46 Scaled Residual = 0.0051962 Iteration = 47 Scaled Residual = 0.0051125 Iteration = 48 Scaled Residual = 0.00503196 Iteration = 49 Scaled Residual = 0.00495223 Iteration = 50 Scaled Residual = 0.00487195 GPU Rank Info: | Storage Format = SELL, Optimization = HAND-TUNED | cuSPARSE version 12.3 | Reference CPU memory = 27691.53 MB | GPU Name: 'NVIDIA H100' | GPU Memory Use: 71674 MB / 95235 MB | Process Grid: 4x8x11 | Local Domain: 416x416x416 | Number of CPU Threads: 64 WARNING: PERFORMING UNPRECONDITIONED ITERATIONS Call [0] Number of Iterations [11] Scaled Residual [1.19798e-14] WARNING: PERFORMING UNPRECONDITIONED ITERATIONS Call [1] Number of Iterations [11] Scaled Residual [1.19798e-14] Call [0] Number of Iterations [2] Scaled Residual [1.49863e-17] Call [1] Number of Iterations [2] Scaled Residual [1.49863e-17] Departure from symmetry (scaled) for SpMV abs(x'*A*y - y'*A*x) = 0 Departure from symmetry (scaled) for MG abs(x'*Minv*y - y'*Minv*x) = 2.3626e-14 SpMV call [0] Residual [1.86265e-09] SpMV call [1] Residual [1.86265e-09] Initial Residual = 67824.5 Iteration = 1 Scaled Residual = 0.222942 Iteration = 2 Scaled Residual = 0.123183 Iteration = 3 Scaled Residual = 0.084494 Iteration = 4 Scaled Residual = 0.0645321 Iteration = 5 Scaled Residual = 0.0521347 Iteration = 6 Scaled Residual = 0.043725 Iteration = 7 Scaled Residual = 0.037744 Iteration = 8 Scaled Residual = 0.0330659 Iteration = 9 Scaled Residual = 0.029507 Iteration = 10 Scaled Residual = 0.0263805 Iteration = 11 Scaled Residual = 0.0240757 Iteration = 12 Scaled Residual = 0.0223371 Iteration = 13 Scaled Residual = 0.0208989 Iteration = 14 Scaled Residual = 0.0194813 Iteration = 15 Scaled Residual = 0.0183438 Iteration = 16 Scaled Residual = 0.0173366 Iteration = 17 Scaled Residual = 0.0163913 Iteration = 18 Scaled Residual = 0.0156181 Iteration = 19 Scaled Residual = 0.0149278 Iteration = 20 Scaled Residual = 0.0143653 Iteration = 21 Scaled Residual = 0.0138459 Iteration = 22 Scaled Residual = 0.0134406 Iteration = 23 Scaled Residual = 0.0129066 Iteration = 24 Scaled Residual = 0.0123201 Iteration = 25 Scaled Residual = 0.0118475 Iteration = 26 Scaled Residual = 0.0114023 Iteration = 27 Scaled Residual = 0.0109149 Iteration = 28 Scaled Residual = 0.0105005 Iteration = 29 Scaled Residual = 0.0100488 Iteration = 30 Scaled Residual = 0.00962544 Iteration = 31 Scaled Residual = 0.00920766 Iteration = 32 Scaled Residual = 0.00882981 Iteration = 33 Scaled Residual = 0.00858327 Iteration = 34 Scaled Residual = 0.00838862 Iteration = 35 Scaled Residual = 0.00819688 Iteration = 36 Scaled Residual = 0.00796879 Iteration = 37 Scaled Residual = 0.00780925 Iteration = 38 Scaled Residual = 0.00764254 Iteration = 39 Scaled Residual = 0.00748095 Iteration = 40 Scaled Residual = 0.00735622 Iteration = 41 Scaled Residual = 0.00721673 Iteration = 42 Scaled Residual = 0.00711174 Iteration = 43 Scaled Residual = 0.00697858 Iteration = 44 Scaled Residual = 0.00683246 Iteration = 45 Scaled Residual = 0.00661022 Iteration = 46 Scaled Residual = 0.00641003 Iteration = 47 Scaled Residual = 0.00626923 Iteration = 48 Scaled Residual = 0.00613979 Iteration = 49 Scaled Residual = 0.0059746 Iteration = 50 Scaled Residual = 0.0058424 Iteration = 51 Scaled Residual = 0.00570033 Iteration = 52 Scaled Residual = 0.00555774 Iteration = 53 Scaled Residual = 0.0054573 Iteration = 54 Scaled Residual = 0.0053623 Iteration = 55 Scaled Residual = 0.00532533 Iteration = 56 Scaled Residual = 0.00525372 Iteration = 57 Scaled Residual = 0.0051637 Iteration = 58 Scaled Residual = 0.00503338 Iteration = 59 Scaled Residual = 0.00497259 Iteration = 60 Scaled Residual = 0.00487764 Iteration = 61 Scaled Residual = 0.0047988 Call [0] Scaled Residual [0.0047988] Call [1] Scaled Residual [0.0047988] Call [2] Scaled Residual [0.0047988] Call [3] Scaled Residual [0.0047988] Call [4] Scaled Residual [0.0047988] Call [5] Scaled Residual [0.0047988] Call [6] Scaled Residual [0.0047988] Call [7] Scaled Residual [0.0047988] Call [8] Scaled Residual [0.0047988] Call [9] Scaled Residual [0.0047988] Call [10] Scaled Residual [0.0047988] Call [11] Scaled Residual [0.0047988] Call [12] Scaled Residual [0.0047988] Call [13] Scaled Residual [0.0047988] Call [14] Scaled Residual [0.0047988] Call [15] Scaled Residual [0.0047988] Call [16] Scaled Residual [0.0047988] Call [17] Scaled Residual [0.0047988] Call [18] Scaled Residual [0.0047988] Call [19] Scaled Residual [0.0047988] Call [20] Scaled Residual [0.0047988] Call [21] Scaled Residual [0.0047988] Call [22] Scaled Residual [0.0047988] Call [23] Scaled Residual [0.0047988] Call [24] Scaled Residual [0.0047988] Call [25] Scaled Residual [0.0047988] Call [26] Scaled Residual [0.0047988] Call [27] Scaled Residual [0.0047988] Call [28] Scaled Residual [0.0047988] Call [29] Scaled Residual [0.0047988] Call [30] Scaled Residual [0.0047988] Call [31] Scaled Residual [0.0047988] Call [32] Scaled Residual [0.0047988] Call [33] Scaled Residual [0.0047988] Call [34] Scaled Residual [0.0047988] Call [35] Scaled Residual [0.0047988] Call [36] Scaled Residual [0.0047988] Call [37] Scaled Residual [0.0047988] Call [38] Scaled Residual [0.0047988] Call [39] Scaled Residual [0.0047988] Call [40] Scaled Residual [0.0047988] Call [41] Scaled Residual [0.0047988] Call [42] Scaled Residual [0.0047988] Call [43] Scaled Residual [0.0047988] Call [44] Scaled Residual [0.0047988] Call [45] Scaled Residual [0.0047988] Call [46] Scaled Residual [0.0047988] Call [47] Scaled Residual [0.0047988] Call [48] Scaled Residual [0.0047988] Call [49] Scaled Residual [0.0047988] Call [50] Scaled Residual [0.0047988] Call [51] Scaled Residual [0.0047988] Call [52] Scaled Residual [0.0047988] Call [53] Scaled Residual [0.0047988] Call [54] Scaled Residual [0.0047988] Call [55] Scaled Residual [0.0047988] Call [56] Scaled Residual [0.0047988] Call [57] Scaled Residual [0.0047988] Call [58] Scaled Residual [0.0047988] Call [59] Scaled Residual [0.0047988] Call [60] Scaled Residual [0.0047988] Call [61] Scaled Residual [0.0047988] Call [62] Scaled Residual [0.0047988] Call [63] Scaled Residual [0.0047988] Call [64] Scaled Residual [0.0047988] Call [65] Scaled Residual [0.0047988] Call [66] Scaled Residual [0.0047988] Call [67] Scaled Residual [0.0047988] Call [68] Scaled Residual [0.0047988] Call [69] Scaled Residual [0.0047988] Call [70] Scaled Residual [0.0047988] Call [71] Scaled Residual [0.0047988] Call [72] Scaled Residual [0.0047988] Call [73] Scaled Residual [0.0047988] Call [74] Scaled Residual [0.0047988] Call [75] Scaled Residual [0.0047988] Call [76] Scaled Residual [0.0047988] Call [77] Scaled Residual [0.0047988] Call [78] Scaled Residual [0.0047988] Call [79] Scaled Residual [0.0047988] Call [80] Scaled Residual [0.0047988] Call [81] Scaled Residual [0.0047988] Call [82] Scaled Residual [0.0047988] Call [83] Scaled Residual [0.0047988] Call [84] Scaled Residual [0.0047988] Call [85] Scaled Residual [0.0047988] Call [86] Scaled Residual [0.0047988] Call [87] Scaled Residual [0.0047988] Call [88] Scaled Residual [0.0047988] Call [89] Scaled Residual [0.0047988] Call [90] Scaled Residual [0.0047988] Call [91] Scaled Residual [0.0047988] Call [92] Scaled Residual [0.0047988] Call [93] Scaled Residual [0.0047988] Call [94] Scaled Residual [0.0047988] Call [95] Scaled Residual [0.0047988] Call [96] Scaled Residual [0.0047988] Call [97] Scaled Residual [0.0047988] Call [98] Scaled Residual [0.0047988] Call [99] Scaled Residual [0.0047988] Call [100] Scaled Residual [0.0047988] Call [101] Scaled Residual [0.0047988] Call [102] Scaled Residual [0.0047988] Call [103] Scaled Residual [0.0047988] Call [104] Scaled Residual [0.0047988] Call [105] Scaled Residual [0.0047988] Call [106] Scaled Residual [0.0047988] Call [107] Scaled Residual [0.0047988] Call [108] Scaled Residual [0.0047988] Call [109] Scaled Residual [0.0047988] Call [110] Scaled Residual [0.0047988] Call [111] Scaled Residual [0.0047988] Call [112] Scaled Residual [0.0047988] Call [113] Scaled Residual [0.0047988] Call [114] Scaled Residual [0.0047988] Call [115] Scaled Residual [0.0047988] Call [116] Scaled Residual [0.0047988] Call [117] Scaled Residual [0.0047988] Call [118] Scaled Residual [0.0047988] Call [119] Scaled Residual [0.0047988] Call [120] Scaled Residual [0.0047988] Call [121] Scaled Residual [0.0047988] Call [122] Scaled Residual [0.0047988] Call [123] Scaled Residual [0.0047988] Call [124] Scaled Residual [0.0047988] Call [125] Scaled Residual [0.0047988] Call [126] Scaled Residual [0.0047988] Call [127] Scaled Residual [0.0047988] Call [128] Scaled Residual [0.0047988] Call [129] Scaled Residual [0.0047988] Call [130] Scaled Residual [0.0047988] Call [131] Scaled Residual [0.0047988] Call [132] Scaled Residual [0.0047988] Call [133] Scaled Residual [0.0047988] Call [134] Scaled Residual [0.0047988] Call [135] Scaled Residual [0.0047988] Call [136] Scaled Residual [0.0047988] Call [137] Scaled Residual [0.0047988] Call [138] Scaled Residual [0.0047988] Call [139] Scaled Residual [0.0047988] Call [140] Scaled Residual [0.0047988] Call [141] Scaled Residual [0.0047988] Call [142] Scaled Residual [0.0047988] Call [143] Scaled Residual [0.0047988] Call [144] Scaled Residual [0.0047988] Call [145] Scaled Residual [0.0047988] Call [146] Scaled Residual [0.0047988] Call [147] Scaled Residual [0.0047988] Call [148] Scaled Residual [0.0047988] Call [149] Scaled Residual [0.0047988] Call [150] Scaled Residual [0.0047988] Call [151] Scaled Residual [0.0047988] Call [152] Scaled Residual [0.0047988] Call [153] Scaled Residual [0.0047988] Call [154] Scaled Residual [0.0047988] Call [155] Scaled Residual [0.0047988] Call [156] Scaled Residual [0.0047988] Call [157] Scaled Residual [0.0047988] Call [158] Scaled Residual [0.0047988] Call [159] Scaled Residual [0.0047988] Call [160] Scaled Residual [0.0047988] Call [161] Scaled Residual [0.0047988] Call [162] Scaled Residual [0.0047988] Call [163] Scaled Residual [0.0047988] Call [164] Scaled Residual [0.0047988] Call [165] Scaled Residual [0.0047988] Call [166] Scaled Residual [0.0047988] Call [167] Scaled Residual [0.0047988] Call [168] Scaled Residual [0.0047988] Call [169] Scaled Residual [0.0047988] Call [170] Scaled Residual [0.0047988] Call [171] Scaled Residual [0.0047988] Call [172] Scaled Residual [0.0047988] Call [173] Scaled Residual [0.0047988] Call [174] Scaled Residual [0.0047988] Call [175] Scaled Residual [0.0047988] Call [176] Scaled Residual [0.0047988] Call [177] Scaled Residual [0.0047988] Call [178] Scaled Residual [0.0047988] Call [179] Scaled Residual [0.0047988] Call [180] Scaled Residual [0.0047988] Call [181] Scaled Residual [0.0047988] Call [182] Scaled Residual [0.0047988] Call [183] Scaled Residual [0.0047988] Call [184] Scaled Residual [0.0047988] Call [185] Scaled Residual [0.0047988] Call [186] Scaled Residual [0.0047988] Call [187] Scaled Residual [0.0047988] Call [188] Scaled Residual [0.0047988] Call [189] Scaled Residual [0.0047988] Call [190] Scaled Residual [0.0047988] Call [191] Scaled Residual [0.0047988] Call [192] Scaled Residual [0.0047988] Call [193] Scaled Residual [0.0047988] Call [194] Scaled Residual [0.0047988] Call [195] Scaled Residual [0.0047988] Call [196] Scaled Residual [0.0047988] Call [197] Scaled Residual [0.0047988] Call [198] Scaled Residual [0.0047988] Call [199] Scaled Residual [0.0047988] Call [200] Scaled Residual [0.0047988] Call [201] Scaled Residual [0.0047988] Call [202] Scaled Residual [0.0047988] Call [203] Scaled Residual [0.0047988] Call [204] Scaled Residual [0.0047988] Call [205] Scaled Residual [0.0047988] Call [206] Scaled Residual [0.0047988] Call [207] Scaled Residual [0.0047988] Call [208] Scaled Residual [0.0047988] Call [209] Scaled Residual [0.0047988] Call [210] Scaled Residual [0.0047988] Call [211] Scaled Residual [0.0047988] Call [212] Scaled Residual [0.0047988] Call [213] Scaled Residual [0.0047988] Call [214] Scaled Residual [0.0047988] Call [215] Scaled Residual [0.0047988] Call [216] Scaled Residual [0.0047988] Call [217] Scaled Residual [0.0047988] Call [218] Scaled Residual [0.0047988] Call [219] Scaled Residual [0.0047988] Call [220] Scaled Residual [0.0047988] Call [221] Scaled Residual [0.0047988] Call [222] Scaled Residual [0.0047988] Call [223] Scaled Residual [0.0047988] Call [224] Scaled Residual [0.0047988] Call [225] Scaled Residual [0.0047988] Call [226] Scaled Residual [0.0047988] Call [227] Scaled Residual [0.0047988] Call [228] Scaled Residual [0.0047988] Call [229] Scaled Residual [0.0047988] Call [230] Scaled Residual [0.0047988] Call [231] Scaled Residual [0.0047988] Call [232] Scaled Residual [0.0047988] Call [233] Scaled Residual [0.0047988] Call [234] Scaled Residual [0.0047988] Call [235] Scaled Residual [0.0047988] Call [236] Scaled Residual [0.0047988] Call [237] Scaled Residual [0.0047988] Call [238] Scaled Residual [0.0047988] Call [239] Scaled Residual [0.0047988] Call [240] Scaled Residual [0.0047988] Call [241] Scaled Residual [0.0047988] Call [242] Scaled Residual [0.0047988] Call [243] Scaled Residual [0.0047988] Call [244] Scaled Residual [0.0047988] Call [245] Scaled Residual [0.0047988] Call [246] Scaled Residual [0.0047988] Call [247] Scaled Residual [0.0047988] Call [248] Scaled Residual [0.0047988] Call [249] Scaled Residual [0.0047988] Call [250] Scaled Residual [0.0047988] Call [251] Scaled Residual [0.0047988] Call [252] Scaled Residual [0.0047988] Call [253] Scaled Residual [0.0047988] Call [254] Scaled Residual [0.0047988] Call [255] Scaled Residual [0.0047988] Call [256] Scaled Residual [0.0047988] Call [257] Scaled Residual [0.0047988] Call [258] Scaled Residual [0.0047988] Call [259] Scaled Residual [0.0047988] Call [260] Scaled Residual [0.0047988] Call [261] Scaled Residual [0.0047988] Call [262] Scaled Residual [0.0047988] Call [263] Scaled Residual [0.0047988] Call [264] Scaled Residual [0.0047988] Call [265] Scaled Residual [0.0047988] Call [266] Scaled Residual [0.0047988] Call [267] Scaled Residual [0.0047988] Call [268] Scaled Residual [0.0047988] Call [269] Scaled Residual [0.0047988] Call [270] Scaled Residual [0.0047988] Call [271] Scaled Residual [0.0047988] Call [272] Scaled Residual [0.0047988] Call [273] Scaled Residual [0.0047988] Call [274] Scaled Residual [0.0047988] Call [275] Scaled Residual [0.0047988] Call [276] Scaled Residual [0.0047988] Call [277] Scaled Residual [0.0047988] Call [278] Scaled Residual [0.0047988] Call [279] Scaled Residual [0.0047988] Call [280] Scaled Residual [0.0047988] Call [281] Scaled Residual [0.0047988] Call [282] Scaled Residual [0.0047988] Call [283] Scaled Residual [0.0047988] Call [284] Scaled Residual [0.0047988] Call [285] Scaled Residual [0.0047988] Call [286] Scaled Residual [0.0047988] Call [287] Scaled Residual [0.0047988] Call [288] Scaled Residual [0.0047988] Call [289] Scaled Residual [0.0047988] Call [290] Scaled Residual [0.0047988] Call [291] Scaled Residual [0.0047988] Call [292] Scaled Residual [0.0047988] Call [293] Scaled Residual [0.0047988] Call [294] Scaled Residual [0.0047988] Call [295] Scaled Residual [0.0047988] Call [296] Scaled Residual [0.0047988] Call [297] Scaled Residual [0.0047988] Call [298] Scaled Residual [0.0047988] Call [299] Scaled Residual [0.0047988] Call [300] Scaled Residual [0.0047988] Call [301] Scaled Residual [0.0047988] Call [302] Scaled Residual [0.0047988] Call [303] Scaled Residual [0.0047988] Call [304] Scaled Residual [0.0047988] Call [305] Scaled Residual [0.0047988] Call [306] Scaled Residual [0.0047988] Call [307] Scaled Residual [0.0047988] Call [308] Scaled Residual [0.0047988] Call [309] Scaled Residual [0.0047988] Call [310] Scaled Residual [0.0047988] Call [311] Scaled Residual [0.0047988] Call [312] Scaled Residual [0.0047988] Call [313] Scaled Residual [0.0047988] Call [314] Scaled Residual [0.0047988] Call [315] Scaled Residual [0.0047988] Call [316] Scaled Residual [0.0047988] Call [317] Scaled Residual [0.0047988] Call [318] Scaled Residual [0.0047988] Call [319] Scaled Residual [0.0047988] Call [320] Scaled Residual [0.0047988] Call [321] Scaled Residual [0.0047988] Call [322] Scaled Residual [0.0047988] Call [323] Scaled Residual [0.0047988] Call [324] Scaled Residual [0.0047988] Call [325] Scaled Residual [0.0047988] Call [326] Scaled Residual [0.0047988] Call [327] Scaled Residual [0.0047988] Call [328] Scaled Residual [0.0047988] Call [329] Scaled Residual [0.0047988] Call [330] Scaled Residual [0.0047988] Call [331] Scaled Residual [0.0047988] Call [332] Scaled Residual [0.0047988] Call [333] Scaled Residual [0.0047988] Call [334] Scaled Residual [0.0047988] Call [335] Scaled Residual [0.0047988] Call [336] Scaled Residual [0.0047988] Call [337] Scaled Residual [0.0047988] Call [338] Scaled Residual [0.0047988] Call [339] Scaled Residual [0.0047988] Call [340] Scaled Residual [0.0047988] Call [341] Scaled Residual [0.0047988] Call [342] Scaled Residual [0.0047988] Call [343] Scaled Residual [0.0047988] Call [344] Scaled Residual [0.0047988] Call [345] Scaled Residual [0.0047988] Call [346] Scaled Residual [0.0047988] Call [347] Scaled Residual [0.0047988] Call [348] Scaled Residual [0.0047988] Call [349] Scaled Residual [0.0047988] Call [350] Scaled Residual [0.0047988] Call [351] Scaled Residual [0.0047988] Call [352] Scaled Residual [0.0047988] Call [353] Scaled Residual [0.0047988] Call [354] Scaled Residual [0.0047988] Call [355] Scaled Residual [0.0047988] Call [356] Scaled Residual [0.0047988] Call [357] Scaled Residual [0.0047988] Call [358] Scaled Residual [0.0047988] Call [359] Scaled Residual [0.0047988] Call [360] Scaled Residual [0.0047988] Call [361] Scaled Residual [0.0047988] Call [362] Scaled Residual [0.0047988] Call [363] Scaled Residual [0.0047988] Call [364] Scaled Residual [0.0047988] Call [365] Scaled Residual [0.0047988] Call [366] Scaled Residual [0.0047988] Call [367] Scaled Residual [0.0047988] Call [368] Scaled Residual [0.0047988] Call [369] Scaled Residual [0.0047988] Call [370] Scaled Residual [0.0047988] Call [371] Scaled Residual [0.0047988] Call [372] Scaled Residual [0.0047988] Call [373] Scaled Residual [0.0047988] Call [374] Scaled Residual [0.0047988] Call [375] Scaled Residual [0.0047988] Call [376] Scaled Residual [0.0047988] Call [377] Scaled Residual [0.0047988] Call [378] Scaled Residual [0.0047988] Call [379] Scaled Residual [0.0047988] Call [380] Scaled Residual [0.0047988] Call [381] Scaled Residual [0.0047988] Call [382] Scaled Residual [0.0047988] Call [383] Scaled Residual [0.0047988] Call [384] Scaled Residual [0.0047988] Call [385] Scaled Residual [0.0047988] Call [386] Scaled Residual [0.0047988] Call [387] Scaled Residual [0.0047988] Call [388] Scaled Residual [0.0047988] Call [389] Scaled Residual [0.0047988] Call [390] Scaled Residual [0.0047988] Call [391] Scaled Residual [0.0047988] Call [392] Scaled Residual [0.0047988] Call [393] Scaled Residual [0.0047988] Call [394] Scaled Residual [0.0047988] Call [395] Scaled Residual [0.0047988] Call [396] Scaled Residual [0.0047988] Call [397] Scaled Residual [0.0047988] Call [398] Scaled Residual [0.0047988] Call [399] Scaled Residual [0.0047988] Call [400] Scaled Residual [0.0047988] Call [401] Scaled Residual [0.0047988] Call [402] Scaled Residual [0.0047988] Call [403] Scaled Residual [0.0047988] Call [404] Scaled Residual [0.0047988] Call [405] Scaled Residual [0.0047988] Call [406] Scaled Residual [0.0047988] Call [407] Scaled Residual [0.0047988] Call [408] Scaled Residual [0.0047988] Call [409] Scaled Residual [0.0047988] Call [410] Scaled Residual [0.0047988] Call [411] Scaled Residual [0.0047988] Call [412] Scaled Residual [0.0047988] Call [413] Scaled Residual [0.0047988] Call [414] Scaled Residual [0.0047988] Call [415] Scaled Residual [0.0047988] Call [416] Scaled Residual [0.0047988] Call [417] Scaled Residual [0.0047988] Call [418] Scaled Residual [0.0047988] Call [419] Scaled Residual [0.0047988] Call [420] Scaled Residual [0.0047988] Call [421] Scaled Residual [0.0047988] Call [422] Scaled Residual [0.0047988] Call [423] Scaled Residual [0.0047988] Call [424] Scaled Residual [0.0047988] Call [425] Scaled Residual [0.0047988] Call [426] Scaled Residual [0.0047988] Call [427] Scaled Residual [0.0047988] Call [428] Scaled Residual [0.0047988] Call [429] Scaled Residual [0.0047988] Call [430] Scaled Residual [0.0047988] Call [431] Scaled Residual [0.0047988] Call [432] Scaled Residual [0.0047988] Call [433] Scaled Residual [0.0047988] Call [434] Scaled Residual [0.0047988] Call [435] Scaled Residual [0.0047988] Call [436] Scaled Residual [0.0047988] Call [437] Scaled Residual [0.0047988] Call [438] Scaled Residual [0.0047988] Call [439] Scaled Residual [0.0047988] Call [440] Scaled Residual [0.0047988] Call [441] Scaled Residual [0.0047988] Call [442] Scaled Residual [0.0047988] Call [443] Scaled Residual [0.0047988] Call [444] Scaled Residual [0.0047988] Call [445] Scaled Residual [0.0047988] Call [446] Scaled Residual [0.0047988] Call [447] Scaled Residual [0.0047988] Call [448] Scaled Residual [0.0047988] Call [449] Scaled Residual [0.0047988] Call [450] Scaled Residual [0.0047988] Call [451] Scaled Residual [0.0047988] Call [452] Scaled Residual [0.0047988] Call [453] Scaled Residual [0.0047988] Call [454] Scaled Residual [0.0047988] Call [455] Scaled Residual [0.0047988] Call [456] Scaled Residual [0.0047988] Call [457] Scaled Residual [0.0047988] Call [458] Scaled Residual [0.0047988] Call [459] Scaled Residual [0.0047988] Call [460] Scaled Residual [0.0047988] Call [461] Scaled Residual [0.0047988] Call [462] Scaled Residual [0.0047988] Call [463] Scaled Residual [0.0047988] Call [464] Scaled Residual [0.0047988] Call [465] Scaled Residual [0.0047988] Call [466] Scaled Residual [0.0047988] Call [467] Scaled Residual [0.0047988] Call [468] Scaled Residual [0.0047988] Call [469] Scaled Residual [0.0047988] HPCG-Benchmark version=3.1 Release date=March 28, 2019 Machine Summary= Machine Summary::Distributed Processes=352 Machine Summary::Threads per processes=64 Global Problem Dimensions= Global Problem Dimensions::Global nx=1664 Global Problem Dimensions::Global ny=3328 Global Problem Dimensions::Global nz=4576 Processor Dimensions= Processor Dimensions::npx=4 Processor Dimensions::npy=8 Processor Dimensions::npz=11 Local Domain Dimensions= Local Domain Dimensions::nx=416 Local Domain Dimensions::ny=416 ########## Problem Summary ##########= Setup Information= Setup Information::Setup Time=0.101863 Linear System Information= Linear System Information::Number of Equations=25340936192 Linear System Information::Number of Nonzero Terms=683694530680 Multigrid Information= Multigrid Information::Number of coarse grid levels=3 Multigrid Information::Coarse Grids= Multigrid Information::Coarse Grids::Grid Level=1 Multigrid Information::Coarse Grids::Number of Equations=3167617024 Multigrid Information::Coarse Grids::Number of Nonzero Terms=85398001720 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=2 Multigrid Information::Coarse Grids::Number of Equations=395952128 Multigrid Information::Coarse Grids::Number of Nonzero Terms=10658807320 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=3 Multigrid Information::Coarse Grids::Number of Equations=49494016 Multigrid Information::Coarse Grids::Number of Nonzero Terms=1328370568 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 ########## Memory Use Summary ##########= Memory Use Information= Memory Use Information::Total memory used for data (Gbytes)=18114.8 Memory Use Information::Memory used for OptimizeProblem data (Gbytes)=0 Memory Use Information::Bytes per equation (Total memory / Number of Equations)=714.843 Memory Use Information::Memory used for linear system and CG (Gbytes)=15942.4 Memory Use Information::Coarse Grids= Memory Use Information::Coarse Grids::Grid Level=1 Memory Use Information::Coarse Grids::Memory used=1904.47 Memory Use Information::Coarse Grids::Grid Level=2 Memory Use Information::Coarse Grids::Memory used=238.152 Memory Use Information::Coarse Grids::Grid Level=3 Memory Use Information::Coarse Grids::Memory used=29.7926 ########## V&V Testing Summary ##########= Spectral Convergence Tests= Spectral Convergence Tests::Result=PASSED Spectral Convergence Tests::Unpreconditioned= Spectral Convergence Tests::Unpreconditioned::Maximum iteration count=11 Spectral Convergence Tests::Unpreconditioned::Expected iteration count=12 Spectral Convergence Tests::Preconditioned= Spectral Convergence Tests::Preconditioned::Maximum iteration count=2 Spectral Convergence Tests::Preconditioned::Expected iteration count=2 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon= Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Result=PASSED Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for SpMV=0 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for MG=2.3626e-14 ########## Iterations Summary ##########= Iteration Count Information= Iteration Count Information::Result=PASSED Iteration Count Information::Reference CG iterations per set=50 Iteration Count Information::Optimized CG iterations per set=61 Iteration Count Information::Total number of reference iterations=23500 Iteration Count Information::Total number of optimized iterations=28670 ########## Reproducibility Summary ##########= Reproducibility Information= Reproducibility Information::Result=PASSED Reproducibility Information::Scaled residual mean=0.0047988 Reproducibility Information::Scaled residual variance=2.88121e-38 ########## Performance Summary (times in sec) ##########= Benchmark Time Summary= Benchmark Time Summary::Optimization phase=0.236881 Benchmark Time Summary::DDOT=61.3261 Benchmark Time Summary::WAXPBY=66.5672 Benchmark Time Summary::SpMV=336.703 Benchmark Time Summary::MG=1447.28 Benchmark Time Summary::Total=1911.94 Floating Point Operations Summary= Floating Point Operations Summary::Raw DDOT=4.38297e+15 Floating Point Operations Summary::Raw WAXPBY=4.38297e+15 Floating Point Operations Summary::Raw SpMV=3.98457e+16 Floating Point Operations Summary::Raw MG=2.23707e+17 Floating Point Operations Summary::Total=2.72319e+17 Floating Point Operations Summary::Total with convergence overhead=2.23212e+17 GB/s Summary= GB/s Summary::Raw Read B/W=877252 GB/s Summary::Raw Write B/W=202814 GB/s Summary::Raw Total B/W=1.08007e+06 GB/s Summary::Total with convergence and optimization phase overhead=877989 GFLOP/s Summary= GFLOP/s Summary::Raw DDOT=71469.9 GFLOP/s Summary::Raw WAXPBY=65842.7 GFLOP/s Summary::Raw SpMV=118341 GFLOP/s Summary::Raw MG=154570 GFLOP/s Summary::Raw Total=142431 GFLOP/s Summary::Total with convergence overhead=116746 GFLOP/s Summary::Total with convergence and optimization phase overhead=115782 User Optimization Overheads= User Optimization Overheads::Optimization phase time (sec)=0.236881 User Optimization Overheads::Optimization phase time vs reference SpMV+MG time=0.0262632 DDOT Timing Variations= DDOT Timing Variations::Min DDOT MPI_Allreduce time=8.69856 DDOT Timing Variations::Max DDOT MPI_Allreduce time=21.3691 DDOT Timing Variations::Avg DDOT MPI_Allreduce time=12.5618 Final Summary= Final Summary::HPCG result is VALID with a GFLOP/s rating of=115782 Final Summary::HPCG 2.4 rating for historical reasons is=116071 Final Summary::Please upload results from the YAML file contents to=http://hpcg-benchmark.org Fri Aug 23 11:17:54 CEST 2024