##### HPCG - Job ID : 1047408 ##### Running on 1089 nodes : as01r1b[01-30,32],as01r2b[01-08,10-22,24-32],as01r3b[01,03-32],as01r4b[01-32],as01r5b[02-32],as02r1b[01,03-32],as02r2b[01-04,06-32],as02r3b[01-10,12-32],as02r4b[01-23,25-32],as02r5b[01-32],as03r1b[01-32],as03r2b[01-32],as03r3b[01-09,11,13-32],as03r4b[01-32],as03r5b[01-32],as04r1b[01-31],as04r2b[01-32],as04r3b[01-08,10-32],as04r4b[01-16,18-32],as04r5b[01-09,11-14,16-17,19-32],as05r1b[01-32],as05r2b[01-22,25-32],as05r3b[01-04,06-32],as05r4b[01-27,29-32],as05r5b[01-32],as06r1b[01-32],as06r2b[01-27,29-32],as06r3b[01-32],as06r4b[01-22,24-32],as06r5b[01-32],as07r1b[01-09,11-32],as07r2b[01-11,14-15,17-32],as07r3b[01-32],as07r4b[01-10,12-30,32],as07r5b[01-13,15-31] Number of tasks : 4356 with 4 tasks per node load SINGULARITY/3.11.5 (PATH) Build v0.2.1 Start of application (GPU-Only) ... Initial Residual = 153800 Iteration = 1 Scaled Residual = 0.187086 Iteration = 2 Scaled Residual = 0.102873 Iteration = 3 Scaled Residual = 0.0710729 Iteration = 4 Scaled Residual = 0.0543328 Iteration = 5 Scaled Residual = 0.0439607 Iteration = 6 Scaled Residual = 0.0369008 Iteration = 7 Scaled Residual = 0.0317954 Iteration = 8 Scaled Residual = 0.0279473 Iteration = 9 Scaled Residual = 0.0249548 Iteration = 10 Scaled Residual = 0.0225632 Iteration = 11 Scaled Residual = 0.0206017 Iteration = 12 Scaled Residual = 0.0189531 Iteration = 13 Scaled Residual = 0.0175366 Iteration = 14 Scaled Residual = 0.0163015 Iteration = 15 Scaled Residual = 0.0152178 Iteration = 16 Scaled Residual = 0.0142658 Iteration = 17 Scaled Residual = 0.0134317 Iteration = 18 Scaled Residual = 0.0127019 Iteration = 19 Scaled Residual = 0.0120603 Iteration = 20 Scaled Residual = 0.0114902 Iteration = 21 Scaled Residual = 0.0109753 Iteration = 22 Scaled Residual = 0.0105021 Iteration = 23 Scaled Residual = 0.0100636 Iteration = 24 Scaled Residual = 0.00965881 Iteration = 25 Scaled Residual = 0.00928967 Iteration = 26 Scaled Residual = 0.00895964 Iteration = 27 Scaled Residual = 0.00866982 Iteration = 28 Scaled Residual = 0.00841693 Iteration = 29 Scaled Residual = 0.00819395 Iteration = 30 Scaled Residual = 0.00799041 Iteration = 31 Scaled Residual = 0.0077958 Iteration = 32 Scaled Residual = 0.00760399 Iteration = 33 Scaled Residual = 0.00741325 Iteration = 34 Scaled Residual = 0.00722483 Iteration = 35 Scaled Residual = 0.00703999 Iteration = 36 Scaled Residual = 0.00685648 Iteration = 37 Scaled Residual = 0.00666997 Iteration = 38 Scaled Residual = 0.00647785 Iteration = 39 Scaled Residual = 0.00628178 Iteration = 40 Scaled Residual = 0.00608905 Iteration = 41 Scaled Residual = 0.00590958 Iteration = 42 Scaled Residual = 0.00575109 Iteration = 43 Scaled Residual = 0.00561712 Iteration = 44 Scaled Residual = 0.00550611 Iteration = 45 Scaled Residual = 0.00541158 Iteration = 46 Scaled Residual = 0.00532505 Iteration = 47 Scaled Residual = 0.00523907 Iteration = 48 Scaled Residual = 0.00514959 Iteration = 49 Scaled Residual = 0.0050571 Iteration = 50 Scaled Residual = 0.00496391 GPU Rank Info: | Storage Format = SELL, Optimization = HAND-TUNED | cuSPARSE version 12.2 | Reference CPU memory = 29040.19 MB | GPU Name: 'NVIDIA H100' | GPU Memory Use: 60140 MB / 64952 MB | Process Grid: 11x18x22 | Local Domain: 512x512x288 | Number of CPU Threads: 20 WARNING: PERFORMING UNPRECONDITIONED ITERATIONS Call [0] Number of Iterations [11] Scaled Residual [1.19812e-14] WARNING: PERFORMING UNPRECONDITIONED ITERATIONS Call [1] Number of Iterations [11] Scaled Residual [1.19812e-14] Call [0] Number of Iterations [2] Scaled Residual [1.57371e-17] Call [1] Number of Iterations [2] Scaled Residual [1.57371e-17] Departure from symmetry (scaled) for SpMV abs(x'*A*y - y'*A*x) = 7.0139e-17 Departure from symmetry (scaled) for MG abs(x'*Minv*y - y'*Minv*x) = 0 SpMV call [0] Residual [0] SpMV call [1] Residual [0] Initial Residual = 153800 Iteration = 1 Scaled Residual = 0.220828 Iteration = 2 Scaled Residual = 0.119612 Iteration = 3 Scaled Residual = 0.0814484 Iteration = 4 Scaled Residual = 0.061732 Iteration = 5 Scaled Residual = 0.0497599 Iteration = 6 Scaled Residual = 0.0416806 Iteration = 7 Scaled Residual = 0.0358757 Iteration = 8 Scaled Residual = 0.0315078 Iteration = 9 Scaled Residual = 0.028091 Iteration = 10 Scaled Residual = 0.025349 Iteration = 11 Scaled Residual = 0.0231005 Iteration = 12 Scaled Residual = 0.0212198 Iteration = 13 Scaled Residual = 0.0196281 Iteration = 14 Scaled Residual = 0.0182623 Iteration = 15 Scaled Residual = 0.0170761 Iteration = 16 Scaled Residual = 0.0160384 Iteration = 17 Scaled Residual = 0.0151233 Iteration = 18 Scaled Residual = 0.0143117 Iteration = 19 Scaled Residual = 0.013588 Iteration = 20 Scaled Residual = 0.0129392 Iteration = 21 Scaled Residual = 0.0123559 Iteration = 22 Scaled Residual = 0.01183 Iteration = 23 Scaled Residual = 0.0113543 Iteration = 24 Scaled Residual = 0.0109222 Iteration = 25 Scaled Residual = 0.0105265 Iteration = 26 Scaled Residual = 0.0101621 Iteration = 27 Scaled Residual = 0.0098232 Iteration = 28 Scaled Residual = 0.0095039 Iteration = 29 Scaled Residual = 0.00919997 Iteration = 30 Scaled Residual = 0.00890753 Iteration = 31 Scaled Residual = 0.00862465 Iteration = 32 Scaled Residual = 0.00835187 Iteration = 33 Scaled Residual = 0.00808942 Iteration = 34 Scaled Residual = 0.00783888 Iteration = 35 Scaled Residual = 0.00760239 Iteration = 36 Scaled Residual = 0.00738077 Iteration = 37 Scaled Residual = 0.00717473 Iteration = 38 Scaled Residual = 0.00698434 Iteration = 39 Scaled Residual = 0.00680822 Iteration = 40 Scaled Residual = 0.0066456 Iteration = 41 Scaled Residual = 0.00649518 Iteration = 42 Scaled Residual = 0.00635471 Iteration = 43 Scaled Residual = 0.00622236 Iteration = 44 Scaled Residual = 0.00609592 Iteration = 45 Scaled Residual = 0.00597269 Iteration = 46 Scaled Residual = 0.00585102 Iteration = 47 Scaled Residual = 0.00572935 Iteration = 48 Scaled Residual = 0.005607 Iteration = 49 Scaled Residual = 0.00548514 Iteration = 50 Scaled Residual = 0.00536541 Iteration = 51 Scaled Residual = 0.00524962 Iteration = 52 Scaled Residual = 0.00513989 Iteration = 53 Scaled Residual = 0.00503741 Iteration = 54 Scaled Residual = 0.004943 Call [0] Scaled Residual [0.004943] Call [1] Scaled Residual [0.004943] Call [2] Scaled Residual [0.004943] Call [3] Scaled Residual [0.004943] Call [4] Scaled Residual [0.004943] Call [5] Scaled Residual [0.004943] Call [6] Scaled Residual [0.004943] Call [7] Scaled Residual [0.004943] Call [8] Scaled Residual [0.004943] Call [9] Scaled Residual [0.004943] Call [10] Scaled Residual [0.004943] Call [11] Scaled Residual [0.004943] Call [12] Scaled Residual [0.004943] Call [13] Scaled Residual [0.004943] Call [14] Scaled Residual [0.004943] Call [15] Scaled Residual [0.004943] Call [16] Scaled Residual [0.004943] Call [17] Scaled Residual [0.004943] Call [18] Scaled Residual [0.004943] Call [19] Scaled Residual [0.004943] Call [20] Scaled Residual [0.004943] Call [21] Scaled Residual [0.004943] Call [22] Scaled Residual [0.004943] Call [23] Scaled Residual [0.004943] Call [24] Scaled Residual [0.004943] Call [25] Scaled Residual [0.004943] Call [26] Scaled Residual [0.004943] Call [27] Scaled Residual [0.004943] Call [28] Scaled Residual [0.004943] Call [29] Scaled Residual [0.004943] Call [30] Scaled Residual [0.004943] Call [31] Scaled Residual [0.004943] Call [32] Scaled Residual [0.004943] Call [33] Scaled Residual [0.004943] Call [34] Scaled Residual [0.004943] Call [35] Scaled Residual [0.004943] Call [36] Scaled Residual [0.004943] Call [37] Scaled Residual [0.004943] Call [38] Scaled Residual [0.004943] Call [39] Scaled Residual [0.004943] Call [40] Scaled Residual [0.004943] Call [41] Scaled Residual [0.004943] Call [42] Scaled Residual [0.004943] Call [43] Scaled Residual [0.004943] Call [44] Scaled Residual [0.004943] Call [45] Scaled Residual [0.004943] Call [46] Scaled Residual [0.004943] Call [47] Scaled Residual [0.004943] Call [48] Scaled Residual [0.004943] Call [49] Scaled Residual [0.004943] Call [50] Scaled Residual [0.004943] Call [51] Scaled Residual [0.004943] Call [52] Scaled Residual [0.004943] Call [53] Scaled Residual [0.004943] Call [54] Scaled Residual [0.004943] Call [55] Scaled Residual [0.004943] Call [56] Scaled Residual [0.004943] Call [57] Scaled Residual [0.004943] Call [58] Scaled Residual [0.004943] Call [59] Scaled Residual [0.004943] Call [60] Scaled Residual [0.004943] Call [61] Scaled Residual [0.004943] Call [62] Scaled Residual [0.004943] Call [63] Scaled Residual [0.004943] Call [64] Scaled Residual [0.004943] Call [65] Scaled Residual [0.004943] Call [66] Scaled Residual [0.004943] Call [67] Scaled Residual [0.004943] Call [68] Scaled Residual [0.004943] Call [69] Scaled Residual [0.004943] Call [70] Scaled Residual [0.004943] Call [71] Scaled Residual [0.004943] Call [72] Scaled Residual [0.004943] Call [73] Scaled Residual [0.004943] Call [74] Scaled Residual [0.004943] Call [75] Scaled Residual [0.004943] Call [76] Scaled Residual [0.004943] Call [77] Scaled Residual [0.004943] Call [78] Scaled Residual [0.004943] Call [79] Scaled Residual [0.004943] Call [80] Scaled Residual [0.004943] Call [81] Scaled Residual [0.004943] Call [82] Scaled Residual [0.004943] Call [83] Scaled Residual [0.004943] Call [84] Scaled Residual [0.004943] Call [85] Scaled Residual [0.004943] Call [86] Scaled Residual [0.004943] Call [87] Scaled Residual [0.004943] Call [88] Scaled Residual [0.004943] Call [89] Scaled Residual [0.004943] Call [90] Scaled Residual [0.004943] Call [91] Scaled Residual [0.004943] Call [92] Scaled Residual [0.004943] Call [93] Scaled Residual [0.004943] Call [94] Scaled Residual [0.004943] Call [95] Scaled Residual [0.004943] Call [96] Scaled Residual [0.004943] Call [97] Scaled Residual [0.004943] Call [98] Scaled Residual [0.004943] Call [99] Scaled Residual [0.004943] Call [100] Scaled Residual [0.004943] Call [101] Scaled Residual [0.004943] Call [102] Scaled Residual [0.004943] Call [103] Scaled Residual [0.004943] Call [104] Scaled Residual [0.004943] Call [105] Scaled Residual [0.004943] Call [106] Scaled Residual [0.004943] Call [107] Scaled Residual [0.004943] Call [108] Scaled Residual [0.004943] Call [109] Scaled Residual [0.004943] Call [110] Scaled Residual [0.004943] Call [111] Scaled Residual [0.004943] Call [112] Scaled Residual [0.004943] Call [113] Scaled Residual [0.004943] Call [114] Scaled Residual [0.004943] Call [115] Scaled Residual [0.004943] Call [116] Scaled Residual [0.004943] Call [117] Scaled Residual [0.004943] Call [118] Scaled Residual [0.004943] Call [119] Scaled Residual [0.004943] Call [120] Scaled Residual [0.004943] Call [121] Scaled Residual [0.004943] Call [122] Scaled Residual [0.004943] Call [123] Scaled Residual [0.004943] Call [124] Scaled Residual [0.004943] Call [125] Scaled Residual [0.004943] Call [126] Scaled Residual [0.004943] Call [127] Scaled Residual [0.004943] Call [128] Scaled Residual [0.004943] Call [129] Scaled Residual [0.004943] Call [130] Scaled Residual [0.004943] Call [131] Scaled Residual [0.004943] Call [132] Scaled Residual [0.004943] Call [133] Scaled Residual [0.004943] Call [134] Scaled Residual [0.004943] Call [135] Scaled Residual [0.004943] Call [136] Scaled Residual [0.004943] Call [137] Scaled Residual [0.004943] Call [138] Scaled Residual [0.004943] Call [139] Scaled Residual [0.004943] Call [140] Scaled Residual [0.004943] Call [141] Scaled Residual [0.004943] Call [142] Scaled Residual [0.004943] Call [143] Scaled Residual [0.004943] Call [144] Scaled Residual [0.004943] Call [145] Scaled Residual [0.004943] Call [146] Scaled Residual [0.004943] Call [147] Scaled Residual [0.004943] Call [148] Scaled Residual [0.004943] Call [149] Scaled Residual [0.004943] Call [150] Scaled Residual [0.004943] Call [151] Scaled Residual [0.004943] Call [152] Scaled Residual [0.004943] Call [153] Scaled Residual [0.004943] Call [154] Scaled Residual [0.004943] Call [155] Scaled Residual [0.004943] Call [156] Scaled Residual [0.004943] Call [157] Scaled Residual [0.004943] Call [158] Scaled Residual [0.004943] Call [159] Scaled Residual [0.004943] Call [160] Scaled Residual [0.004943] Call [161] Scaled Residual [0.004943] Call [162] Scaled Residual [0.004943] Call [163] Scaled Residual [0.004943] Call [164] Scaled Residual [0.004943] Call [165] Scaled Residual [0.004943] Call [166] Scaled Residual [0.004943] Call [167] Scaled Residual [0.004943] Call [168] Scaled Residual [0.004943] Call [169] Scaled Residual [0.004943] Call [170] Scaled Residual [0.004943] Call [171] Scaled Residual [0.004943] Call [172] Scaled Residual [0.004943] Call [173] Scaled Residual [0.004943] Call [174] Scaled Residual [0.004943] Call [175] Scaled Residual [0.004943] Call [176] Scaled Residual [0.004943] Call [177] Scaled Residual [0.004943] Call [178] Scaled Residual [0.004943] Call [179] Scaled Residual [0.004943] Call [180] Scaled Residual [0.004943] Call [181] Scaled Residual [0.004943] Call [182] Scaled Residual [0.004943] Call [183] Scaled Residual [0.004943] Call [184] Scaled Residual [0.004943] Call [185] Scaled Residual [0.004943] Call [186] Scaled Residual [0.004943] Call [187] Scaled Residual [0.004943] Call [188] Scaled Residual [0.004943] Call [189] Scaled Residual [0.004943] Call [190] Scaled Residual [0.004943] Call [191] Scaled Residual [0.004943] Call [192] Scaled Residual [0.004943] Call [193] Scaled Residual [0.004943] Call [194] Scaled Residual [0.004943] Call [195] Scaled Residual [0.004943] Call [196] Scaled Residual [0.004943] Call [197] Scaled Residual [0.004943] Call [198] Scaled Residual [0.004943] Call [199] Scaled Residual [0.004943] Call [200] Scaled Residual [0.004943] Call [201] Scaled Residual [0.004943] Call [202] Scaled Residual [0.004943] Call [203] Scaled Residual [0.004943] Call [204] Scaled Residual [0.004943] Call [205] Scaled Residual [0.004943] Call [206] Scaled Residual [0.004943] Call [207] Scaled Residual [0.004943] Call [208] Scaled Residual [0.004943] Call [209] Scaled Residual [0.004943] Call [210] Scaled Residual [0.004943] Call [211] Scaled Residual [0.004943] Call [212] Scaled Residual [0.004943] Call [213] Scaled Residual [0.004943] Call [214] Scaled Residual [0.004943] Call [215] Scaled Residual [0.004943] Call [216] Scaled Residual [0.004943] Call [217] Scaled Residual [0.004943] Call [218] Scaled Residual [0.004943] Call [219] Scaled Residual [0.004943] Call [220] Scaled Residual [0.004943] Call [221] Scaled Residual [0.004943] Call [222] Scaled Residual [0.004943] Call [223] Scaled Residual [0.004943] Call [224] Scaled Residual [0.004943] Call [225] Scaled Residual [0.004943] Call [226] Scaled Residual [0.004943] Call [227] Scaled Residual [0.004943] Call [228] Scaled Residual [0.004943] Call [229] Scaled Residual [0.004943] Call [230] Scaled Residual [0.004943] Call [231] Scaled Residual [0.004943] Call [232] Scaled Residual [0.004943] Call [233] Scaled Residual [0.004943] Call [234] Scaled Residual [0.004943] Call [235] Scaled Residual [0.004943] Call [236] Scaled Residual [0.004943] Call [237] Scaled Residual [0.004943] Call [238] Scaled Residual [0.004943] Call [239] Scaled Residual [0.004943] Call [240] Scaled Residual [0.004943] Call [241] Scaled Residual [0.004943] Call [242] Scaled Residual [0.004943] Call [243] Scaled Residual [0.004943] Call [244] Scaled Residual [0.004943] Call [245] Scaled Residual [0.004943] Call [246] Scaled Residual [0.004943] Call [247] Scaled Residual [0.004943] Call [248] Scaled Residual [0.004943] Call [249] Scaled Residual [0.004943] Call [250] Scaled Residual [0.004943] Call [251] Scaled Residual [0.004943] Call [252] Scaled Residual [0.004943] Call [253] Scaled Residual [0.004943] Call [254] Scaled Residual [0.004943] Call [255] Scaled Residual [0.004943] Call [256] Scaled Residual [0.004943] Call [257] Scaled Residual [0.004943] Call [258] Scaled Residual [0.004943] Call [259] Scaled Residual [0.004943] Call [260] Scaled Residual [0.004943] Call [261] Scaled Residual [0.004943] Call [262] Scaled Residual [0.004943] Call [263] Scaled Residual [0.004943] Call [264] Scaled Residual [0.004943] Call [265] Scaled Residual [0.004943] Call [266] Scaled Residual [0.004943] Call [267] Scaled Residual [0.004943] Call [268] Scaled Residual [0.004943] Call [269] Scaled Residual [0.004943] Call [270] Scaled Residual [0.004943] Call [271] Scaled Residual [0.004943] Call [272] Scaled Residual [0.004943] Call [273] Scaled Residual [0.004943] Call [274] Scaled Residual [0.004943] Call [275] Scaled Residual [0.004943] Call [276] Scaled Residual [0.004943] Call [277] Scaled Residual [0.004943] Call [278] Scaled Residual [0.004943] Call [279] Scaled Residual [0.004943] Call [280] Scaled Residual [0.004943] Call [281] Scaled Residual [0.004943] Call [282] Scaled Residual [0.004943] Call [283] Scaled Residual [0.004943] Call [284] Scaled Residual [0.004943] Call [285] Scaled Residual [0.004943] Call [286] Scaled Residual [0.004943] Call [287] Scaled Residual [0.004943] Call [288] Scaled Residual [0.004943] Call [289] Scaled Residual [0.004943] Call [290] Scaled Residual [0.004943] Call [291] Scaled Residual [0.004943] Call [292] Scaled Residual [0.004943] Call [293] Scaled Residual [0.004943] Call [294] Scaled Residual [0.004943] Call [295] Scaled Residual [0.004943] Call [296] Scaled Residual [0.004943] Call [297] Scaled Residual [0.004943] Call [298] Scaled Residual [0.004943] Call [299] Scaled Residual [0.004943] Call [300] Scaled Residual [0.004943] Call [301] Scaled Residual [0.004943] Call [302] Scaled Residual [0.004943] Call [303] Scaled Residual [0.004943] Call [304] Scaled Residual [0.004943] Call [305] Scaled Residual [0.004943] Call [306] Scaled Residual [0.004943] Call [307] Scaled Residual [0.004943] Call [308] Scaled Residual [0.004943] Call [309] Scaled Residual [0.004943] Call [310] Scaled Residual [0.004943] Call [311] Scaled Residual [0.004943] Call [312] Scaled Residual [0.004943] Call [313] Scaled Residual [0.004943] Call [314] Scaled Residual [0.004943] Call [315] Scaled Residual [0.004943] Call [316] Scaled Residual [0.004943] Call [317] Scaled Residual [0.004943] Call [318] Scaled Residual [0.004943] Call [319] Scaled Residual [0.004943] Call [320] Scaled Residual [0.004943] Call [321] Scaled Residual [0.004943] Call [322] Scaled Residual [0.004943] Call [323] Scaled Residual [0.004943] Call [324] Scaled Residual [0.004943] Call [325] Scaled Residual [0.004943] Call [326] Scaled Residual [0.004943] Call [327] Scaled Residual [0.004943] Call [328] Scaled Residual [0.004943] Call [329] Scaled Residual [0.004943] Call [330] Scaled Residual [0.004943] Call [331] Scaled Residual [0.004943] Call [332] Scaled Residual [0.004943] Call [333] Scaled Residual [0.004943] Call [334] Scaled Residual [0.004943] Call [335] Scaled Residual [0.004943] Call [336] Scaled Residual [0.004943] Call [337] Scaled Residual [0.004943] Call [338] Scaled Residual [0.004943] Call [339] Scaled Residual [0.004943] Call [340] Scaled Residual [0.004943] Call [341] Scaled Residual [0.004943] Call [342] Scaled Residual [0.004943] Call [343] Scaled Residual [0.004943] Call [344] Scaled Residual [0.004943] Call [345] Scaled Residual [0.004943] Call [346] Scaled Residual [0.004943] Call [347] Scaled Residual [0.004943] Call [348] Scaled Residual [0.004943] Call [349] Scaled Residual [0.004943] Call [350] Scaled Residual [0.004943] Call [351] Scaled Residual [0.004943] Call [352] Scaled Residual [0.004943] Call [353] Scaled Residual [0.004943] Call [354] Scaled Residual [0.004943] Call [355] Scaled Residual [0.004943] HPCG-Benchmark version=3.1 Release date=March 28, 2019 Machine Summary= Machine Summary::Distributed Processes=4356 Machine Summary::Threads per processes=20 Global Problem Dimensions= Global Problem Dimensions::Global nx=5632 Global Problem Dimensions::Global ny=9216 Global Problem Dimensions::Global nz=6336 Processor Dimensions= Processor Dimensions::npx=11 Processor Dimensions::npy=18 Processor Dimensions::npz=22 Local Domain Dimensions= Local Domain Dimensions::nx=512 Local Domain Dimensions::ny=512 ########## Problem Summary ##########= Setup Information= Setup Information::Setup Time=0.205921 Linear System Information= Linear System Information::Number of Equations=328866988032 Linear System Information::Number of Nonzero Terms=8876781265144 Multigrid Information= Multigrid Information::Number of coarse grid levels=3 Multigrid Information::Coarse Grids= Multigrid Information::Coarse Grids::Grid Level=1 Multigrid Information::Coarse Grids::Number of Equations=41108373504 Multigrid Information::Coarse Grids::Number of Nonzero Terms=1109269295224 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=2 Multigrid Information::Coarse Grids::Number of Equations=5138546688 Multigrid Information::Coarse Grids::Number of Nonzero Terms=138576595000 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=3 Multigrid Information::Coarse Grids::Number of Equations=642318336 Multigrid Information::Coarse Grids::Number of Nonzero Terms=17301569560 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 ########## Memory Use Summary ##########= Memory Use Information= Memory Use Information::Total memory used for data (Gbytes)=235090 Memory Use Information::Memory used for OptimizeProblem data (Gbytes)=0 Memory Use Information::Bytes per equation (Total memory / Number of Equations)=714.847 Memory Use Information::Memory used for linear system and CG (Gbytes)=206896 Memory Use Information::Coarse Grids= Memory Use Information::Coarse Grids::Grid Level=1 Memory Use Information::Coarse Grids::Memory used=24715.9 Memory Use Information::Coarse Grids::Grid Level=2 Memory Use Information::Coarse Grids::Memory used=3090.72 Memory Use Information::Coarse Grids::Grid Level=3 Memory Use Information::Coarse Grids::Memory used=386.652 ########## V&V Testing Summary ##########= Spectral Convergence Tests= Spectral Convergence Tests::Result=PASSED Spectral Convergence Tests::Unpreconditioned= Spectral Convergence Tests::Unpreconditioned::Maximum iteration count=11 Spectral Convergence Tests::Unpreconditioned::Expected iteration count=12 Spectral Convergence Tests::Preconditioned= Spectral Convergence Tests::Preconditioned::Maximum iteration count=2 Spectral Convergence Tests::Preconditioned::Expected iteration count=2 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon= Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Result=PASSED Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for SpMV=7.0139e-17 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for MG=0 ########## Iterations Summary ##########= Iteration Count Information= Iteration Count Information::Result=PASSED Iteration Count Information::Reference CG iterations per set=50 Iteration Count Information::Optimized CG iterations per set=54 Iteration Count Information::Total number of reference iterations=17800 Iteration Count Information::Total number of optimized iterations=19224 ########## Reproducibility Summary ##########= Reproducibility Information= Reproducibility Information::Result=PASSED Reproducibility Information::Scaled residual mean=0.004943 Reproducibility Information::Scaled residual variance=0 ########## Performance Summary (times in sec) ##########= Benchmark Time Summary= Benchmark Time Summary::Optimization phase=0.325849 Benchmark Time Summary::DDOT=51.9061 Benchmark Time Summary::WAXPBY=68.8547 Benchmark Time Summary::SpMV=342.906 Benchmark Time Summary::MG=1431.96 Benchmark Time Summary::Total=1895.63 Floating Point Operations Summary= Floating Point Operations Summary::Raw DDOT=3.8167e+16 Floating Point Operations Summary::Raw WAXPBY=3.8167e+16 Floating Point Operations Summary::Raw SpMV=3.47615e+17 Floating Point Operations Summary::Raw MG=1.94769e+18 Floating Point Operations Summary::Total=2.37164e+18 Floating Point Operations Summary::Total with convergence overhead=2.19596e+18 GB/s Summary= GB/s Summary::Raw Read B/W=7.70569e+06 GB/s Summary::Raw Write B/W=1.78101e+06 GB/s Summary::Raw Total B/W=9.4867e+06 GB/s Summary::Total with convergence and optimization phase overhead=8.69713e+06 GFLOP/s Summary= GFLOP/s Summary::Raw DDOT=735308 GFLOP/s Summary::Raw WAXPBY=554312 GFLOP/s Summary::Raw SpMV=1.01373e+06 GFLOP/s Summary::Raw MG=1.36016e+06 GFLOP/s Summary::Raw Total=1.2511e+06 GFLOP/s Summary::Total with convergence overhead=1.15843e+06 GFLOP/s Summary::Total with convergence and optimization phase overhead=1.14698e+06 User Optimization Overheads= User Optimization Overheads::Optimization phase time (sec)=0.325849 User Optimization Overheads::Optimization phase time vs reference SpMV+MG time=0.0269459 DDOT Timing Variations= DDOT Timing Variations::Min DDOT MPI_Allreduce time=4.12217 DDOT Timing Variations::Max DDOT MPI_Allreduce time=12.7324 DDOT Timing Variations::Avg DDOT MPI_Allreduce time=6.33166 Final Summary= Final Summary::HPCG result is VALID with a GFLOP/s rating of=1.14698e+06 Final Summary::HPCG 2.4 rating for historical reasons is=1.15138e+06 Final Summary::Please upload results from the YAML file contents to=http://hpcg-benchmark.org