node-011 paste time1.out time1-omp.out time1-2.out time1-8.out time1-16.out time1-32.out 28, 26.93 28, 26.97 28, 24.47 28, 23.98 28, 24.13 28, 24.12 29, 54.89 29, 54.93 29, 49.99 29, 50.14 29, 49.83 29, 49.94 30, 112.54 30, 114.49 30, 103.14 30, 102.46 30, 102.57 30, 101.15 31, 235.30 31, 233.09 31, 209.36 31, 211.05 31, 210.34 31, 209.89 32, 608.85 32, 618.74 32, 544.64 32, 525.45 32, 507.05 32, 508.77 ~200% CPU overall with nthreads >= 2 PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 55050 rperry 20 0 64.4g 64.0g 10688 R 197.4 68.8 2:11.54 BV-omp OMP_NUM_THREADS 32 memory I/O bandwidth limited per socket, equiv to 2 CPU's ? threads (top -H) PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 55110 rperry 20 0 64.4g 64.0g 10688 R 8.6 68.8 0:11.44 BV-omp 55109 rperry 20 0 64.4g 64.0g 10688 R 7.9 68.8 0:11.50 BV-omp 55104 rperry 20 0 64.4g 64.0g 10688 R 7.6 68.8 0:11.47 BV-omp 55105 rperry 20 0 64.4g 64.0g 10688 R 7.6 68.8 0:11.58 BV-omp 55106 rperry 20 0 64.4g 64.0g 10688 R 7.6 68.8 0:11.48 BV-omp 55107 rperry 20 0 64.4g 64.0g 10688 R 7.6 68.8 0:11.50 BV-omp 55112 rperry 20 0 64.4g 64.0g 10688 R 7.6 68.8 0:11.41 BV-omp 55111 rperry 20 0 64.4g 64.0g 10688 R 7.3 68.8 0:11.47 BV-omp 55103 rperry 20 0 64.4g 64.0g 10688 R 6.9 68.8 0:11.40 BV-omp 55108 rperry 20 0 64.4g 64.0g 10688 R 6.9 68.8 0:11.41 BV-omp 55091 rperry 20 0 64.4g 64.0g 10688 R 6.3 68.8 0:07.37 BV-omp 55094 rperry 20 0 64.4g 64.0g 10688 R 6.3 68.8 0:07.37 BV-omp 55089 rperry 20 0 64.4g 64.0g 10688 R 5.9 68.8 0:07.35 BV-omp 55090 rperry 20 0 64.4g 64.0g 10688 R 5.9 68.8 0:07.31 BV-omp 55095 rperry 20 0 64.4g 64.0g 10688 R 5.9 68.8 0:07.34 BV-omp 55097 rperry 20 0 64.4g 64.0g 10688 R 5.9 68.8 0:07.37 BV-omp 55082 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.35 BV-omp 55083 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.36 BV-omp 55085 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.36 BV-omp 55086 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.36 BV-omp 55087 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.36 BV-omp 55088 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.37 BV-omp 55092 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.30 BV-omp 55100 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.33 BV-omp 55101 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.37 BV-omp 55102 rperry 20 0 64.4g 64.0g 10688 R 5.6 68.8 0:07.94 BV-omp 55050 rperry 20 0 64.4g 64.0g 10688 R 5.3 68.8 0:34.20 BV-omp 55084 rperry 20 0 64.4g 64.0g 10688 R 5.3 68.8 0:07.34 BV-omp 55096 rperry 20 0 64.4g 64.0g 10688 R 5.3 68.8 0:07.35 BV-omp 55098 rperry 20 0 64.4g 64.0g 10688 R 5.3 68.8 0:07.32 BV-omp 55093 rperry 20 0 64.4g 64.0g 10688 R 5.0 68.8 0:07.37 BV-omp 55099 rperry 20 0 64.4g 64.0g 10688 R 5.0 68.8 0:07.36 BV-omp