-
Notifications
You must be signed in to change notification settings - Fork 57
Benchmarks TCP DGX2
Benjamin Zaitlen edited this page Dec 17, 2019
·
1 revision
Merge benchmark
--------------------------
Chunk-size | 100000000
Frac-match | 0.3
Ignore-size | 1.05 MB
Protocol | tcp
Device(s) | 1
rmm-pool | True
==========================
Total time | 146.62 ms
Total time | 145.68 ms
Total time | 145.96 ms
==========================
Worker-Worker Transfer Rates
(w1,w2) | 25% 50% 75% (total nbytes)
--------------------------
Merge benchmark
--------------------------
Chunk-size | 100000000
Frac-match | 0.3
Ignore-size | 1.05 MB
Protocol | tcp
Device(s) | 1,2
rmm-pool | True
==========================
Total time | 47.57 s
Total time | 26.83 s
Total time | 48.84 s
==========================
Worker-Worker Transfer Rates
(w1,w2) | 25% 50% 75% (total nbytes)
--------------------------
(01,02) | 118.88 MB/s 126.06 MB/s 151.57 MB/s (19.20 GB)
(02,01) | 116.15 MB/s 132.47 MB/s 163.41 MB/s (19.20 GB)
Merge benchmark
--------------------------
Chunk-size | 100000000
Frac-match | 0.3
Ignore-size | 1.05 MB
Protocol | tcp
Device(s) | 1,2,3,4
rmm-pool | True
==========================
Total time | 50.97 s
Total time | 49.24 s
Total time | 44.83 s
==========================
Worker-Worker Transfer Rates
(w1,w2) | 25% 50% 75% (total nbytes)
--------------------------
(01,02) | 58.02 MB/s 82.32 MB/s 113.60 MB/s (9.60 GB)
(01,03) | 56.08 MB/s 67.33 MB/s 94.89 MB/s (9.60 GB)
(01,04) | 56.19 MB/s 68.46 MB/s 83.70 MB/s (8.90 GB)
(02,01) | 57.76 MB/s 85.76 MB/s 140.92 MB/s (10.30 GB)
(02,03) | 64.29 MB/s 79.35 MB/s 93.22 MB/s (11.00 GB)
(02,04) | 72.96 MB/s 81.32 MB/s 95.19 MB/s (7.20 GB)
(03,01) | 59.07 MB/s 66.72 MB/s 120.39 MB/s (7.20 GB)
(03,02) | 68.87 MB/s 81.73 MB/s 136.11 MB/s (8.90 GB)
(03,04) | 68.13 MB/s 101.02 MB/s 108.40 MB/s (12.00 GB)
(04,01) | 49.47 MB/s 91.49 MB/s 107.66 MB/s (10.30 GB)
(04,02) | 56.79 MB/s 69.13 MB/s 102.18 MB/s (10.30 GB)
(04,03) | 53.25 MB/s 65.07 MB/s 68.59 MB/s (7.90 GB)
Merge benchmark
--------------------------
Chunk-size | 100000000
Frac-match | 0.3
Ignore-size | 1.05 MB
Protocol | tcp
Device(s) | 0,1,2,3,4,5,6,7
rmm-pool | True
==========================
Total time | 64.82 s
Total time | 64.49 s
Total time | 70.90 s
==========================
Worker-Worker Transfer Rates
(w1,w2) | 25% 50% 75% (total nbytes)
--------------------------
(00,01) | 30.14 MB/s 35.22 MB/s 41.10 MB/s (4.65 GB)
(00,02) | 33.88 MB/s 39.69 MB/s 55.43 MB/s (4.30 GB)
(00,03) | 32.83 MB/s 46.80 MB/s 62.71 MB/s (4.30 GB)
(00,04) | 31.91 MB/s 38.89 MB/s 44.49 MB/s (4.65 GB)
(00,05) | 30.64 MB/s 46.81 MB/s 64.02 MB/s (7.05 GB)
(00,06) | 27.74 MB/s 49.76 MB/s 74.42 MB/s (6.35 GB)
(00,07) | 30.65 MB/s 35.74 MB/s 47.93 MB/s (4.30 GB)
(01,00) | 34.08 MB/s 41.80 MB/s 49.79 MB/s (6.70 GB)
(01,02) | 30.55 MB/s 43.10 MB/s 66.65 MB/s (6.70 GB)
(01,03) | 25.63 MB/s 33.72 MB/s 49.90 MB/s (6.35 GB)
(01,04) | 31.73 MB/s 37.76 MB/s 49.20 MB/s (4.30 GB)
(01,05) | 26.23 MB/s 27.98 MB/s 56.71 MB/s (4.30 GB)
(01,06) | 30.01 MB/s 33.70 MB/s 46.22 MB/s (6.70 GB)
(01,07) | 31.11 MB/s 33.95 MB/s 37.88 MB/s (3.95 GB)
(02,00) | 34.43 MB/s 37.43 MB/s 72.22 MB/s (6.35 GB)
(02,01) | 26.07 MB/s 43.39 MB/s 56.10 MB/s (5.00 GB)
(02,03) | 30.10 MB/s 32.24 MB/s 37.82 MB/s (4.30 GB)
(02,04) | 31.85 MB/s 38.91 MB/s 48.99 MB/s (6.70 GB)
(02,05) | 26.70 MB/s 39.84 MB/s 62.46 MB/s (4.65 GB)
(02,06) | 25.44 MB/s 29.04 MB/s 47.16 MB/s (4.30 GB)
(02,07) | 21.98 MB/s 30.02 MB/s 39.25 MB/s (3.95 GB)
(03,00) | 31.87 MB/s 39.01 MB/s 51.94 MB/s (7.05 GB)
(03,01) | 28.82 MB/s 38.90 MB/s 52.63 MB/s (4.65 GB)
(03,02) | 29.01 MB/s 35.22 MB/s 47.45 MB/s (4.65 GB)
(03,04) | 27.70 MB/s 32.01 MB/s 32.87 MB/s (3.60 GB)
(03,05) | 27.35 MB/s 37.48 MB/s 50.58 MB/s (4.30 GB)
(03,06) | 27.95 MB/s 38.81 MB/s 42.56 MB/s (3.95 GB)
(03,07) | 32.80 MB/s 50.26 MB/s 50.85 MB/s (6.70 GB)
(04,00) | 27.46 MB/s 29.31 MB/s 45.42 MB/s (4.30 GB)
(04,01) | 33.03 MB/s 48.13 MB/s 69.98 MB/s (9.45 GB)
(04,02) | 27.46 MB/s 32.17 MB/s 47.59 MB/s (5.65 GB)
(04,03) | 31.00 MB/s 32.19 MB/s 34.51 MB/s (4.30 GB)
(04,05) | 26.86 MB/s 37.32 MB/s 67.73 MB/s (4.65 GB)
(04,06) | 25.86 MB/s 31.29 MB/s 34.08 MB/s (4.30 GB)
(04,07) | 31.80 MB/s 41.66 MB/s 47.44 MB/s (5.00 GB)
(05,00) | 29.46 MB/s 36.28 MB/s 45.39 MB/s (3.60 GB)
(05,01) | 22.64 MB/s 25.92 MB/s 32.57 MB/s (3.60 GB)
(05,02) | 26.99 MB/s 31.95 MB/s 41.49 MB/s (3.60 GB)
(05,03) | 28.33 MB/s 36.13 MB/s 45.30 MB/s (6.00 GB)
(05,04) | 31.07 MB/s 35.88 MB/s 55.38 MB/s (6.00 GB)
(05,06) | 30.24 MB/s 38.93 MB/s 50.13 MB/s (8.40 GB)
(05,07) | 23.76 MB/s 29.53 MB/s 48.32 MB/s (6.00 GB)
(06,00) | 25.04 MB/s 31.70 MB/s 41.78 MB/s (6.35 GB)
(06,01) | 30.66 MB/s 33.07 MB/s 37.37 MB/s (3.95 GB)
(06,02) | 28.05 MB/s 34.50 MB/s 56.70 MB/s (7.05 GB)
(06,03) | 29.77 MB/s 36.85 MB/s 45.60 MB/s (4.30 GB)
(06,04) | 23.25 MB/s 27.27 MB/s 42.13 MB/s (3.95 GB)
(06,05) | 26.64 MB/s 39.22 MB/s 42.48 MB/s (4.30 GB)
(06,07) | 28.13 MB/s 32.82 MB/s 40.41 MB/s (4.30 GB)
(07,00) | 27.55 MB/s 36.00 MB/s 43.41 MB/s (5.00 GB)
(07,01) | 31.01 MB/s 36.08 MB/s 47.47 MB/s (4.65 GB)
(07,02) | 24.94 MB/s 35.77 MB/s 84.51 MB/s (6.70 GB)
(07,03) | 41.78 MB/s 47.67 MB/s 66.58 MB/s (5.00 GB)
(07,04) | 30.33 MB/s 47.63 MB/s 72.38 MB/s (5.00 GB)
(07,05) | 28.47 MB/s 35.65 MB/s 52.15 MB/s (4.30 GB)
(07,06) | 31.98 MB/s 37.49 MB/s 52.24 MB/s (5.00 GB)