Quantcast
Channel: Clusters and HPC Technology
Viewing all articles
Browse latest Browse all 927

Performance degration with larger message on knl(>128M)

$
0
0

Hi, 

    When I ran with IMPI benchmark, it always got an obvious performance drop when buffer size>128MB with OFI, is this reasonable or there is some configuration? Thanks

mpirun -genv I_MPI_STATS=ipm    -genv I_MPI_FABRICS=tmi -n 2  -ppn 1 -f hostfile IMB-MPI1 -msglog 20:29 -iter 20000,1000 uniband -time 1000000  -mem 2

#---------------------------------------------------
# Benchmarking Uniband 
# #processes = 2 
#---------------------------------------------------
       #bytes #repetitions   Mbytes/sec      Msg/sec
            0        20000         0.00       607266
      1048576         1000      8356.72         7970
      2097152          500      8847.71         4219
      4194304          250      9295.13         2216
      8388608          125      9205.23         1097
     16777216           62      9498.35          566
     33554432           31      9577.55          285
     67108864           15      9564.31          143
    134217728            7      9523.83           71
   268435456            3      2700.73           10   <-----------performance dropped much
    536870912            1      3514.32            7

 


Viewing all articles
Browse latest Browse all 927

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>