iWARP (Internet Wide-Area RDMA Protocol) \u306f\u3001TCP\/IP\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u7d4c\u7531\u3067RDMA\u3092\u5b9f\u88c5\u3059\u308b\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u30d7\u30ed\u30c8\u30b3\u30eb\u3067\u3059\u3002<\/p>\n
\u5f93\u6765\u3088\u308aHPC\u5206\u91ce\u3067\u306f\u3001\u5927\u91cf\u306e\u30c7\u30fc\u30bf\u3092\u4f7f\u3044\u6f14\u7b97\u51e6\u7406\u3092\u3059\u308b\u5927\u898f\u6a21\u8a08\u7b97\u3092\u30b5\u30dd\u30fc\u30c8\u3059\u308b\u30a4\u30f3\u30bf\u30fc\u30b3\u30cd\u30af\u30c8\u3068\u3057\u3066Infiniband\u304c\u5e83\u304f\u63a1\u7528\u3055\u308c\u3066\u304d\u3066\u3044\u307e\u3059\u3002
\n\u3057\u304b\u3057\u3053\u3053\u6700\u8fd1\u3067\u306f\u3001Infiniband\u4ee5\u5916\u306b\u3082iWARP\u3084RoCE\u306a\u3069\u3082\u63a1\u7528\u3055\u308c\u308b\u4e8b\u4f8b\u304c\u591a\u304f\u306a\u3063\u3066\u304d\u3066\u3044\u307e\u3059\u3002<\/p>\n
\u305d\u3053\u3067iWARP\u306e\u52d5\u4f5c\u691c\u8a3c\u3092\u3057\u3066\u307f\u307e\u3057\u305f\u3002
\n\u6bd4\u8f03\u65b9\u6cd5\u306f\u30012\u53f0\u306e\u8a08\u7b97\u6a5f\u306e\u6700\u5927\u30b9\u30b3\u30a2\u3092\u60f3\u5b9a\u3057
\n1GBps
\nInfiniband
\n10Gbps iWARP
\n\u306e\u30b9\u30b3\u30a2\u3092\u6bd4\u8f03\u3057\u307e\u3059\u3002<\/p>\n
\u307e\u305a\u4ee5\u4e0b\u69cb\u6210\u306e\u8a08\u7b97\u6a5f\u30922\u53f0\u7528\u610f\u3059\u308b\u3002<\/p>\n
\u3010\u74b0\u5883\u3011
\n\u25cf\u30cf\u30fc\u30c9\u30a6\u30a7\u30a2\u74b0\u5883
\nCPU: Intel Xeon Gold 6258R CPU 28Core x1
\nMEM: 16GB DDR4-2933 x6<\/p>\n
\u25cf\u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u74b0\u5883
\nOS: Ubuntu Server 20.04
\nMPI: Openmpi 4.1.1
\nGCC: 9.4.0
\nBenchmark: cc_himenoBMTxp_mpi\uff08C + MPI, static allocate version\uff09Size=L<\/p>\n
\u3010\u30c6\u30b9\u30c8\u3011
\n\u25cf\u6e96\u5099\u8a08\u6e2c
\n\u307e\u305a\u524d\u63d0\u3068\u306a\u308b\u6700\u5927\u5024\u3092\u8a08\u6e2c\u3059\u308b\u3002
\n\u8a08\u7b97\u6a5f1\u53f0\u3067\u306e\u30b9\u30b3\u30a2\u306f\u4ee5\u4e0b\u3002<\/p>\n
\u30fb28core without HT N=28
\nMFLOPS measured : 48898.718831
\nMFLOPS measured : 48306.170793
\nMFLOPS measured : 48640.000116
\nMFLOPS measured : 48399.317924
\nMFLOPS measured : 48277.031488<\/p>\n
\u5e73\u5747 48504.2478304 MFLOPS<\/p>\n
\u540c\u69cb\u6210\u30de\u30b7\u30f3\uff12\u53f0\u306a\u306e\u3067\u6700\u5927\u671f\u5f85\u30b9\u30b3\u30a2\u306f\u30b7\u30f3\u30d7\u30eb\u306b2\u500d\u3068\u3059\u308b\u3002<\/p>\n
48504.2478304 MFLOPS x2 = 97008.4956608 MFLOPS
\n\u6700\u5927\u671f\u5f85\u5024\u00a0\u00a0 97008.4956608 MFLOPS<\/p>\n
\u25cf\u8a08\u6e2c
\n\u3053\u3053\u304b\u3089\u306f\u30a4\u30f3\u30bf\u30fc\u30b3\u30cd\u30af\u30c8\u8d8a\u3057\u306b2\u53f0\u306e\u30de\u30b7\u30f3\u3067\u8a08\u6e2c\u3059\u308b\u3002<\/p>\n
\u25a0 \uff11Gbps TCP\uff08\u30aa\u30f3\u30dc\u30fc\u30c9 Intel 1Gbps NIC\uff09
\n\u30fb56core without HT N=56
\nMFLOPS measured : 80623.366818
\nMFLOPS measured : 80866.794020
\nMFLOPS measured : 81248.198197
\nMFLOPS measured : 81189.602887
\nMFLOPS measured : 80827.159099<\/p>\n
\u5e73\u5747 80951.0242042 MFLOPS<\/p>\n
\u5e73\u5747 80951.0242042 MFLOPS \u00f7 \u6700\u5927\u671f\u5f85\u5024\u00a0\u00a0 97008.4956608 MFLOPS \u2252 83.4%
\n\u203b \u8a08\u6e2c\u6642\u306e\u304a\u304a\u3088\u305d\u306a\u30b7\u30b9\u30c6\u30e0\u30d7\u30ed\u30bb\u30b9\u5024 10%\u307b\u3069<\/p>\n
\u25a0 Infiniband QDR\uff08Mellanox QDR\uff09
\n\u30fb56core without HT N=56
\nMFLOPS measured : 96102.390695
\nMFLOPS measured : 96600.515094
\nMFLOPS measured : 96122.006927
\nMFLOPS measured : 95872.529788
\nMFLOPS measured : 96135.243922<\/p>\n
\u5e73\u5747 96166.5372852 MFLOPS<\/p>\n
\u5e73\u5747 96166.5372852 MFLOPS \u00f7 \u6700\u5927\u671f\u5f85\u5024\u00a0\u00a0 97008.4956608 MFLOPS \u2252 99.1%
\n\u203b \u8a08\u6e2c\u6642\u306e\u304a\u304a\u3088\u305d\u306a\u30b7\u30b9\u30c6\u30e0\u30d7\u30ed\u30bb\u30b9\u5024 0.1%\u307b\u3069<\/p>\n
\u25a0 10Gbps iWARP\uff08Chelsio 10Gbps NIC\uff09
\n\u30fb56core without HT N=56
\nMFLOPS measured : 95879.634238
\nMFLOPS measured : 95465.368767
\nMFLOPS measured : 94577.077169
\nMFLOPS measured : 94201.079737
\nMFLOPS measured : 94704.609024<\/p>\n
\u5e73\u5747 94965.553787 MFLOPS<\/p>\n
\u5e73\u5747 94965.553787 MFLOPS \u00f7 \u6700\u5927\u671f\u5f85\u5024\u00a0\u00a0 97008.4956608 MFLOPS \u2252 97.8%
\n\u203b \u8a08\u6e2c\u6642\u306e\u304a\u304a\u3088\u305d\u306a\u30b7\u30b9\u30c6\u30e0\u30d7\u30ed\u30bb\u30b9\u5024 0.1%\u307b\u3069<\/p>\n
\u3010\u8a55\u4fa1\u3011
\n\u59eb\u91ce\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u306f\u3001\u5927\u898f\u6a21\u8a08\u7b97\u307e\u3067\u306a\u3089\u306a\u3044\u3068\u3057\u3066\u3082\u8ecd\u914d\u306fInfiniband\u3067\u3057\u305f\u3002\u3055\u3059\u304c\u3067\u3059\u3002
\n\u3067\u3059\u304c10Gbps iWARP\u3082\u826f\u3044\u7d50\u679c\u3067\u3057\u305f\u3002
\n\u6700\u5927\u671f\u5f85\u5024\u306e97.8%\u306e\u30b9\u30b3\u30a2\u3082\u826f\u304b\u3063\u305f\u3067\u3059\u304c\u3001\u8a08\u6e2c\u6642\u306e\u30b7\u30b9\u30c6\u30e0\u30d7\u30ed\u30bb\u30b9\u5024 \u304c\u9a5a\u304f\u307b\u3069\u4f4e\u304f0.1%\u3067\u3042\u3063\u305f\u3053\u3068\u306f\u30d3\u30c3\u30af\u30ea\u3067\u3057\u305f\u3002
\n\u8a08\u7b97\u6a5f\u74b0\u5883\u304c\u5c0f\u898f\u6a21\u3067\u3042\u308a\u3001\u30b3\u30b9\u30c8\u306b\u898b\u5408\u3046\u306e\u3067\u3042\u308c\u30701Gbps\u3088\u308aiWARP\u3092\u9078\u629e\u3059\u308b\u306e\u3082\u60aa\u304f\u306a\u3055\u305d\u3046\u3067\u3059\u3002<\/p>\n
\u3064\u3065\u304f<\/p>\n","protected":false},"excerpt":{"rendered":"
iWARP (Internet Wide-Area RDMA Protocol) \u306f\u3001TCP\/IP\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u7d4c\u7531\u3067RDMA\u3092\u5b9f\u88c5\u3059\u308b\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u30d7\u30ed\u30c8\u30b3\u30eb\u3067\u3059\u3002 \u5f93\u6765\u3088\u308aHPC\u5206\u91ce\u3067\u306f\u3001\u5927\u91cf\u306e\u30c7\u30fc\u30bf\u3092\u4f7f\u3044\u6f14\u7b97\u51e6\u7406\u3092\u3059\u308b […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,7],"tags":[],"class_list":["post-1934","post","type-post","status-publish","format-standard","hentry","category-pc","category-7"],"_links":{"self":[{"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/posts\/1934","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1934"}],"version-history":[{"count":7,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/posts\/1934\/revisions"}],"predecessor-version":[{"id":1952,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/posts\/1934\/revisions\/1952"}],"wp:attachment":[{"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1934"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1934"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1934"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}