{"id":638,"date":"2012-06-29T12:11:36","date_gmt":"2012-06-29T03:11:36","guid":{"rendered":"http:\/\/blog.systemworks.co.jp\/?p=638"},"modified":"2012-11-20T17:19:20","modified_gmt":"2012-11-20T08:19:20","slug":"gluster-%e3%83%99%e3%83%b3%e3%83%81%e3%83%9e%e3%83%bc%e3%82%af","status":"publish","type":"post","link":"https:\/\/blog.systemworks.co.jp\/?p=638","title":{"rendered":"Gluster \u30d9\u30f3\u30c1\u30de\u30fc\u30af"},"content":{"rendered":"

\"Gluster\"<\/a><\/p>\n

\u5206\u6563\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u304c\u6ce8\u76ee\u3055\u308c\u3066\u3044\u307e\u3059\u3002
\n\u8907\u6570\u306e\u5b9f\u88c5\u304c\u3042\u308a\u307e\u3059\u304c\u3001\u4eca\u56de\u306fGluster\u3092\u52d5\u304b\u3057\u3066\u307f\u307e\u3057\u305f\u3002
\nGluster\u306f\u3001\u30af\u30e9\u30a6\u30c9\u74b0\u5883\u3084HPC\u74b0\u5883\u306b\u3082\u4f7f\u3048\u308b\u5206\u6563\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u3067\u3059\u3002
\n\u30ed\u30fc\u30ab\u30eb\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u3092\u30a8\u30af\u30b9\u30dd\u30fc\u30c8\u3057\u3001\u30e1\u30bf\u30c7\u30fc\u30bf\u30b5\u30fc\u30d0\u304c\u5b58\u5728\u3057\u306a\u3044\u306e\u3082\u5927\u304d\u306a\u7279\u5fb4\u3067\u3059\u3002
\n\u4eca\u56de\u306f\u3001\u304b\u306a\u308a\u30ea\u30c3\u30c1\u306a\u74b0\u5883\u306a\u306e\u3067\u3001\u53c2\u8003\u7a0b\u5ea6\u306b\u3057\u304b\u306a\u3089\u306a\u3044\u304b\u3082\u3002\u3002\u3002<\/p>\n

\u25a0\u30c6\u30b9\u30c8\u74b0\u5883
\n\u25cfGluster\u30b5\u30fc\u30d0 3\u53f0
\nCPU: x5675 2\u500b
\nMEM: 72GB
\nRAID: Areca 1280
\nHDD: 3TB 24\u53f0 RAID6
\nInfinband: Mellanox_QDR
\nEthernet: Intel 82574L<\/p>\n

OS: Centos 5.5 x86_64
\nLocal Filesystem: XFS
\nDFS: Gluster 3.2.4<\/p>\n

\u25cfGluster\u30af\u30e9\u30a4\u30a2\u30f3\u30c8 3\u53f0
\nCPU: x5675 2\u500b
\nMEM: 72GB
\nHDD: 2TB 1\u53f0 OS\u7528
\nInfinband: Mellanox_QDR
\nEthernet: Intel 82574L<\/p>\n

OS: Centos 5.5 x86_64
\nMPI: mpich2, mvapich2
\nBenchmark: IOR<\/p>\n

\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u306f\u3001IOR\u3092\u4f7f\u3044\u307e\u3057\u305f\u3002
\nIOR\u306f\u3001\u5206\u6563\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u5411\u3051\u306e\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u30d7\u30ed\u30b0\u30e9\u30e0\u3067\u3059\u3002
\n\u7279\u5fb4\u3068\u3057\u3066\u306f\u3001MPI\u3092\u4f7f\u3063\u305f\u4e26\u5217\u30d7\u30ed\u30bb\u30b9\u304b\u3089\u306eI\/O\u6e2c\u5b9a\u304c\u3067\u304d\u307e\u3059\u3002
\n\u6e2c\u5b9a\u7d50\u679c\u306f\u6700\u5927\u5024\u3067\u51fa\u3066\u304f\u308b\u3088\u3046\u3067\u3059\u3002\uff08Max Write, Max Read\uff09
\nIOR\u306e\u30d1\u30e9\u30e1\u30fc\u30bf\u304c\u59a5\u5f53\u304b\u3069\u3046\u304b\uff1f\u306e\u554f\u984c\u304c\u3042\u308a\u307e\u3059\u304c\u3001\u30cd\u30c3\u30c8\u4e0a\u306b\u3042\u3063\u305f\u60c5\u5831\u3092\u5143\u306b\u3057\u3066\u5b9f\u884c\u3057\u307e\u3057\u305f\u3002
\n\u4f7f\u3063\u3066\u307f\u3066\u308f\u304b\u3063\u305f\u306e\u3067\u3059\u304c\u3001IOR\u306f\u5b9f\u884c\u5074\u30db\u30b9\u30c8\u306e\u30ad\u30e3\u30c3\u30b7\u30e5\u3092\u307b\u3068\u3093\u3069\u4f7f\u308f\u306a\u3044\u3088\u3046\u3067\u3059\u3002
\n\u6bd4\u8f03\u306f\u4ee5\u4e0b\u3068\u3057\u307e\u3057\u305f\u3002<\/p>\n

Gigabit \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea) VS infiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea)
\ninfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(2GB\u30e1\u30e2\u30ea) VS infiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea)
\ninfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea) VS infiniband \u5206\u6563\u578b(72GB\u30e1\u30e2\u30ea)
\ninfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(2GB\u30e1\u30e2\u30ea) VS infiniband \u5206\u6563\u578b(2GB\u30e1\u30e2\u30ea)
\ninfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea 36\u30d7\u30ed\u30bb\u30b9) VS infiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea 72\u30d7\u30ed\u30bb\u30b9)
\ninfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b 3\u53f0(72GB\u30e1\u30e2\u30ea 36\u30d7\u30ed\u30bb\u30b9\u5b9f\u884c) VS infiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b 2\u53f0(72GB\u30e1\u30e2\u30ea 36\u30d7\u30ed\u30bb\u30b9\u5b9f\u884c)<\/p>\n

\u25a0fuse\u306b\u3064\u3044\u3066
\nGluster\u306ffuse\u3092\u4f7f\u3044\u30de\u30a6\u30f3\u30c8\u3092\u3057\u3066\u3044\u308b\u3002
\nfuse\u306fOS\u6a19\u6e96\u3092\u4f7f\u3046\u3053\u3068\u304c\u3067\u304d\u308b\u304c\u3001gluster\u304b\u3089\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0\u3055\u308c\u305ffuse\u304c\u5165\u624b\u3067\u304d\u308b\u3002<\/p>\n

72\u30d7\u30ed\u30bb\u30b9\u306b\u3059\u308b\u3068\u3001infinband\u3067\u3082Max Write\u306e\u5024\u304c\u3060\u3044\u3076\u843d\u3061\u3066\u304f\u308b\u3002
\n\u3053\u308c\u3067fuse\u306e\u5dee\u304c\u51fa\u308b\u304b\u3092\u898b\u3066\u307f\u308b\u3002<\/p>\n

\u25cffuse\u306f\u3001centos\u6a19\u6e96
\n# mpiexec -launcher rsh -f mvapich2host -n 72 \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/output
\n\u7d50\u679c\uff08Infinband\uff09
\nOperation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s)Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
\n——— ——— ——— ———- ——- ——— ——— ———- ——- ——-
\nwrite 233.77 233.77 233.77 0.00 58.44 58.44 58.44 0.001261.54440 72 24 1 1 0 1 0 0 1 0 4194304 309237645312 -1 MPIIO EXCEL
\nread 2829.12 2829.12 2829.12 0.00 707.28 707.28 707.28 0.00 104.24172 72 24 1 1 0 1 0 0 1 0 4194304 309237645312 -1 MPIIO EXCEL<\/p>\n

Max Write: 233.77 MiB\/sec (245.13 MB\/sec)
\nMax Read: 2829.12 MiB\/sec (2966.54 MB\/sec)<\/p>\n

\u25cffuse\u306f\u3001gluster-fuse
\n# mpiexec -launcher rsh -f mvapich2host -n 72 \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/output
\nperation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s)Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
\n——— ——— ——— ———- ——- ——— ——— ———- ——- ——-
\nwrite 262.79 262.79 262.79 0.00 65.70 65.70 65.70 0.001122.22525 72 24 1 1 0 1 0 0 1 0 4194304 309237645312 -1 MPIIO EXCEL
\nread 2814.13 2814.13 2814.13 0.00 703.53 703.53 703.53 0.00 104.79704 72 24 1 1 0 1 0 0 1 0 4194304 309237645312 -1 MPIIO EXCEL<\/p>\n

Max Write: 262.79 MiB\/sec (275.56 MB\/sec)
\nMax Read: 2814.13 MiB\/sec (2950.82 MB\/sec)<\/p>\n

Max Write\u304c12%\u7a0b\u5ea6\u4e0a\u304c\u3063\u305f\u3002
\nfuse\u306fOS\u6a19\u6e96\u306efuse\u3088\u308aGluster\u304b\u3089\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u305f\u3082\u306e\u3092\u4f7f\u3046\u306e\u304c\u826f\u3044\u3002<\/p>\n

\u25a0\u30d9\u30f3\u30c1\u30de\u30fc\u30af
\n———-
\nGluster \u30b9\u30c8\u30e9\u30a4\u30d7\u578b (ethernet gigabit)
\n\u30d5\u30a1\u30a4\u30eb\u30b5\u30fc\u30d0 \u30e1\u30e2\u30ea72GB
\nMPI\u30e9\u30a4\u30d6\u30e9\u30ea mpich2<\/p>\n

[work@gluster5 ~]$ mpiexec -launcher rsh -iface eth0 -f mpich2host -n 36 \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/output
\nIOR-2.10.2: MPI Coordinated Test of Parallel I\/O<\/p>\n

Run began: Mon Dec 19 12:49:50 2011
\nCommand line used: \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/outputMachine: Linux gluster5<\/p>\n

Summary:
\napi = MPIIO (version=2, subversion=2)
\ntest filename = \/gluster\/output
\naccess = file-per-process
\nordering in a file = sequential offsets
\nordering inter file= no tasks offsets
\nclients = 36 (12 per node)
\nrepetitions = 1
\nxfersize = 4 MiB
\nblocksize = 4 GiB
\naggregate filesize = 144 GiB<\/p>\n

Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s)Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
\n——— ——— ——— ———- ——- ——— ——— ———- ——- ——-
\nwrite 203.89 203.89 203.89 0.00 50.97 50.97 50.97 0.00 723.22218 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL
\nread 209.22 209.22 209.22 0.00 52.30 52.30 52.30 0.00 704.80554 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL<\/p>\n

Max Write: 203.89 MiB\/sec (213.79 MB\/sec)
\nMax Read: 209.22 MiB\/sec (219.38 MB\/sec)<\/p>\n

Run finished: Mon Dec 19 13:13:56 2011<\/p>\n

———-
\nGluster \u30b9\u30c8\u30e9\u30a4\u30d7\u578b (infiniband QDR)
\n\u30d5\u30a1\u30a4\u30eb\u30b5\u30fc\u30d0 \u30e1\u30e2\u30ea72GB
\nMPI\u30e9\u30a4\u30d6\u30e9\u30ea mvapich2<\/p>\n

[work@gluster5 ~]$ mpiexec -launcher rsh -f mvapich2host -n 36 \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/output
\nIOR-2.10.2: MPI Coordinated Test of Parallel I\/O<\/p>\n

Run began: Mon Dec 19 12:18:54 2011
\nCommand line used: \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/outputMachine: Linux gluster5<\/p>\n

Summary:
\napi = MPIIO (version=2, subversion=2)
\ntest filename = \/gluster\/output
\naccess = file-per-process
\nordering in a file = sequential offsets
\nordering inter file= no tasks offsets
\nclients = 36 (12 per node)
\nrepetitions = 1
\nxfersize = 4 MiB
\nblocksize = 4 GiB
\naggregate filesize = 144 GiB<\/p>\n

Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s)Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
\n——— ——— ——— ———- ——- ——— ——— ———- ——- ——-
\nwrite 2475.39 2475.39 2475.39 0.00 618.85 618.85 618.85 0.00 59.56869 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL
\nread 2701.51 2701.51 2701.51 0.00 675.38 675.38 675.38 0.00 54.58275 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL<\/p>\n

Max Write: 2475.39 MiB\/sec (2595.64 MB\/sec)
\nMax Read: 2701.51 MiB\/sec (2832.74 MB\/sec)<\/p>\n

Run finished: Mon Dec 19 12:20:56 2011<\/p>\n

———-
\nGluster \u30b9\u30c8\u30e9\u30a4\u30d7\u578b (infiniband QDR)
\n\u30d5\u30a1\u30a4\u30eb\u30b5\u30fc\u30d0 \u30e1\u30e2\u30ea2GB
\nMPI\u30e9\u30a4\u30d6\u30e9\u30ea mvapich2<\/p>\n

[work@gluster5 ~]$ mpiexec -launcher rsh -f mvapich2host -n 36 \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/output
\nIOR-2.10.2: MPI Coordinated Test of Parallel I\/O<\/p>\n

Run began: Mon Dec 19 16:29:59 2011
\nCommand line used: \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/outputMachine: Linux gluster5<\/p>\n

Summary:
\napi = MPIIO (version=2, subversion=2)
\ntest filename = \/gluster\/output
\naccess = file-per-process
\nordering in a file = sequential offsets
\nordering inter file= no tasks offsets
\nclients = 36 (12 per node)
\nrepetitions = 1
\nxfersize = 4 MiB
\nblocksize = 4 GiB
\naggregate filesize = 144 GiB<\/p>\n

Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s)Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
\n——— ——— ——— ———- ——- ——— ——— ———- ——- ——-
\nwrite 205.71 205.71 205.71 0.00 51.43 51.43 51.43 0.00 716.80098 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL
\nread 275.65 275.65 275.65 0.00 68.91 68.91 68.91 0.00 534.94492 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL<\/p>\n

Max Write: 205.71 MiB\/sec (215.71 MB\/sec)
\nMax Read: 275.65 MiB\/sec (289.04 MB\/sec)<\/p>\n

Run finished: Mon Dec 19 16:51:30 2011<\/p>\n

———-
\nGluster \u5206\u6563\u578b (infiniband QDR)
\n\u30d5\u30a1\u30a4\u30eb\u30b5\u30fc\u30d0 \u30e1\u30e2\u30ea72GB
\nMPI\u30e9\u30a4\u30d6\u30e9\u30ea mvapich2<\/p>\n

[work@gluster5 ~]$ mpiexec -launcher rsh -f mvapich2host -n 36 \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/output
\nIOR-2.10.2: MPI Coordinated Test of Parallel I\/O<\/p>\n

Run began: Mon Dec 19 15:58:29 2011
\nCommand line used: \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/outputMachine: Linux gluster5<\/p>\n

Summary:
\napi = MPIIO (version=2, subversion=2)
\ntest filename = \/gluster\/output
\naccess = file-per-process
\nordering in a file = sequential offsets
\nordering inter file= no tasks offsets
\nclients = 36 (12 per node)
\nrepetitions = 1
\nxfersize = 4 MiB
\nblocksize = 4 GiB
\naggregate filesize = 144 GiB<\/p>\n

Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s)Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
\n——— ——— ——— ———- ——- ——— ——— ———- ——- ——-
\nwrite 1936.59 1936.59 1936.59 0.00 484.15 484.15 484.15 0.00 76.14225 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL
\nread 2008.95 2008.95 2008.95 0.00 502.24 502.24 502.24 0.00 73.39951 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL<\/p>\n

Max Write: 1936.59 MiB\/sec (2030.66 MB\/sec)
\nMax Read: 2008.95 MiB\/sec (2106.54 MB\/sec)<\/p>\n

Run finished: Mon Dec 19 16:01:05 2011<\/p>\n

———-
\nGluster \u5206\u6563\u578b (infiniband QDR)
\n\u30d5\u30a1\u30a4\u30eb\u30b5\u30fc\u30d0 \u30e1\u30e2\u30ea2GB
\nMPI\u30e9\u30a4\u30d6\u30e9\u30ea mvapich2<\/p>\n

[work@gluster5 ~]$ mpiexec -launcher rsh -f mvapich2host -n 36 \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/output
\nIOR-2.10.2: MPI Coordinated Test of Parallel I\/O<\/p>\n

Run began: Mon Dec 19 16:16:12 2011
\nCommand line used: \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/outputMachine: Linux gluster5<\/p>\n

Summary:
\napi = MPIIO (version=2, subversion=2)
\ntest filename = \/gluster\/output
\naccess = file-per-process
\nordering in a file = sequential offsets
\nordering inter file= no tasks offsets
\nclients = 36 (12 per node)
\nrepetitions = 1
\nxfersize = 4 MiB
\nblocksize = 4 GiB
\naggregate filesize = 144 GiB<\/p>\n

Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s)Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
\n——— ——— ——— ———- ——- ——— ——— ———- ——- ——-
\nwrite 1102.60 1102.60 1102.60 0.00 275.65 275.65 275.65 0.00 133.73433 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL
\nread 447.15 447.15 447.15 0.00 111.79 111.79 111.79 0.00 329.76871 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL<\/p>\n

Max Write: 1102.60 MiB\/sec (1156.16 MB\/sec)
\nMax Read: 447.15 MiB\/sec (468.87 MB\/sec)<\/p>\n

Run finished: Mon Dec 19 16:23:57 2011<\/p>\n

———-
\nGluster \u30b9\u30c8\u30e9\u30a4\u30d7\u578b 2\u53f0(infiniband QDR)
\n\u30d5\u30a1\u30a4\u30eb\u30b5\u30fc\u30d0 \u30e1\u30e2\u30ea72GB
\nMPI\u30e9\u30a4\u30d6\u30e9\u30ea mvapich2<\/p>\n

[work@gluster5 ~]$ mpiexec -launcher rsh -f mvapich2host -n 36 \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/output
\nIOR-2.10.2: MPI Coordinated Test of Parallel I\/O<\/p>\n

Run began: Mon Dec 19 21:11:29 2011
\nCommand line used: \/home\/work\/bin\/IOR -a MPIIO -b 4g -t 4m -i 1 -F -o \/gluster\/outputMachine: Linux gluster5<\/p>\n

Summary:
\napi = MPIIO (version=2, subversion=2)
\ntest filename = \/gluster\/output
\naccess = file-per-process
\nordering in a file = sequential offsets
\nordering inter file= no tasks offsets
\nclients = 36 (12 per node)
\nrepetitions = 1
\nxfersize = 4 MiB
\nblocksize = 4 GiB
\naggregate filesize = 144 GiB<\/p>\n

Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s)Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
\n——— ——— ——— ———- ——- ——— ——— ———- ——- ——-
\nwrite 968.56 968.56 968.56 0.00 242.14 242.14 242.14 0.00 152.24190 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL
\nread 1940.63 1940.63 1940.63 0.00 485.16 485.16 485.16 0.00 75.98366 36 12 1 1 0 1 0 0 1 0 4194304 154618822656 -1 MPIIO EXCEL<\/p>\n

Max Write: 968.56 MiB\/sec (1015.61 MB\/sec)
\nMax Read: 1940.63 MiB\/sec (2034.90 MB\/sec)<\/p>\n

Run finished: Mon Dec 19 20:32:40 2011<\/p>\n

\u25a0\u6bd4\u8f03\u3068\u8a55\u4fa1
\n\u25cfGigabit \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea) VS infiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea)<\/p>\n

\u30fbGigabit \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea)
\nMax Write: 203.89 MiB\/sec (213.79 MB\/sec)
\nMax Read: 209.22 MiB\/sec (219.38 MB\/sec)<\/p>\n

\u30fbinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea)
\nMax Write: 2475.39 MiB\/sec (2595.64 MB\/sec)
\nMax Read: 2701.51 MiB\/sec (2832.74 MB\/sec)<\/p>\n

gigabit\u3068infiniband\u306e\u5dee\u306f\u8a00\u3046\u307e\u3067\u3082\u3042\u308a\u307e\u305b\u3093\u3002
\ninfinband\u306710\u500d\u4ee5\u4e0a\u306e\u5411\u4e0a\u3067\u3059\u3002
\n\u3057\u304b\u3057gigabit\u3067\u3082\u3001200MB\/s\u4ee5\u4e0a\u306b\u306a\u3063\u3066\u3044\u308b\u306e\u306f\u3001Gluster\u30b5\u30fc\u30d0\u5074\u306e\u30ad\u30e3\u30c3\u30b7\u30e5\u52b9\u679c\u304c\u51fa\u3066\u3044\u308b\u306e\u3067\u306f\u306a\u3044\u304b\uff1f<\/p>\n

\u25cfinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(2GB\u30e1\u30e2\u30ea) VS infiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea)<\/p>\n

\u30fbinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(2GB\u30e1\u30e2\u30ea)
\nMax Write: 205.71 MiB\/sec (215.71 MB\/sec)
\nMax Read: 275.65 MiB\/sec (289.04 MB\/sec)<\/p>\n

\u30fbinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea)
\nMax Write: 2475.39 MiB\/sec (2595.64 MB\/sec)
\nMax Read: 2701.51 MiB\/sec (2832.74 MB\/sec)<\/p>\n

infiniband\u3067\u3082\u3001Gluster\u30b5\u30fc\u30d0\u5074\u306e\u30e1\u30e2\u30ea\u304c\u5c11\u306a\u3044\u3068\u5927\u304d\u304f\u30b9\u30b3\u30a2\u304c\u843d\u3061\u305f\u3002
\nGluster\u30b5\u30fc\u30d0\u5074\u306e\u30ad\u30e3\u30c3\u30b7\u30e5\u52b9\u679c\u306f\u30ed\u30fc\u30ab\u30eb\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u306e\u90e8\u5206\u3067\u91cd\u8981\u306a\u8981\u7d20\u3068\u306a\u3063\u3066\u3044\u308b\u3002<\/p>\n

\u25cfinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea) VS infiniband \u5206\u6563\u578b(72GB\u30e1\u30e2\u30ea)<\/p>\n

\u30fbinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea)
\nMax Write: 2475.39 MiB\/sec (2595.64 MB\/sec)
\nMax Read: 2701.51 MiB\/sec (2832.74 MB\/sec)<\/p>\n

\u30fbinfiniband \u5206\u6563\u578b(72GB\u30e1\u30e2\u30ea)
\nMax Write: 1936.59 MiB\/sec (2030.66 MB\/sec)
\nMax Read: 2008.95 MiB\/sec (2106.54 MB\/sec)<\/p>\n

\u30b9\u30c8\u30e9\u30a4\u30d6\u578b\u306e\u307b\u3046\u304c25%\uff5e33%\u304f\u3089\u3044\u901f\u3044\u3002<\/p>\n

\u25cfinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(2GB\u30e1\u30e2\u30ea) VS infiniband \u5206\u6563\u578b(2GB\u30e1\u30e2\u30ea)<\/p>\n

\u30fbinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(2GB\u30e1\u30e2\u30ea)
\nMax Write: 205.71 MiB\/sec (215.71 MB\/sec)
\nMax Read: 275.65 MiB\/sec (289.04 MB\/sec)<\/p>\n

\u30fbinfiniband \u5206\u6563\u578b(2GB\u30e1\u30e2\u30ea)
\nMax Write: 1102.60 MiB\/sec (1156.16 MB\/sec)
\nMax Read: 447.15 MiB\/sec (468.87 MB\/sec)<\/p>\n

Gluster\u30b5\u30fc\u30d0\u5074\u306e\u30e1\u30e2\u30ea\u304c\u5c11\u306a\u3044\u3068\u5206\u6563\u578b\u306e\u307b\u3046\u304c\u826f\u3044\u30b9\u30b3\u30a2\u304c\u51fa\u305f\u3002
\nMax Write\u304c\u5927\u304d\u304f\u5411\u4e0a\u3057\u3066\u3044\u308b\u3002<\/p>\n

\u25cfinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea 36\u30d7\u30ed\u30bb\u30b9) VS infiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea 72\u30d7\u30ed\u30bb\u30b9)<\/p>\n

\u30fbinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea 36\u30d7\u30ed\u30bb\u30b9)
\nMax Write: 2475.39 MiB\/sec (2595.64 MB\/sec)
\nMax Read: 2701.51 MiB\/sec (2832.74 MB\/sec)<\/p>\n

\u30fbinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b(72GB\u30e1\u30e2\u30ea 72\u30d7\u30ed\u30bb\u30b9)
\nMax Write: 262.79 MiB\/sec (275.56 MB\/sec)
\nMax Read: 2814.13 MiB\/sec (2950.82 MB\/sec)<\/p>\n

\u30d7\u30ed\u30bb\u30b9\u6570 36\u306872\u3067\u306f\u3001Max Write\u304c\u4e0b\u304c\u3063\u305f\u3002\u4e26\u5217\u6570\u304c\u591a\u304f\u306a\u308c\u3070\u8ca0\u8377\u304c\u4e0a\u304c\u308a\u5f71\u97ff\u304c\u51fa\u3066\u3044\u308b\u3002<\/p>\n

\u25cfinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b 3\u53f0(72GB\u30e1\u30e2\u30ea 36\u30d7\u30ed\u30bb\u30b9\u5b9f\u884c) VS infiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b 2\u53f0(72GB\u30e1\u30e2\u30ea 36\u30d7\u30ed\u30bb\u30b9\u5b9f\u884c)<\/p>\n

\u30fbinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b 3\u53f0(72GB\u30e1\u30e2\u30ea 36\u30d7\u30ed\u30bb\u30b9\u5b9f\u884c)
\nMax Write: 2475.39 MiB\/sec (2595.64 MB\/sec)
\nMax Read: 2701.51 MiB\/sec (2832.74 MB\/sec)<\/p>\n

\u30fbinfiniband \u30b9\u30c8\u30e9\u30a4\u30d7\u578b 2\u53f0(72GB\u30e1\u30e2\u30ea 36\u30d7\u30ed\u30bb\u30b9\u5b9f\u884c)
\nMax Write: 968.56 MiB\/sec (1015.61 MB\/sec)
\nMax Read: 1940.63 MiB\/sec (2034.90 MB\/sec)<\/p>\n

2\u53f0\u306b\u306a\u308b\u3068Max Write\u304c60%\u52a3\u5316\u3057\u305f\u3002
\n\u30b5\u30fc\u30d0\u3092\u5897\u3084\u3059\u3053\u3068\u3067\u4e26\u5217I\/O\u3078\u306e\u5e2f\u57df\u306f\u5897\u3084\u305b\u305d\u3046\u3060\u3002<\/p>\n

\u25a0\u5168\u4f53\u8a55\u4fa1
\nGluster\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u306f\u4ee5\u4e0b\u304c\u52b9\u679c\u7684\u3068\u601d\u308f\u308c\u308b\u3002
\n\u591a\u304f\u306e\u30e1\u30e2\u30ea\u3092\u642d\u8f09\uff08\u30ad\u30e3\u30c3\u30b7\u30e5\u52b9\u679c\uff09
\nGluster\u30b5\u30fc\u30d0\u306e\u5897\u8a2d\uff08\u4e26\u5217\u52b9\u679c\uff09<\/p>\n

\u3044\u305a\u308c\u306b\u3057\u3066\u3082\u3001\u76ee\u7684\u3092\u660e\u78ba\u306b\u3059\u308b\u3053\u3068\u304c\u69cb\u6210\u9078\u629e\u3078\u306e\u6700\u521d\u306e\u4e00\u6b69\u3067\u3059\u306d\u3002<\/p>\n

\u4ee5\u4e0a<\/p>\n","protected":false},"excerpt":{"rendered":"

\u5206\u6563\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u304c\u6ce8\u76ee\u3055\u308c\u3066\u3044\u307e\u3059\u3002 \u8907\u6570\u306e\u5b9f\u88c5\u304c\u3042\u308a\u307e\u3059\u304c\u3001\u4eca\u56de\u306fGluster\u3092\u52d5\u304b\u3057\u3066\u307f\u307e\u3057\u305f\u3002 Gluster\u306f\u3001\u30af\u30e9\u30a6\u30c9\u74b0\u5883\u3084HPC\u74b0\u5883\u306b\u3082\u4f7f\u3048\u308b\u5206\u6563\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u3067\u3059\u3002 \u30ed\u30fc\u30ab\u30eb\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u3092\u30a8\u30af\u30b9 […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,7],"tags":[],"class_list":["post-638","post","type-post","status-publish","format-standard","hentry","category-pc","category-7"],"_links":{"self":[{"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/posts\/638","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=638"}],"version-history":[{"count":14,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/posts\/638\/revisions"}],"predecessor-version":[{"id":641,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=\/wp\/v2\/posts\/638\/revisions\/641"}],"wp:attachment":[{"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=638"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=638"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.systemworks.co.jp\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=638"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}