Chunk Size 64 Lard Test Results

1 xdd

[root@lard-oss-2 bin]#   ./xdd.linux -op read -targets 1 /dev/sdc -queuedepth 1 -blocksize 512 -reqsize 2048 -mbytes 131072 -passes 2 -verbose

IOIOIOIOIOIOIOIOIOIOI XDD version 6.5.013007.0001 IOIOIOIOIOIOIOIOIOIOIOI
xdd - I/O Performance Inc. Copyright 1992-2007
Starting time for this run, Wed Mar 23 12:40:56 2016

ID for this run, 'No ID Specified'
Maximum Process Priority, disabled
Passes, 2
Pass Delay in seconds, 0
Maximum Error Threshold, 0
Target Offset, 0
I/O Synchronization, 0
Total run-time limit in seconds, 0
Output file name, stdout
CSV output file name, 
Error output file name, stderr
Pass seek randomization, disabled
File write synchronization, disabled
Pass synchronization barriers, enabled
Number of Targets, 1
Number of I/O Threads, 1

Computer Name, lard-oss-2, User Name, root
OS release and version, Linux 2.6.32-573.el6.x86_64 #1 SMP Wed Jul 1 18:23:37 EDT 2015
Machine hardware type, x86_64
Number of processors on this system, 1
Page size in bytes, 4096
Number of physical pages, 16466417
Megabytes of physical memory, 64321
Seconds before starting, 0
   Target[0] Q[0], /dev/sdc
      Target directory, "./"
      Process ID, 62788
      Thread ID, 1935042304
      Processor, all/any
      Read/write ratio, 100.00,  0.00
      Throttle in MB/sec,   0.00
      Per-pass time limit in seconds, 0
      Blocksize in bytes, 512
      Request size, 2048, blocks, 1048576, bytes
      Number of Requests, 131072
      Start offset, 0
      Number of MegaBytes, 131072
      Pass Offset in blocks, 0
      I/O memory buffer is a normal memory buffer
      I/O memory buffer alignment in bytes, 4096
      Data pattern in buffer, '0x00'
      Data buffer verification is disabled.
      Direct I/O, disabled
      Seek pattern, sequential
      Seek range, 1048576
      Preallocation, 0
      Queue Depth, 1
      Timestamping, disabled
      Delete file, disabled
  • Results, sdc (file system and partitions) Read and Write (sdc)
# # # READ # # #
                     T  Q       Bytes      Ops    Time      Rate      IOPS   Latency     %CPU  OP_Type    ReqSize     
TARGET   PASS0001    0  1  137438953472   131072   104.568   1314.347     1253.46    0.0008     0.01   read     1048576 
TARGET   PASS0002    0  1  137438953472   131072   106.236   1293.711     1233.78    0.0008     0.01   read     1048576 
TARGET   Average     0  1  274877906944   262144   210.804   1303.947     1243.54    0.0008     0.01   read     1048576 
         Combined    1  1  274877906944   262144   210.804   1303.947     1243.54    0.0008     0.01   read     1048576 
Ending time for this run, Wed Mar 23 12:44:35 2016

# # # WRITE # # #
                     T  Q       Bytes      Ops    Time      Rate      IOPS   Latency     %CPU  OP_Type    ReqSize     
TARGET   PASS0001    0  1  137438953472   131072   107.135   1282.854     1223.42    0.0008     0.01   write     1048576 
TARGET   PASS0002    0  1  137438953472   131072   111.609   1231.435     1174.39    0.0009     0.01   write     1048576 
TARGET   Average     0  1  274877906944   262144   218.744   1256.618     1198.40    0.0008     0.01   write     1048576 
         Combined    1  1  274877906944   262144   218.744   1256.618     1198.40    0.0008     0.01   write     1048576 
Ending time for this run, Wed Mar 23 12:56:52 2016

  • Results, sdd (raw) Read and Write (sdd)
# # # READ # # #
                     T  Q       Bytes      Ops    Time      Rate      IOPS   Latency     %CPU  OP_Type    ReqSize     
TARGET   PASS0001    0  1  137438953472   131072   106.361   1292.194     1232.33    0.0008     0.01   read     1048576 
TARGET   PASS0002    0  1  137438953472   131072   107.954   1273.129     1214.15    0.0008     0.01   read     1048576 
TARGET   Average     0  1  274877906944   262144   214.315   1282.590     1223.17    0.0008     0.01   read     1048576 
         Combined    1  1  274877906944   262144   214.315   1282.590     1223.17    0.0008     0.01   read     1048576 
Ending time for this run, Wed Mar 23 13:12:35 2016

# # # WRITE # # # 
                    T  Q       Bytes      Ops    Time      Rate      IOPS   Latency     %CPU  OP_Type    ReqSize     
TARGET   PASS0001    0  1  137438953472   131072   106.162   1294.617     1234.64    0.0008     0.01   write     1048576 
TARGET   PASS0002    0  1  137438953472   131072   126.718   1084.607     1034.36    0.0010     0.01   write     1048576 
TARGET   Average     0  1  274877906944   262144   232.880   1180.343     1125.66    0.0009     0.01   write     1048576 
         Combined    1  1  274877906944   262144   232.880   1180.343     1125.66    0.0009     0.01   write     1048576 
Ending time for this run, Wed Mar 23 13:17:36 2016

2 iozone

  • Run iozone
cd /mnt/sdX; /tmp/root/iozone3_434/src/current/iozone -ec -t 1 -r 1M -s 128g -+n -i 0 -i 1

  • Results
Iozone: Performance Test of File I/O
           Version $Revision: 1.5 $
      Compiled for 64 bit mode.
      Build: linux 

   Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
                Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
                Vangel Bojaxhi, Ben England, Vikentsi Lapa,
                Alexey Skidanov.

   Run began: Wed Mar 23 14:08:22 2016

   Include fsync in write timing
   Include close in write timing
   Record Size 1024 kB
   File size set to 134217728 kB
   No retest option selected
   Command line used: /tmp/root/iozone3_434/src/current/iozone -ec -t 1 -r 1M -s 128g -+n -i 0 -i 1
   Output is in kBytes/sec
   Time Resolution = 0.000001 seconds.
   Processor cache size set to 1024 kBytes.
   Processor cache line size set to 32 bytes.
   File stride size set to 17 * record size.
   Throughput test with 1 process
   Each process writes a 134217728 kByte file in 1024 kByte records

Children see throughput for  1 initial writers    =  866563.56 kB/sec
   Parent sees throughput for  1 initial writers    =  866562.16 kB/sec
   Min throughput per process          =  866563.56 kB/sec 
   Max throughput per process          =  866563.56 kB/sec
   Avg throughput per process          =  866563.56 kB/sec
   Min xfer                = 134217728.00 kB

   Children see throughput for  1 readers       =  451720.44 kB/sec
   Parent sees throughput for  1 readers       =  451720.04 kB/sec
   Min throughput per process          =  451720.44 kB/sec 
   Max throughput per process          =  451720.44 kB/sec
   Avg throughput per process          =  451720.44 kB/sec
   Min xfer                = 134217728.00 kB

2.1 iozone retest with mkfs.ext4 -j -m0 -E stride=16 -E stripe-width=112 /dev/sdd

Run began: Fri Apr  1 13:34:14 2016

   Include fsync in write timing
   Include close in write timing
   Record Size 1024 kB
   File size set to 134217728 kB
   No retest option selected
   Command line used: /tmp/root/iozone3_434/src/current/iozone -ec -t 1 -r 1M -s 128g -+n -i 0 -i 1
   Output is in kBytes/sec
   Time Resolution = 0.000001 seconds.
   Processor cache size set to 1024 kBytes.
   Processor cache line size set to 32 bytes.
   File stride size set to 17 * record size.
   Throughput test with 1 process
   Each process writes a 134217728 kByte file in 1024 kByte records

   Children see throughput for  1 initial writers    =  887660.19 kB/sec
   Parent sees throughput for  1 initial writers    =  887658.92 kB/sec
   Min throughput per process          =  887660.19 kB/sec 
   Max throughput per process          =  887660.19 kB/sec
   Avg throughput per process          =  887660.19 kB/sec
   Min xfer                = 134217728.00 kB

   Children see throughput for  1 readers       =  496098.31 kB/sec
   Parent sees throughput for  1 readers       =  496097.82 kB/sec
   Min throughput per process          =  496098.31 kB/sec 
   Max throughput per process          =  496098.31 kB/sec
   Avg throughput per process          =  496098.31 kB/sec
   Min xfer                = 134217728.00 kB

This topic: HPC > WebHome > LustreFilesystem > LardLustreInstall > ChunkSize64
Topic revision: 2016-04-01, JessicaOtey
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback