Samsung PM953 8tb - Testing

Notes from testing the Samsung PM953 8tb for A future video on Level1

# 4k random reads 

fio-3.21
Starting 4 processes
Jobs: 4 (f=4): [r(4)][100.0%][r=2256MiB/s][r=578k IOPS][eta 00m:00s]
onessd: (groupid=0, jobs=4): err= 0: pid=8182: Sat May 15 15:09:15 2021
  read: IOPS=576k, BW=2249MiB/s (2359MB/s)(65.9GiB/30001msec)
   bw (  MiB/s): min= 2215, max= 2272, per=100.00%, avg=2252.48, stdev= 3.06, samples=236
   iops        : min=567040, max=581648, avg=576634.54, stdev=784.61, samples=236
  cpu          : usr=6.62%, sys=87.09%, ctx=480, majf=1, minf=25
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued rwts: total=17275576,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: bw=2249MiB/s (2359MB/s), 2249MiB/s-2249MiB/s (2359MB/s-2359MB/s), io=65.9GiB (70.8GB), run=30001-30001msec

Disk stats (read/write):
  nvme12n1: ios=17187891/0, merge=0/0, ticks=3783728/0, in_queue=3783728, util=99.78%


Crystal Disk Mark

Results:  

Sequential Read: 2881MB/s IOPS=2
Sequential Write: 1797MB/s IOPS=1

512KB Read: 1730MB/s IOPS=3460
512KB Write: 1729MB/s IOPS=3459

Sequential Q32T1 Read: 2935MB/s IOPS=91
Sequential Q32T1 Write: 1852MB/s IOPS=57

4KB Read: 23MB/s IOPS=6048
4KB Write: 167MB/s IOPS=42780

4KB Q32T1 Read: 697MB/s IOPS=178547
4KB Q32T1 Write: 1364MB/s IOPS=349432

4KB Q8T8 Read: 1302MB/s IOPS=333527
4KB Q8T8 Write: 1382MB/s IOPS=353953



[root@localhost 1]# fio --name=random-write --ioengine=posixaio --rw=randwrite --bs=64k --size=256m --numjobs=16 --iodepth=16 --runtime=60 --time_based --end_fsync=1 ./a
random-write: (g=0): rw=randwrite, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=posixaio, iodepth=16
...
fio-3.21
Starting 16 processes
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
random-write: Laying out IO file (1 file / 256MiB)
Jobs: 14 (f=14): [w(2),F(1),w(1),_(1),F(1),w(1),F(1),_(1),w(1),F(2),w(1),F(2),w(1)][100.0%][w=240MiB/s][w=3840 IOPS][eta 00m:00s]
random-write: (groupid=0, jobs=1): err= 0: pid=27284: Sat May 15 15:39:10 2021
  write: IOPS=2076, BW=130MiB/s (136MB/s)(7936MiB/61157msec); 0 zone resets
    slat (nsec): min=390, max=297628, avg=1903.03, stdev=1628.91
    clat (usec): min=53, max=2457.8k, avg=6423.30, stdev=104553.91
     lat (usec): min=96, max=2457.8k, avg=6425.20, stdev=104553.91
    clat percentiles (usec):
     |  1.00th=[    326],  5.00th=[    347], 10.00th=[    359],
     | 20.00th=[    375], 30.00th=[    404], 40.00th=[    494],
     | 50.00th=[    529], 60.00th=[    586], 70.00th=[    635],
     | 80.00th=[    709], 90.00th=[    840], 95.00th=[   1090],
     | 99.00th=[   1237], 99.50th=[   1827], 99.90th=[1954546],
     | 99.95th=[2231370], 99.99th=[2466251]
   bw (  KiB/s): min=17664, max=524928, per=21.35%, avg=406249.07, stdev=165266.73, samples=40
   iops        : min=  276, max= 8202, avg=6347.63, stdev=2582.28, samples=40
  lat (usec)   : 100=0.01%, 250=0.04%, 500=41.67%, 750=41.30%, 1000=10.80%
  lat (msec)   : 2=5.71%, 4=0.12%, 50=0.01%, 2000=0.23%, >=2000=0.10%
  cpu          : usr=0.62%, sys=3.88%, ctx=67396, majf=0, minf=29
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.7%, 8=1.8%, 16=2.5%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,126977,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27285: Sat May 15 15:39:10 2021
  write: IOPS=1745, BW=109MiB/s (114MB/s)(6656MiB/61022msec); 0 zone resets
    slat (nsec): min=541, max=142577, avg=1966.60, stdev=1436.81
    clat (usec): min=60, max=3144.5k, avg=6703.48, stdev=116986.54
     lat (usec): min=92, max=3144.5k, avg=6705.44, stdev=116986.53
    clat percentiles (usec):
     |  1.00th=[    334],  5.00th=[    363], 10.00th=[    375],
     | 20.00th=[    396], 30.00th=[    465], 40.00th=[    529],
     | 50.00th=[    570], 60.00th=[    603], 70.00th=[    644],
     | 80.00th=[    717], 90.00th=[    914], 95.00th=[   1123],
     | 99.00th=[   1205], 99.50th=[   1483], 99.90th=[2264925],
     | 99.95th=[2365588], 99.99th=[3137340]
   bw (  KiB/s): min=11520, max=525184, per=21.70%, avg=412985.55, stdev=163769.57, samples=33
   iops        : min=  180, max= 8206, avg=6452.88, stdev=2558.89, samples=33
  lat (usec)   : 100=0.01%, 250=0.02%, 500=34.53%, 750=48.08%, 1000=9.52%
  lat (msec)   : 2=7.42%, 4=0.13%, 50=0.02%, 2000=0.09%, >=2000=0.19%
  cpu          : usr=0.50%, sys=3.63%, ctx=58269, majf=0, minf=30
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.2%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.7%, 8=2.4%, 16=1.9%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,106497,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27286: Sat May 15 15:39:10 2021
  write: IOPS=1816, BW=114MiB/s (119MB/s)(6912MiB/60873msec); 0 zone resets
    slat (nsec): min=451, max=294582, avg=1864.15, stdev=1590.33
    clat (usec): min=28, max=2999.1k, avg=7252.25, stdev=119708.53
     lat (usec): min=32, max=2999.1k, avg=7254.12, stdev=119708.52
    clat percentiles (usec):
     |  1.00th=[    330],  5.00th=[    355], 10.00th=[    367],
     | 20.00th=[    379], 30.00th=[    392], 40.00th=[    412],
     | 50.00th=[    486], 60.00th=[    537], 70.00th=[    594],
     | 80.00th=[    668], 90.00th=[    824], 95.00th=[   1074],
     | 99.00th=[   1172], 99.50th=[   1434], 99.90th=[2197816],
     | 99.95th=[2332034], 99.99th=[2835350]
   bw (  KiB/s): min=16384, max=525056, per=21.87%, avg=416259.21, stdev=160300.23, samples=34
   iops        : min=  256, max= 8204, avg=6504.03, stdev=2504.68, samples=34
  lat (usec)   : 50=0.01%, 100=0.01%, 250=0.07%, 500=52.33%, 750=34.36%
  lat (usec)   : 1000=6.58%
  lat (msec)   : 2=6.19%, 4=0.12%, 50=0.01%, 100=0.01%, 2000=0.14%
  lat (msec)   : >=2000=0.18%
  cpu          : usr=0.54%, sys=3.54%, ctx=59588, majf=0, minf=28
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.1%, 8=3.4%, 16=1.5%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,110593,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27287: Sat May 15 15:39:10 2021
  write: IOPS=1813, BW=113MiB/s (119MB/s)(6912MiB/60975msec); 0 zone resets
    slat (nsec): min=351, max=703499, avg=1917.93, stdev=2637.02
    clat (usec): min=56, max=2616.6k, avg=6973.68, stdev=118032.25
     lat (usec): min=86, max=2616.6k, avg=6975.59, stdev=118032.25
    clat percentiles (usec):
     |  1.00th=[    314],  5.00th=[    359], 10.00th=[    371],
     | 20.00th=[    392], 30.00th=[    457], 40.00th=[    519],
     | 50.00th=[    553], 60.00th=[    586], 70.00th=[    627],
     | 80.00th=[    685], 90.00th=[    799], 95.00th=[   1090],
     | 99.00th=[   1172], 99.50th=[   1336], 99.90th=[2298479],
     | 99.95th=[2432697], 99.99th=[2566915]
   bw (  KiB/s): min=64256, max=525056, per=22.53%, avg=428873.06, stdev=154489.77, samples=33
   iops        : min= 1004, max= 8204, avg=6701.12, stdev=2413.89, samples=33
  lat (usec)   : 100=0.01%, 250=0.06%, 500=36.32%, 750=52.59%, 1000=3.82%
  lat (msec)   : 2=6.79%, 4=0.09%, 50=0.01%, 2000=0.09%, >=2000=0.21%
  cpu          : usr=0.51%, sys=3.60%, ctx=60466, majf=0, minf=28
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.2%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.6%, 8=1.8%, 16=2.6%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,110593,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27288: Sat May 15 15:39:10 2021
  write: IOPS=1818, BW=114MiB/s (119MB/s)(6912MiB/60829msec); 0 zone resets
    slat (nsec): min=351, max=83447, avg=1933.55, stdev=1028.18
    clat (usec): min=65, max=2922.3k, avg=6010.30, stdev=106910.98
     lat (usec): min=97, max=2922.3k, avg=6012.23, stdev=106910.97
    clat percentiles (usec):
     |  1.00th=[    322],  5.00th=[    351], 10.00th=[    363],
     | 20.00th=[    379], 30.00th=[    404], 40.00th=[    490],
     | 50.00th=[    545], 60.00th=[    578], 70.00th=[    603],
     | 80.00th=[    676], 90.00th=[    881], 95.00th=[   1074],
     | 99.00th=[   1156], 99.50th=[   1483], 99.90th=[2055209],
     | 99.95th=[2332034], 99.99th=[2600469]
   bw (  KiB/s): min= 9472, max=525056, per=20.10%, avg=382536.08, stdev=184049.07, samples=37
   iops        : min=  148, max= 8204, avg=5977.11, stdev=2875.75, samples=37
  lat (usec)   : 100=0.01%, 250=0.07%, 500=41.46%, 750=44.10%, 1000=7.61%
  lat (msec)   : 2=6.32%, 4=0.13%, 50=0.04%, 2000=0.12%, >=2000=0.14%
  cpu          : usr=0.56%, sys=3.72%, ctx=61102, majf=0, minf=28
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.8%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.9%, 8=1.9%, 16=2.2%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,110593,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27289: Sat May 15 15:39:10 2021
  write: IOPS=1884, BW=118MiB/s (123MB/s)(7168MiB/60873msec); 0 zone resets
    slat (nsec): min=490, max=191368, avg=1820.21, stdev=1535.10
    clat (usec): min=23, max=2598.6k, avg=7506.11, stdev=119131.66
     lat (usec): min=28, max=2598.7k, avg=7507.93, stdev=119131.65
    clat percentiles (usec):
     |  1.00th=[    322],  5.00th=[    367], 10.00th=[    379],
     | 20.00th=[    453], 30.00th=[    519], 40.00th=[    570],
     | 50.00th=[    603], 60.00th=[    635], 70.00th=[    668],
     | 80.00th=[    709], 90.00th=[    865], 95.00th=[   1090],
     | 99.00th=[   1172], 99.50th=[   1598], 99.90th=[2298479],
     | 99.95th=[2365588], 99.99th=[2600469]
   bw (  KiB/s): min=34816, max=524928, per=22.68%, avg=431683.15, stdev=145008.84, samples=34
   iops        : min=  544, max= 8202, avg=6745.03, stdev=2265.75, samples=34
  lat (usec)   : 50=0.01%, 100=0.02%, 250=0.04%, 500=26.06%, 750=58.75%
  lat (usec)   : 1000=8.13%
  lat (msec)   : 2=6.53%, 4=0.10%, 50=0.03%, 250=0.01%, 2000=0.18%
  lat (msec)   : >=2000=0.16%
  cpu          : usr=0.56%, sys=3.72%, ctx=62639, majf=0, minf=29
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.6%, 8=1.3%, 16=3.1%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,114689,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27290: Sat May 15 15:39:10 2021
  write: IOPS=2013, BW=126MiB/s (132MB/s)(7680MiB/61022msec); 0 zone resets
    slat (nsec): min=300, max=287158, avg=1823.21, stdev=1522.00
    clat (usec): min=60, max=2909.2k, avg=6473.89, stdev=108135.58
     lat (usec): min=84, max=2909.2k, avg=6475.71, stdev=108135.58
    clat percentiles (usec):
     |  1.00th=[    262],  5.00th=[    351], 10.00th=[    367],
     | 20.00th=[    383], 30.00th=[    408], 40.00th=[    494],
     | 50.00th=[    537], 60.00th=[    562], 70.00th=[    594],
     | 80.00th=[    652], 90.00th=[    816], 95.00th=[   1020],
     | 99.00th=[   1156], 99.50th=[   1352], 99.90th=[2088764],
     | 99.95th=[2264925], 99.99th=[2734687]
   bw (  KiB/s): min= 4992, max=525184, per=23.61%, avg=449305.00, stdev=158253.26, samples=35
   iops        : min=   78, max= 8206, avg=7020.37, stdev=2472.70, samples=35
  lat (usec)   : 100=0.01%, 250=0.34%, 500=40.30%, 750=45.80%, 1000=8.23%
  lat (msec)   : 2=4.92%, 4=0.07%, 50=0.01%, 250=0.01%, 1000=0.01%
  lat (msec)   : 2000=0.18%, >=2000=0.13%
  cpu          : usr=0.53%, sys=3.83%, ctx=65616, majf=0, minf=33
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.6%, 8=3.0%, 16=1.4%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,122881,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27291: Sat May 15 15:39:10 2021
  write: IOPS=1746, BW=109MiB/s (114MB/s)(6656MiB/60975msec); 0 zone resets
    slat (nsec): min=431, max=269055, avg=1874.60, stdev=1508.87
    clat (usec): min=34, max=2824.4k, avg=6051.60, stdev=111267.55
     lat (usec): min=38, max=2824.4k, avg=6053.48, stdev=111267.55
    clat percentiles (usec):
     |  1.00th=[    351],  5.00th=[    367], 10.00th=[    375],
     | 20.00th=[    388], 30.00th=[    408], 40.00th=[    474],
     | 50.00th=[    519], 60.00th=[    553], 70.00th=[    594],
     | 80.00th=[    652], 90.00th=[    832], 95.00th=[   1090],
     | 99.00th=[   1172], 99.50th=[   1237], 99.90th=[2332034],
     | 99.95th=[2432697], 99.99th=[2835350]
   bw (  KiB/s): min= 5248, max=525184, per=19.35%, avg=368348.84, stdev=166837.39, samples=37
   iops        : min=   82, max= 8206, avg=5755.43, stdev=2606.82, samples=37
  lat (usec)   : 50=0.01%, 100=0.01%, 250=0.09%, 500=45.03%, 750=41.79%
  lat (usec)   : 1000=6.24%
  lat (msec)   : 2=6.49%, 4=0.09%, 50=0.02%, 2000=0.07%, >=2000=0.18%
  cpu          : usr=0.50%, sys=3.55%, ctx=58346, majf=2, minf=30
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.2%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.7%, 8=2.2%, 16=2.2%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,106497,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27292: Sat May 15 15:39:10 2021
  write: IOPS=1895, BW=118MiB/s (124MB/s)(7168MiB/60510msec); 0 zone resets
    slat (nsec): min=320, max=245961, avg=1898.88, stdev=1654.11
    clat (usec): min=59, max=2699.5k, avg=7504.28, stdev=119132.68
     lat (usec): min=102, max=2699.5k, avg=7506.17, stdev=119132.68
    clat percentiles (usec):
     |  1.00th=[    330],  5.00th=[    359], 10.00th=[    371],
     | 20.00th=[    383], 30.00th=[    404], 40.00th=[    478],
     | 50.00th=[    523], 60.00th=[    578], 70.00th=[    627],
     | 80.00th=[    685], 90.00th=[    857], 95.00th=[   1057],
     | 99.00th=[   1188], 99.50th=[   1827], 99.90th=[2164261],
     | 99.95th=[2231370], 99.99th=[2701132]
   bw (  KiB/s): min=16640, max=525056, per=22.03%, avg=419345.69, stdev=179729.78, samples=35
   iops        : min=  260, max= 8204, avg=6552.26, stdev=2808.27, samples=35
  lat (usec)   : 100=0.02%, 250=0.05%, 500=44.15%, 750=41.00%, 1000=8.54%
  lat (msec)   : 2=5.76%, 4=0.11%, 50=0.03%, 2000=0.15%, >=2000=0.20%
  cpu          : usr=0.57%, sys=3.72%, ctx=62494, majf=0, minf=27
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.9%, 8=1.9%, 16=2.2%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,114689,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27296: Sat May 15 15:39:10 2021
  write: IOPS=2010, BW=126MiB/s (132MB/s)(7680MiB/61112msec); 0 zone resets
    slat (nsec): min=431, max=296496, avg=1906.95, stdev=1384.68
    clat (usec): min=28, max=2411.3k, avg=6161.50, stdev=102419.71
     lat (usec): min=31, max=2411.3k, avg=6163.40, stdev=102419.71
    clat percentiles (usec):
     |  1.00th=[    326],  5.00th=[    359], 10.00th=[    371],
     | 20.00th=[    396], 30.00th=[    519], 40.00th=[    578],
     | 50.00th=[    611], 60.00th=[    635], 70.00th=[    668],
     | 80.00th=[    717], 90.00th=[    840], 95.00th=[   1074],
     | 99.00th=[   1172], 99.50th=[   1549], 99.90th=[2004878],
     | 99.95th=[2197816], 99.99th=[2365588]
   bw (  KiB/s): min=52096, max=525184, per=22.33%, avg=425018.24, stdev=158326.34, samples=37
   iops        : min=  814, max= 8206, avg=6640.89, stdev=2473.84, samples=37
  lat (usec)   : 50=0.01%, 100=0.01%, 250=0.06%, 500=26.98%, 750=57.51%
  lat (usec)   : 1000=8.87%
  lat (msec)   : 2=6.12%, 4=0.10%, 50=0.05%, 2000=0.20%, >=2000=0.10%
  cpu          : usr=0.53%, sys=3.88%, ctx=67166, majf=0, minf=34
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.2%, 8=2.8%, 16=2.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,122881,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27297: Sat May 15 15:39:10 2021
  write: IOPS=1816, BW=114MiB/s (119MB/s)(6912MiB/60873msec); 0 zone resets
    slat (nsec): min=390, max=189937, avg=1888.28, stdev=1404.49
    clat (usec): min=55, max=2805.8k, avg=7738.73, stdev=124779.45
     lat (usec): min=100, max=2805.8k, avg=7740.62, stdev=124779.45
    clat percentiles (usec):
     |  1.00th=[    322],  5.00th=[    359], 10.00th=[    379],
     | 20.00th=[    424], 30.00th=[    523], 40.00th=[    562],
     | 50.00th=[    594], 60.00th=[    627], 70.00th=[    668],
     | 80.00th=[    742], 90.00th=[    857], 95.00th=[   1012],
     | 99.00th=[   1123], 99.50th=[   2089], 99.90th=[2264925],
     | 99.95th=[2566915], 99.99th=[2801796]
   bw (  KiB/s): min=42752, max=524800, per=18.59%, avg=353846.40, stdev=182355.98, samples=40
   iops        : min=  668, max= 8200, avg=5528.85, stdev=2849.31, samples=40
  lat (usec)   : 100=0.01%, 250=0.04%, 500=25.38%, 750=56.01%, 1000=13.31%
  lat (msec)   : 2=4.73%, 4=0.16%, 50=0.01%, 100=0.01%, 250=0.01%
  lat (msec)   : 2000=0.12%, >=2000=0.21%
  cpu          : usr=0.53%, sys=3.68%, ctx=60036, majf=0, minf=27
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.3%, 8=2.3%, 16=2.4%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,110593,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27298: Sat May 15 15:39:10 2021
  write: IOPS=1745, BW=109MiB/s (114MB/s)(6656MiB/61002msec); 0 zone resets
    slat (nsec): min=471, max=279785, avg=1946.78, stdev=1574.86
    clat (usec): min=64, max=2999.6k, avg=7520.93, stdev=124846.72
     lat (usec): min=104, max=2999.6k, avg=7522.87, stdev=124846.72
    clat percentiles (usec):
     |  1.00th=[    330],  5.00th=[    355], 10.00th=[    371],
     | 20.00th=[    400], 30.00th=[    498], 40.00th=[    537],
     | 50.00th=[    570], 60.00th=[    603], 70.00th=[    635],
     | 80.00th=[    668], 90.00th=[    832], 95.00th=[   1106],
     | 99.00th=[   1188], 99.50th=[   1369], 99.90th=[2298479],
     | 99.95th=[2466251], 99.99th=[3003122]
   bw (  KiB/s): min=57344, max=525184, per=21.70%, avg=412985.55, stdev=157660.89, samples=33
   iops        : min=  896, max= 8206, avg=6452.88, stdev=2463.44, samples=33
  lat (usec)   : 100=0.01%, 250=0.05%, 500=30.40%, 750=57.90%, 1000=4.78%
  lat (msec)   : 2=6.45%, 4=0.10%, 2000=0.10%, >=2000=0.21%
  cpu          : usr=0.52%, sys=3.57%, ctx=57297, majf=0, minf=28
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.8%, 8=2.5%, 16=1.6%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,106497,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27299: Sat May 15 15:39:10 2021
  write: IOPS=1876, BW=117MiB/s (123MB/s)(7168MiB/61112msec); 0 zone resets
    slat (nsec): min=501, max=361208, avg=1816.46, stdev=1573.39
    clat (usec): min=65, max=2698.0k, avg=6659.69, stdev=111530.75
     lat (usec): min=87, max=2698.0k, avg=6661.51, stdev=111530.75
    clat percentiles (usec):
     |  1.00th=[    338],  5.00th=[    367], 10.00th=[    379],
     | 20.00th=[    416], 30.00th=[    494], 40.00th=[    529],
     | 50.00th=[    553], 60.00th=[    578], 70.00th=[    619],
     | 80.00th=[    685], 90.00th=[    857], 95.00th=[   1090],
     | 99.00th=[   1156], 99.50th=[   1500], 99.90th=[2139096],
     | 99.95th=[2298479], 99.99th=[2701132]
   bw (  KiB/s): min= 2048, max=525312, per=20.84%, avg=396706.03, stdev=172493.38, samples=37
   iops        : min=   32, max= 8208, avg=6198.51, stdev=2695.20, samples=37
  lat (usec)   : 100=0.01%, 250=0.06%, 500=30.98%, 750=54.86%, 1000=7.44%
  lat (msec)   : 2=6.23%, 4=0.10%, 50=0.01%, 2000=0.15%, >=2000=0.15%
  cpu          : usr=0.51%, sys=3.79%, ctx=63236, majf=0, minf=28
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.2%, 16=49.6%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.7%, 8=2.2%, 16=2.2%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,114689,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27300: Sat May 15 15:39:10 2021
  write: IOPS=1749, BW=109MiB/s (115MB/s)(6656MiB/60873msec); 0 zone resets
    slat (nsec): min=301, max=398908, avg=1937.96, stdev=1777.75
    clat (usec): min=65, max=2766.1k, avg=7796.64, stdev=125639.59
     lat (usec): min=120, max=2766.1k, avg=7798.57, stdev=125639.59
    clat percentiles (usec):
     |  1.00th=[    355],  5.00th=[    375], 10.00th=[    383],
     | 20.00th=[    453], 30.00th=[    510], 40.00th=[    562],
     | 50.00th=[    603], 60.00th=[    644], 70.00th=[    685],
     | 80.00th=[    758], 90.00th=[    898], 95.00th=[   1106],
     | 99.00th=[   1188], 99.50th=[   2073], 99.90th=[2332034],
     | 99.95th=[2499806], 99.99th=[2768241]
   bw (  KiB/s): min= 1920, max=524928, per=19.89%, avg=378623.42, stdev=200631.93, samples=36
   iops        : min=   30, max= 8202, avg=5915.97, stdev=3134.86, samples=36
  lat (usec)   : 100=0.01%, 250=0.02%, 500=27.58%, 750=51.65%, 1000=13.27%
  lat (msec)   : 2=6.96%, 4=0.15%, 50=0.03%, 500=0.01%, 2000=0.12%
  lat (msec)   : >=2000=0.21%
  cpu          : usr=0.55%, sys=3.57%, ctx=57476, majf=0, minf=27
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.1%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.7%, 8=1.9%, 16=2.4%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,106497,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27301: Sat May 15 15:39:10 2021
  write: IOPS=2018, BW=126MiB/s (132MB/s)(7680MiB/60873msec); 0 zone resets
    slat (nsec): min=521, max=228779, avg=1912.27, stdev=1625.59
    clat (usec): min=42, max=2276.9k, avg=6239.39, stdev=104691.97
     lat (usec): min=47, max=2276.9k, avg=6241.30, stdev=104691.97
    clat percentiles (usec):
     |  1.00th=[    343],  5.00th=[    355], 10.00th=[    363],
     | 20.00th=[    375], 30.00th=[    392], 40.00th=[    441],
     | 50.00th=[    498], 60.00th=[    537], 70.00th=[    594],
     | 80.00th=[    709], 90.00th=[    881], 95.00th=[   1090],
     | 99.00th=[   1156], 99.50th=[   1729], 99.90th=[2055209],
     | 99.95th=[2231370], 99.99th=[2264925]
   bw (  KiB/s): min=31360, max=525312, per=21.19%, avg=403235.56, stdev=161133.85, samples=39
   iops        : min=  490, max= 8208, avg=6300.54, stdev=2517.70, samples=39
  lat (usec)   : 50=0.01%, 100=0.01%, 250=0.04%, 500=50.58%, 750=32.93%
  lat (usec)   : 1000=9.72%
  lat (msec)   : 2=6.25%, 4=0.14%, 20=0.01%, 50=0.01%, 250=0.01%
  lat (msec)   : 2000=0.17%, >=2000=0.13%
  cpu          : usr=0.54%, sys=3.68%, ctx=66540, majf=0, minf=29
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.2%, 16=49.7%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.8%, 8=2.5%, 16=1.7%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,122881,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=27302: Sat May 15 15:39:10 2021
  write: IOPS=1808, BW=113MiB/s (119MB/s)(6912MiB/61157msec); 0 zone resets
    slat (nsec): min=421, max=287639, avg=2090.71, stdev=2130.45
    clat (usec): min=48, max=2588.1k, avg=7038.79, stdev=116348.86
     lat (usec): min=109, max=2588.1k, avg=7040.89, stdev=116348.86
    clat percentiles (usec):
     |  1.00th=[    359],  5.00th=[    379], 10.00th=[    396],
     | 20.00th=[    515], 30.00th=[    562], 40.00th=[    603],
     | 50.00th=[    635], 60.00th=[    660], 70.00th=[    693],
     | 80.00th=[    758], 90.00th=[    881], 95.00th=[   1106],
     | 99.00th=[   1188], 99.50th=[   1663], 99.90th=[2197816],
     | 99.95th=[2365588], 99.99th=[2466251]
   bw (  KiB/s): min= 3072, max=524800, per=21.87%, avg=416262.91, stdev=164807.45, samples=34
   iops        : min=   48, max= 8200, avg=6504.09, stdev=2575.10, samples=34
  lat (usec)   : 50=0.01%, 100=0.01%, 250=0.04%, 500=17.95%, 750=61.47%
  lat (usec)   : 1000=13.61%
  lat (msec)   : 2=6.50%, 4=0.12%, 2000=0.09%, >=2000=0.22%
  cpu          : usr=0.60%, sys=3.57%, ctx=60459, majf=0, minf=28
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=50.2%, 16=49.6%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=95.8%, 8=2.6%, 16=1.6%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,110593,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
  WRITE: bw=1859MiB/s (1949MB/s), 109MiB/s-130MiB/s (114MB/s-136MB/s), io=111GiB (119GB), run=60510-61157msec

Disk stats (read/write):
  nvme12n1: ios=0/197071, merge=0/487, ticks=0/19551476, in_queue=19551475, util=99.52%


seq-read: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=io_uring, iodepth=128
...
rand-read: (g=1): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=io_uring, iodepth=128
...
seq-write: (g=2): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=io_uring, iodepth=128
...
rand-write: (g=3): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=io_uring, iodepth=128
...
fio-3.21
Starting 48 processes
seq-read: Laying out IO file (1 file / 1024MiB)
Jobs: 12 (f=12): [_(36),w(12)][100.0%][w=1648MiB/s][w=422k IOPS][eta 00m:00s]     
seq-read: (groupid=0, jobs=12): err= 0: pid=63860: Sat May 15 16:50:48 2021
  read: IOPS=463k, BW=1810MiB/s (1898MB/s)(106GiB/60004msec)
    slat (nsec): min=1222, max=729608, avg=2335.88, stdev=825.61
    clat (usec): min=91, max=13328, avg=3311.73, stdev=609.50
     lat (usec): min=93, max=13330, avg=3314.12, stdev=609.48
    clat percentiles (usec):
     |  1.00th=[ 2409],  5.00th=[ 2606], 10.00th=[ 2737], 20.00th=[ 2900],
     | 30.00th=[ 2999], 40.00th=[ 3097], 50.00th=[ 3228], 60.00th=[ 3326],
     | 70.00th=[ 3458], 80.00th=[ 3654], 90.00th=[ 3916], 95.00th=[ 4228],
     | 99.00th=[ 5669], 99.50th=[ 6325], 99.90th=[ 7832], 99.95th=[ 8979],
     | 99.99th=[10814]
   bw (  MiB/s): min= 1241, max= 2208, per=100.00%, avg=1811.68, stdev=13.28, samples=984
   iops        : min=317721, max=565291, avg=463785.77, stdev=3399.26, samples=984
  lat (usec)   : 100=0.01%, 250=0.01%, 500=0.02%, 750=0.02%, 1000=0.02%
  lat (msec)   : 2=0.10%, 4=91.32%, 10=8.49%, 20=0.02%
  cpu          : usr=2.44%, sys=10.01%, ctx=21901641, majf=0, minf=698
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
     issued rwts: total=27806056,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=128
rand-read: (groupid=1, jobs=12): err= 0: pid=64614: Sat May 15 16:50:48 2021
  read: IOPS=551k, BW=2151MiB/s (2255MB/s)(126GiB/60004msec)
    slat (nsec): min=1242, max=387316, avg=2335.04, stdev=858.28
    clat (usec): min=93, max=11961, avg=2787.28, stdev=317.80
     lat (usec): min=96, max=11963, avg=2789.67, stdev=317.80
    clat percentiles (usec):
     |  1.00th=[ 2376],  5.00th=[ 2507], 10.00th=[ 2540], 20.00th=[ 2638],
     | 30.00th=[ 2671], 40.00th=[ 2704], 50.00th=[ 2769], 60.00th=[ 2802],
     | 70.00th=[ 2835], 80.00th=[ 2900], 90.00th=[ 2999], 95.00th=[ 3097],
     | 99.00th=[ 3458], 99.50th=[ 5014], 99.90th=[ 5800], 99.95th=[ 7898],
     | 99.99th=[ 9372]
   bw (  MiB/s): min= 1748, max= 2346, per=100.00%, avg=2150.93, stdev= 8.11, samples=1008
   iops        : min=447545, max=600791, avg=550635.89, stdev=2076.03, samples=1008
  lat (usec)   : 100=0.01%, 250=0.01%, 500=0.02%, 750=0.02%, 1000=0.02%
  lat (msec)   : 2=0.10%, 4=99.08%, 10=0.75%, 20=0.01%
  cpu          : usr=2.76%, sys=11.62%, ctx=25521706, majf=0, minf=698
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
     issued rwts: total=33032597,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=128
seq-write: (groupid=2, jobs=12): err= 0: pid=65381: Sat May 15 16:50:48 2021
  write: IOPS=432k, BW=1687MiB/s (1769MB/s)(98.8GiB/60004msec); 0 zone resets
    slat (nsec): min=1242, max=2725.1k, avg=2278.70, stdev=1771.90
    clat (usec): min=147, max=19645, avg=3554.52, stdev=598.77
     lat (usec): min=154, max=19650, avg=3556.86, stdev=598.79
    clat percentiles (usec):
     |  1.00th=[ 2999],  5.00th=[ 3163], 10.00th=[ 3228], 20.00th=[ 3392],
     | 30.00th=[ 3425], 40.00th=[ 3458], 50.00th=[ 3490], 60.00th=[ 3523],
     | 70.00th=[ 3556], 80.00th=[ 3589], 90.00th=[ 3654], 95.00th=[ 3916],
     | 99.00th=[ 6456], 99.50th=[ 6587], 99.90th=[ 9896], 99.95th=[12911],
     | 99.99th=[16188]
   bw (  MiB/s): min= 1056, max= 1881, per=100.00%, avg=1687.64, stdev= 9.56, samples=972
   iops        : min=270464, max=481705, avg=432032.85, stdev=2446.52, samples=972
  lat (usec)   : 250=0.02%, 500=0.05%, 750=0.05%, 1000=0.05%
  lat (msec)   : 2=0.19%, 4=95.08%, 10=4.47%, 20=0.10%
  cpu          : usr=2.59%, sys=10.68%, ctx=7316371, majf=0, minf=700
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
     issued rwts: total=0,25908774,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=128
rand-write: (groupid=3, jobs=12): err= 0: pid=66193: Sat May 15 16:50:48 2021
  write: IOPS=420k, BW=1639MiB/s (1719MB/s)(96.1GiB/60004msec); 0 zone resets
    slat (nsec): min=1252, max=2752.4k, avg=2373.75, stdev=1750.47
    clat (usec): min=148, max=22520, avg=3657.25, stdev=584.48
     lat (usec): min=154, max=22522, avg=3659.69, stdev=584.48
    clat percentiles (usec):
     |  1.00th=[ 3130],  5.00th=[ 3326], 10.00th=[ 3425], 20.00th=[ 3490],
     | 30.00th=[ 3556], 40.00th=[ 3556], 50.00th=[ 3589], 60.00th=[ 3621],
     | 70.00th=[ 3654], 80.00th=[ 3720], 90.00th=[ 3818], 95.00th=[ 4015],
     | 99.00th=[ 6390], 99.50th=[ 6652], 99.90th=[11338], 99.95th=[15401],
     | 99.99th=[19006]
   bw (  MiB/s): min= 1121, max= 1795, per=100.00%, avg=1641.68, stdev= 6.51, samples=1428
   iops        : min=287120, max=459670, avg=420271.19, stdev=1666.67, samples=1428
  lat (usec)   : 250=0.02%, 500=0.06%, 750=0.05%, 1000=0.05%
  lat (msec)   : 2=0.18%, 4=94.38%, 10=5.15%, 20=0.12%, 50=0.01%
  cpu          : usr=2.77%, sys=10.79%, ctx=7289001, majf=0, minf=699
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
     issued rwts: total=0,25180585,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=128

Run status group 0 (all jobs):
   READ: bw=1810MiB/s (1898MB/s), 1810MiB/s-1810MiB/s (1898MB/s-1898MB/s), io=106GiB (114GB), run=60004-60004msec

Run status group 1 (all jobs):
   READ: bw=2151MiB/s (2255MB/s), 2151MiB/s-2151MiB/s (2255MB/s-2255MB/s), io=126GiB (135GB), run=60004-60004msec

Run status group 2 (all jobs):
  WRITE: bw=1687MiB/s (1769MB/s), 1687MiB/s-1687MiB/s (1769MB/s-1769MB/s), io=98.8GiB (106GB), run=60004-60004msec

Run status group 3 (all jobs):
  WRITE: bw=1639MiB/s (1719MB/s), 1639MiB/s-1639MiB/s (1719MB/s-1719MB/s), io=96.1GiB (103GB), run=60004-60004msec

Disk stats (read/write):
  nvme12n1: ios=91372891/76502535, merge=0/45, ticks=276148615/275497502, in_queue=551646117, util=99.96%

# smartctl -a 
=== START OF INFORMATION SECTION ===
Model Number:                       SAMSUNG MZQLB7T6HMLA-00007
Serial Number:                      
Firmware Version:                   EDB5102Q
PCI Vendor/Subsystem ID:            0x144d
IEEE OUI Identifier:                0x002538
Total NVM Capacity:                 7,681,501,126,656 [7.68 TB]
Unallocated NVM Capacity:           0
Controller ID:                      4
NVMe Version:                       1.2
Number of Namespaces:               1
Namespace 1 Size/Capacity:          7,681,501,126,656 [7.68 TB]
Namespace 1 Utilization:            67,594,858,496 [67.5 GB]
Namespace 1 Formatted LBA Size:     512
Local Time is:                      Sat May 15 17:10:19 2021 EDT
Firmware Updates (0x17):            3 Slots, Slot 1 R/O, no Reset required
Optional Admin Commands (0x000f):   Security Format Frmw_DL NS_Mngmt
Optional NVM Commands (0x001f):     Comp Wr_Unc DS_Mngmt Wr_Zero Sav/Sel_Feat
Log Page Attributes (0x03):         S/H_per_NS Cmd_Eff_Lg
Maximum Data Transfer Size:         512 Pages
Warning  Comp. Temp. Threshold:     86 Celsius
Critical Comp. Temp. Threshold:     87 Celsius
Namespace 1 Features (0x02):        NA_Fields

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +    10.60W       -        -    0  0  0  0        0       0

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 +     512       0         0
 1 -    4096       0         0

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:                   0x00
Temperature:                        36 Celsius
Available Spare:                    100%
Available Spare Threshold:          10%
Percentage Used:                    0%
Data Units Read:                    31,688,969 [16.2 TB]
Data Units Written:                 2,335,700 [1.19 TB]
Host Read Commands:                 633,231,198
Host Write Commands:                92,895,851
Controller Busy Time:               144
Power Cycles:                       4
Power On Hours:                     420
Unsafe Shutdowns:                   1
Media and Data Integrity Errors:    0
Error Information Log Entries:      1
Warning  Comp. Temperature Time:    0
Critical Comp. Temperature Time:    0
Temperature Sensor 1:               36 Celsius
Temperature Sensor 2:               41 Celsius
Temperature Sensor 3:               49 Celsius

Error Information (NVMe Log 0x01, 16 of 64 entries)
No Errors Logged

10 watts for a u.2? Not bad!

… More later!

3 Likes

Who is this wendell and why does he always use the forum like a scratch paper of sorts?

:laughing:

2 Likes

Heh. Should probably be Crystal. :slight_smile:

Is it just me or does this seem a little sluggish?

Its a little older ssd, but you can pick them up now for ~$100/tb so its pretty decent for that cost in this capacity.

1 Like

This topic was automatically closed 273 days after the last reply. New replies are no longer allowed.