Starting systematic I/O integrity test... ================================= [*] Testing file size: 64M buffered-write-verify-test: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=posixaio, iodepth=1 fio-3.41 Starting 1 process buffered-write-verify-test: Laying out IO file (1 file / 64MiB) buffered-write-verify-test: (groupid=0, jobs=1): err= 0: pid=2372: Thu Nov 20 11:00:26 2025 read: IOPS=179, BW=179MiB/s (188MB/s)(64.0MiB/357msec) slat (nsec): min=1000, max=5000, avg=2609.37, stdev=936.34 clat (usec): min=256, max=640, avg=506.34, stdev=97.78 lat (usec): min=259, max=642, avg=508.95, stdev=97.73 clat percentiles (usec): | 1.00th=[ 258], 5.00th=[ 322], 10.00th=[ 400], 20.00th=[ 424], | 30.00th=[ 449], 40.00th=[ 478], 50.00th=[ 510], 60.00th=[ 570], | 70.00th=[ 586], 80.00th=[ 594], 90.00th=[ 611], 95.00th=[ 627], | 99.00th=[ 644], 99.50th=[ 644], 99.90th=[ 644], 99.95th=[ 644], | 99.99th=[ 644] write: IOPS=151, BW=151MiB/s (159MB/s)(64.0MiB/423msec); 0 zone resets slat (usec): min=5215, max=9710, avg=5764.25, stdev=798.54 clat (usec): min=328, max=1512, avg=842.25, stdev=281.07 lat (usec): min=5638, max=10405, avg=6606.50, stdev=810.63 clat percentiles (usec): | 1.00th=[ 330], 5.00th=[ 445], 10.00th=[ 494], 20.00th=[ 553], | 30.00th=[ 709], 40.00th=[ 742], 50.00th=[ 766], 60.00th=[ 840], | 70.00th=[ 1057], 80.00th=[ 1156], 90.00th=[ 1221], 95.00th=[ 1270], | 99.00th=[ 1516], 99.50th=[ 1516], 99.90th=[ 1516], 99.95th=[ 1516], | 99.99th=[ 1516] bw ( KiB/s): min=129774, max=129774, per=83.76%, avg=129774.00, stdev= 0.00, samples=1 iops : min= 126, max= 126, avg=126.00, stdev= 0.00, samples=1 lat (usec) : 500=28.91%, 750=43.75%, 1000=10.94% lat (msec) : 2=16.41% cpu : usr=88.25%, sys=0.26%, ctx=140, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=64,64,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): READ: bw=179MiB/s (188MB/s), 179MiB/s-179MiB/s (188MB/s-188MB/s), io=64.0MiB (67.1MB), run=357-357msec WRITE: bw=151MiB/s (159MB/s), 151MiB/s-151MiB/s (159MB/s-159MB/s), io=64.0MiB (67.1MB), run=423-423msec [OK] Test passed for file size 64M. [*] Testing file size: 128M buffered-write-verify-test: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=posixaio, iodepth=1 fio-3.41 Starting 1 process buffered-write-verify-test: Laying out IO file (1 file / 128MiB) Jobs: 1 (f=1) buffered-write-verify-test: (groupid=0, jobs=1): err= 0: pid=2378: Thu Nov 20 11:00:28 2025 read: IOPS=178, BW=178MiB/s (187MB/s)(128MiB/718msec) slat (nsec): min=1000, max=7000, avg=2726.56, stdev=936.70 clat (usec): min=209, max=648, avg=527.17, stdev=96.90 lat (usec): min=211, max=650, avg=529.90, stdev=97.00 clat percentiles (usec): | 1.00th=[ 247], 5.00th=[ 314], 10.00th=[ 367], 20.00th=[ 465], | 30.00th=[ 519], 40.00th=[ 545], 50.00th=[ 570], 60.00th=[ 578], | 70.00th=[ 586], 80.00th=[ 594], 90.00th=[ 619], 95.00th=[ 627], | 99.00th=[ 635], 99.50th=[ 652], 99.90th=[ 652], 99.95th=[ 652], | 99.99th=[ 652] write: IOPS=153, BW=154MiB/s (161MB/s)(128MiB/833msec); 0 zone resets slat (usec): min=5310, max=10248, avg=5649.34, stdev=619.41 clat (usec): min=326, max=1544, avg=851.41, stdev=266.19 lat (usec): min=5804, max=11130, avg=6500.75, stdev=664.24 clat percentiles (usec): | 1.00th=[ 363], 5.00th=[ 420], 10.00th=[ 474], 20.00th=[ 619], | 30.00th=[ 734], 40.00th=[ 750], 50.00th=[ 824], 60.00th=[ 881], | 70.00th=[ 979], 80.00th=[ 1106], 90.00th=[ 1172], 95.00th=[ 1352], | 99.00th=[ 1500], 99.50th=[ 1549], 99.90th=[ 1549], 99.95th=[ 1549], | 99.99th=[ 1549] bw ( KiB/s): min=105441, max=154106, per=82.47%, avg=129773.50, stdev=34411.35, samples=2 iops : min= 102, max= 150, avg=126.00, stdev=33.94, samples=2 lat (usec) : 250=0.78%, 500=18.36%, 750=51.56%, 1000=14.84% lat (msec) : 2=14.45% cpu : usr=88.10%, sys=0.26%, ctx=278, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=128,128,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): READ: bw=178MiB/s (187MB/s), 178MiB/s-178MiB/s (187MB/s-187MB/s), io=128MiB (134MB), run=718-718msec WRITE: bw=154MiB/s (161MB/s), 154MiB/s-154MiB/s (161MB/s-161MB/s), io=128MiB (134MB), run=833-833msec [OK] Test passed for file size 128M. [*] Testing file size: 256M buffered-write-verify-test: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=posixaio, iodepth=1 fio-3.41 Starting 1 process buffered-write-verify-test: Laying out IO file (1 file / 256MiB) verify: bad header rand_seed 46386204153304124, wanted 9852480210356360750 at file /Volumes/RAID5-0/fio-test/fio_test_file.dat offset 1048576, length 1048576 (requested block: offset=1048576, length=1048576) fio: pid=2384, err=92/file:io_u.c:2318, func=io_u_queued_complete, error=Illegal byte sequence buffered-write-verify-test: (groupid=0, jobs=1): err=92 (file:io_u.c:2318, func=io_u_queued_complete, error=Illegal byte sequence): pid=2384: Thu Nov 20 11:00:30 2025 read: IOPS=285, BW=286MiB/s (300MB/s)(2048KiB/7msec) slat (nsec): min=1000, max=5000, avg=3000.00, stdev=2828.43 clat (usec): min=546, max=1295, avg=920.50, stdev=529.62 lat (usec): min=547, max=1300, avg=923.50, stdev=532.45 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 545], 50.00th=[ 545], 60.00th=[ 1303], | 70.00th=[ 1303], 80.00th=[ 1303], 90.00th=[ 1303], 95.00th=[ 1303], | 99.00th=[ 1303], 99.50th=[ 1303], 99.90th=[ 1303], 99.95th=[ 1303], | 99.99th=[ 1303] write: IOPS=156, BW=157MiB/s (164MB/s)(256MiB/1635msec); 0 zone resets slat (usec): min=5267, max=9244, avg=5554.95, stdev=358.62 clat (usec): min=217, max=1339, avg=829.77, stdev=245.23 lat (usec): min=5575, max=9967, avg=6384.72, stdev=413.18 clat percentiles (usec): | 1.00th=[ 285], 5.00th=[ 420], 10.00th=[ 494], 20.00th=[ 635], | 30.00th=[ 717], 40.00th=[ 750], 50.00th=[ 766], 60.00th=[ 898], | 70.00th=[ 1004], 80.00th=[ 1106], 90.00th=[ 1156], 95.00th=[ 1188], | 99.00th=[ 1254], 99.50th=[ 1270], 99.90th=[ 1336], 99.95th=[ 1336], | 99.99th=[ 1336] bw ( KiB/s): min=156134, max=162217, per=99.82%, avg=160047.67, stdev=3395.99, samples=3 iops : min= 152, max= 158, avg=156.00, stdev= 3.46, samples=3 lat (usec) : 250=0.39%, 500=10.08%, 750=32.17%, 1000=26.74% lat (msec) : 2=30.62% cpu : usr=86.24%, sys=0.24%, ctx=287, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,256,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): READ: bw=286MiB/s (300MB/s), 286MiB/s-286MiB/s (300MB/s-300MB/s), io=2048KiB (2097kB), run=7-7msec WRITE: bw=157MiB/s (164MB/s), 157MiB/s-157MiB/s (164MB/s-164MB/s), io=256MiB (268MB), run=1635-1635msec -------------------------------------------------- [!!!] TEST FAILED at file size: 256M The issue is likely related to transfers of this size. Check the fio output for 'verify' or 'IO' related error messages. --------------------------------------------------