I just came here to post the exact same problem for my F8 SSD (not Plus) and found this post.
August 23rd, a WD RED 1TB in slot 7 went offline:
Code: Select all
[Sat Aug 23 18:42:01 2025] nvme nvme0: I/O 334 (I/O Cmd) QID 4 timeout, aborting
[Sat Aug 23 18:42:01 2025] nvme nvme0: I/O 335 (I/O Cmd) QID 4 timeout, aborting
[Sat Aug 23 18:42:01 2025] nvme nvme0: I/O 336 (I/O Cmd) QID 4 timeout, aborting
[Sat Aug 23 18:42:01 2025] nvme nvme0: I/O 337 (I/O Cmd) QID 4 timeout, aborting
[Sat Aug 23 18:42:01 2025] nvme nvme0: I/O 338 (I/O Cmd) QID 4 timeout, aborting
[Sat Aug 23 18:42:31 2025] nvme nvme0: I/O 334 QID 4 timeout, reset controller
[Sat Aug 23 18:42:34 2025] nvme nvme0: I/O 9 QID 0 timeout, reset controller
[Sat Aug 23 18:43:44 2025] nvme nvme0: Device not ready; aborting reset, CSTS=0x1
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404237440, 144 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404237440 op 0x0:(READ) flags 0x80700 phys_seg 11 prio class 2
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404237592, 104 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404237592 op 0x0:(READ) flags 0x80700 phys_seg 7 prio class 2
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404238208, 128 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404238208 op 0x0:(READ) flags 0x80700 phys_seg 8 prio class 2
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404238464, 256 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404238464 op 0x0:(READ) flags 0x80700 phys_seg 16 prio class 2
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404237824, 384 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404237824 op 0x0:(READ) flags 0x80700 phys_seg 24 prio class 2
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404239328, 112 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404239328 op 0x0:(READ) flags 0x80700 phys_seg 7 prio class 2
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404238720, 256 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404238720 op 0x0:(READ) flags 0x80700 phys_seg 16 prio class 2
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404239104, 224 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404239104 op 0x0:(READ) flags 0x80700 phys_seg 14 prio class 2
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404235392, 384 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404235392 op 0x0:(READ) flags 0x80700 phys_seg 47 prio class 2
[Sat Aug 23 18:43:44 2025] sdza: I/O Cmd(0x2) @ LBA 404235904, 384 blocks, I/O Error (sct 0x3 / sc 0x71)
[Sat Aug 23 18:43:44 2025] I/O error, dev sdza, sector 404235904 op 0x0:(READ) flags 0x80700 phys_seg 48 prio class 2
[Sat Aug 23 18:43:44 2025] nvme nvme0: Abort status: 0x371
[Sat Aug 23 18:43:44 2025] nvme nvme0: Abort status: 0x371
[Sat Aug 23 18:43:44 2025] nvme nvme0: Abort status: 0x371
[Sat Aug 23 18:43:44 2025] nvme nvme0: Abort status: 0x371
[Sat Aug 23 18:43:44 2025] nvme nvme0: Abort status: 0x371
[Sat Aug 23 18:44:06 2025] nvme nvme0: Device not ready; aborting reset, CSTS=0x1
[Sat Aug 23 18:44:06 2025] nvme nvme0: Removing after probe failure status: -19
[Sat Aug 23 18:44:29 2025] nvme nvme0: Device not ready; aborting reset, CSTS=0x1
[Sat Aug 23 18:44:29 2025] sdza: detected capacity change from 1953525168 to 0
[Sat Aug 23 18:44:29 2025] md: super_written gets error=-5
[Sat Aug 23 18:44:29 2025] md/raid:md0: Disk failure on sdza4, disabling device.
[Sat Aug 23 18:44:29 2025] md/raid:md0: Operation continuing on 4 devices.
Today, a brand new Samsung 990 Pro 2TB in slot 2 went offline:
Code: Select all
[1467682.857543] nvme nvme3: I/O 438 (I/O Cmd) QID 4 timeout, aborting
[1467712.041542] nvme nvme3: I/O 8 QID 0 timeout, reset controller
[1467713.065542] nvme nvme3: I/O 459 (I/O Cmd) QID 2 timeout, aborting
[1467713.065578] nvme nvme3: I/O 438 QID 4 timeout, reset controller
[1467794.488889] nvme nvme3: Device not ready; aborting reset, CSTS=0x1
[1467794.494709] nvme nvme3: Abort status: 0x371
[1467794.494712] nvme nvme3: Abort status: 0x371
[1467815.007821] nvme nvme3: Device not ready; aborting reset, CSTS=0x1
[1467815.007835] nvme nvme3: Removing after probe failure status: -19
[1467835.515566] nvme nvme3: Device not ready; aborting reset, CSTS=0x1
[1467835.515730] sdzd: detected capacity change from 3907029168 to 0
[1467835.515736] md/raid1:md8: sdzd3: rescheduling sector 3988960
[1467835.515776] md: super_written gets error=-5
[1467835.515782] md/raid1:md9: Disk failure on sdzd2, disabling device.
md/raid1:md9: Operation continuing on 1 devices.
[1467835.515806] md/raid1:md9: sdzd2: rescheduling sector 2120384
[1467835.525328] md/raid1:md8: redirecting sector 3988960 to other mirror: sdzc3
[1467835.525340] md: super_written gets error=-5
[1467835.525350] md/raid1:md8: Disk failure on sdzd3, disabling device.
md/raid1:md8: Operation continuing on 1 devices.
[1467835.539718] md/raid1:md9: redirecting sector 2120384 to other mirror: sdzc2
[1467835.741619] md/raid:md0: Disk failure on sdzd4, disabling device.
[1467835.741628] md/raid:md0: Operation continuing on 4 devices.
[1467835.742291] md/raid:md1: Disk failure on sdzd5, disabling device.
[1467835.742299] md/raid:md1: Operation continuing on 2 devices.
Each time, shutting down the NAS (reboot does not help) and turning it on again, it came up 100% fine and rebuild the RAID.
The first time I still had 16GB Crucial in, immediately went back to the original RAM. But now I am seeing that was not the problem.
My NAS is cooled perfectly well was and under no load when it happened.
I have also updated the BIOS and firmware when I found the new version a few weeks ago.
NVMes were all reseated after the first incident, and the heat sink is installed on each of them.
Please help!