Large number of removed devices in RAID Pool

RAID, Volume, storage pool, hard drive, USB, SSD cache and iSCSI LUN
Locked
User avatar
dhfh522
Posts: 15
Joined: 23 Mar 2023, 22:53

Large number of removed devices in RAID Pool

Post by dhfh522 »

Hello,
My Primary Storage pool shows a large number of removed devices, so the status is clean, degraded. This array was only built a few weeks ago, no devices have been added or removed. Please investigate. Thanks.

[gfollan1@gfnas2 etc]# mdadm -D /dev/md8
/dev/md8:
Version : 1.2
Creation Time : Sat Mar 18 16:24:58 2023
Raid Level : raid1
Array Size : 999872 (976.44 MiB 1023.87 MB)
Used Dev Size : 999872 (976.44 MiB 1023.87 MB)
Raid Devices : 72
Total Devices : 12
Persistence : Superblock is persistent

Intent Bitmap : Internal

Update Time : Fri Apr 14 06:42:33 2023
State : clean, degraded
Active Devices : 12
Working Devices : 12
Failed Devices : 0
Spare Devices : 0

Name : TNAS:UTOSSWAP-X86-S64
UUID : cffaa552:cad8366a:5eaff6aa:921491c6
Events : 1741

Number Major Minor RaidDevice State
72 8 211 0 active sync /dev/sdn3
14 8 131 1 active sync /dev/sdi3
13 8 115 2 active sync /dev/sdh3
12 8 99 3 active sync /dev/sdg3
4 8 19 4 active sync /dev/sdb3
11 8 83 5 active sync /dev/sdf3
10 8 67 6 active sync /dev/sde3
9 8 51 7 active sync /dev/sdd3
5 8 35 8 active sync /dev/sdc3
73 8 3 9 active sync /dev/sda3
74 8 195 10 active sync /dev/sdm3
75 8 163 11 active sync /dev/sdk3
- 0 0 12 removed
- 0 0 13 removed
- 0 0 14 removed
- 0 0 15 removed
- 0 0 16 removed
- 0 0 17 removed
- 0 0 18 removed
- 0 0 19 removed
- 0 0 20 removed
- 0 0 21 removed
- 0 0 22 removed
- 0 0 23 removed
- 0 0 24 removed
- 0 0 25 removed
- 0 0 26 removed
- 0 0 27 removed
- 0 0 28 removed
- 0 0 29 removed
- 0 0 30 removed
- 0 0 31 removed
- 0 0 32 removed
- 0 0 33 removed
- 0 0 34 removed
- 0 0 35 removed
- 0 0 36 removed
- 0 0 37 removed
- 0 0 38 removed
- 0 0 39 removed
- 0 0 40 removed
- 0 0 41 removed
- 0 0 42 removed
- 0 0 43 removed
- 0 0 44 removed
- 0 0 45 removed
- 0 0 46 removed
- 0 0 47 removed
- 0 0 48 removed
- 0 0 49 removed
- 0 0 50 removed
- 0 0 51 removed
- 0 0 52 removed
- 0 0 53 removed
- 0 0 54 removed
- 0 0 55 removed
- 0 0 56 removed
- 0 0 57 removed
- 0 0 58 removed
- 0 0 59 removed
- 0 0 60 removed
- 0 0 61 removed
- 0 0 62 removed
- 0 0 63 removed
- 0 0 64 removed
- 0 0 65 removed
- 0 0 66 removed
- 0 0 67 removed
- 0 0 68 removed
- 0 0 69 removed
- 0 0 70 removed
- 0 0 71 removed
[gfollan1@gfnas2 etc]# mdadm --detail --scan
ARRAY /dev/md9 metadata=1.2 name=TNAS:UTOSCORE-X86-S64 UUID=e798fdba:01c69cab:ef8e4a0c:b5da49c6
ARRAY /dev/md1 metadata=1.2 name=gfnas2:UTOSFC-X86-S64 UUID=c78e0239:253f2dd7:c9d87c4a:35ef965b
ARRAY /dev/md8 metadata=1.2 name=TNAS:UTOSSWAP-X86-S64 UUID=cffaa552:cad8366a:5eaff6aa:921491c6
ARRAY /dev/md0 metadata=1.2 name=gfnas2:UTOSUSER-X86-S64 UUID=54bdb01c:012c6987:da281e7a:b0087d0b
ARRAY /dev/md2 metadata=1.2 name=gfnas2:UTOSUSER-X86-S64 UUID=d3496820:a7af7684:8977dbcf:00357286
[gfollan1@gfnas2 etc]# mdadm -D /dev/md1
/dev/md1:
Version : 1.2
Creation Time : Sun Mar 19 04:22:26 2023
Raid Level : raid1
Array Size : 1000072192 (953.74 GiB 1024.07 GB)
Used Dev Size : 1000072192 (953.74 GiB 1024.07 GB)
Raid Devices : 1
Total Devices : 1
Persistence : Superblock is persistent

Intent Bitmap : Internal

Update Time : Fri Apr 14 07:03:00 2023
State : clean
Active Devices : 1
Working Devices : 1
Failed Devices : 0
Spare Devices : 0

Name : gfnas2:UTOSFC-X86-S64 (local to host gfnas2)
UUID : c78e0239:253f2dd7:c9d87c4a:35ef965b
Events : 8

Number Major Minor RaidDevice State
0 259 1 0 active sync /dev/sdza1
[gfollan1@gfnas2 etc]# mdadm --detail --scan
ARRAY /dev/md9 metadata=1.2 name=TNAS:UTOSCORE-X86-S64 UUID=e798fdba:01c69cab:ef8e4a0c:b5da49c6
ARRAY /dev/md1 metadata=1.2 name=gfnas2:UTOSFC-X86-S64 UUID=c78e0239:253f2dd7:c9d87c4a:35ef965b
ARRAY /dev/md8 metadata=1.2 name=TNAS:UTOSSWAP-X86-S64 UUID=cffaa552:cad8366a:5eaff6aa:921491c6
ARRAY /dev/md0 metadata=1.2 name=gfnas2:UTOSUSER-X86-S64 UUID=54bdb01c:012c6987:da281e7a:b0087d0b
ARRAY /dev/md2 metadata=1.2 name=gfnas2:UTOSUSER-X86-S64 UUID=d3496820:a7af7684:8977dbcf:00357286
[gfollan1@gfnas2 etc]# mdadm -D /dev/md9
/dev/md9:
Version : 1.2
Creation Time : Sat Mar 18 16:25:00 2023
Raid Level : raid1
Array Size : 1998848 (1952.00 MiB 2046.82 MB)
Used Dev Size : 1998848 (1952.00 MiB 2046.82 MB)
Raid Devices : 72
Total Devices : 12
Persistence : Superblock is persistent

Intent Bitmap : Internal

Update Time : Fri Apr 14 06:55:49 2023
State : clean, degraded
Active Devices : 12
Working Devices : 12
Failed Devices : 0
Spare Devices : 0

Name : TNAS:UTOSCORE-X86-S64
UUID : e798fdba:01c69cab:ef8e4a0c:b5da49c6
Events : 11356

Number Major Minor RaidDevice State
72 8 34 0 active sync /dev/sdc2
73 8 50 1 active sync /dev/sdd2
74 8 18 2 active sync /dev/sdb2
79 8 130 3 active sync /dev/sdi2
78 8 114 4 active sync /dev/sdh2
77 8 98 5 active sync /dev/sdg2
76 8 82 6 active sync /dev/sdf2
75 8 66 7 active sync /dev/sde2
80 8 210 8 active sync /dev/sdn2
81 8 2 9 active sync /dev/sda2
82 8 194 10 active sync /dev/sdm2
83 8 162 11 active sync /dev/sdk2
- 0 0 12 removed
- 0 0 13 removed
- 0 0 14 removed
- 0 0 15 removed
- 0 0 16 removed
- 0 0 17 removed
- 0 0 18 removed
- 0 0 19 removed
- 0 0 20 removed
- 0 0 21 removed
- 0 0 22 removed
- 0 0 23 removed
- 0 0 24 removed
- 0 0 25 removed
- 0 0 26 removed
- 0 0 27 removed
- 0 0 28 removed
- 0 0 29 removed
- 0 0 30 removed
- 0 0 31 removed
- 0 0 32 removed
- 0 0 33 removed
- 0 0 34 removed
- 0 0 35 removed
- 0 0 36 removed
- 0 0 37 removed
- 0 0 38 removed
- 0 0 39 removed
- 0 0 40 removed
- 0 0 41 removed
- 0 0 42 removed
- 0 0 43 removed
- 0 0 44 removed
- 0 0 45 removed
- 0 0 46 removed
- 0 0 47 removed
- 0 0 48 removed
- 0 0 49 removed
- 0 0 50 removed
- 0 0 51 removed
- 0 0 52 removed
- 0 0 53 removed
- 0 0 54 removed
- 0 0 55 removed
- 0 0 56 removed
- 0 0 57 removed
- 0 0 58 removed
- 0 0 59 removed
- 0 0 60 removed
- 0 0 61 removed
- 0 0 62 removed
- 0 0 63 removed
- 0 0 64 removed
- 0 0 65 removed
- 0 0 66 removed
- 0 0 67 removed
- 0 0 68 removed
- 0 0 69 removed
- 0 0 70 removed
- 0 0 71 removed
Setup:
TOS 5.1.37
T9-423(16GB)
1 x Intel 1Tb 670P Hyper-Cache
9 x 3TB HGST Ultrastar 7K4000
8 - members in TRaid array, 1 - Hot Spare
1 Storage pool with 2 Volumes
Backup
D5-300C
4x14TB ST14000NM0018 in TRaid array
1 Storage pool with 1 volume
Locked

Return to “Storage”