Issues bringing up RAID5 array

[sklv]

I have a machine with a crypto volume on sd0, and a RAID5 array on sd1, sd2, and sd3.

I was transferring data to the machine when it panicked. The data is backed up, and not important, but I'd like to learn how to recover.

I have ran SMART short test on all 3 drives and the test reports no issues. As the array contains a crypto volume, I can't verify the validity of the data on the drives.

My issue is that the array does not appear in bioctl -i softraid0.

There is a suspicious message in dmesg but I don't know how to use the information to help mount the array.

# dmesg | grep softraid
softraid0 at root
scsibus4 at softraid0: 256 targets
softraid0: trying to bring up sd4 degraded
softraid0: sd4 was not shutdown properly
softraid0: sd4 is offline, will not be brought online
softraid0: volume sd4 is roaming, it used to be sd2, updating metadata

# bioctl -c 5 -l sd1a,sd2a,sd3a softraid0
softraid0: trying to bring up sd4 degraded
softraid0: sd4 was not shutdown properly
softraid0: sd4 is offline, will not be brought online

According to bioctl, sd4 is the name of sd0's crypto volume.

# bioctl -i softraid0
Volume      Status               Size Device
softraid0 0 Online       254432315904 sd4     CRYPTO
          0 Online       254432315904 0:0.0   noencl <sd0a>

I have tried to google the bioctl error but the info i am able to find is involved and confusing. Any advice on how I could recover my raid5 array?

[jggimi]

Originally Posted by sklv

As the array contains a crypto volume, I can't verify the validity of the on the drives.

I interpret this to indicate you have two layers of softraid in use on these three drives. While you may be able to get it to work, the OpenBSD FAQ states:

Note that "stacking" softraid modes (mirrored drives and encryption, for example) is not supported at this time.

I don't know if this type of error is recoverable. You could ask on the misc@ mailing list.

If it is not recoverable, you must zero out the metadata, recreate the array, and restore from backup.

[sklv]

Thanks for the reply!

I can see that you're right.

I was aware of the limitation of stacking softraid disciples, but I thought that you couldn't *boot* of crypto on raid5, not that it was outright not supported.

It feels counterintuitive to me that the contents of the array can prevent the array from being *assembled*, but the limitation is clearly stated in the FAQ.

I will ask on the mailing list as you suggest.