[linux-lvm] Check of pool ernie/cache failed (status:1). Manual repair required!

[Dennis Schridde <devurandom@gmx.net>]

[-- Attachment #1.1: Type: text/plain, Size: 1555 bytes --]

Hello!

I have an issue re-gaining access to my data.  The error messages are:
# lvchange -ay ernie/system
  Check of pool ernie/cache failed (status:1). Manual repair required!
# lvconvert --repair ernie/system
bad checksum in superblock
  Repair of cache metadata volume of cache ernie/system failed (status:1). 
Manual repair required!

How do I recover from this situation and repair the volume group?

For a full log, including the output of pvdisplay, vgdisplay and lvdisplay -a, 
please see attached log file.  If more information is necessary, please ask.

What led to this situation:
I am using one of the infamous AMD Ryzen 2400G with an AMD B350 chipset, which 
suffers from random lockups related to CPU C-states [1].  With the recent 
AGESA 1.0.0.2a firmware update and the introduction of the "Power Supply Idle 
Control = Typical Current Idle" setting, the system is stable, if it boots at 
all.  But it often takes several attempts to boot -- the failed attempts 
ending in weird firmware / EFI or CPU / idle related Linux kernel stack 
traces, which sometimes even require a hard reset, since soft-reboot (ctrl+alt
+del) sometimes has no effect, because init dies.  This was such a situation, 
where I had to reboot (ctrl+alt+del) and reset (hard) the system several 
times, at the end of which everything seemed fine, except that dracut was 
timing out when activating the disks.  Debugging the situation using a Fedora 
28 live system resulted in the attached log file.

--Dennis

[1]: https://bugzilla.kernel.org/show_bug.cgi?id=196683

[-- Attachment #1.2: ernie-lvm.log --]
[-- Type: text/x-log, Size: 5943 bytes --]

# pvdisplay
  WARNING: Not using lvmetad because a repair command was run.
  /dev/cdrom: open failed: No medium found
  /dev/sr1: open failed: No medium found
  --- Physical volume ---
  PV Name               /dev/sdb3
  VG Name               ernie
  PV Size               <3.64 TiB / not usable 2.00 MiB
  Allocatable           yes (but full)
  PE Size               4.00 MiB
  Total PE              953742
  Free PE               0
  Allocated PE          953742
  PV UUID               R4qBtd-llco-Y2dj-ymFq-KxIB-lJv5-ySnjoa
   
  --- Physical volume ---
  PV Name               /dev/nvme0n1
  VG Name               ernie
  PV Size               <232.89 GiB / not usable <3.18 MiB
  Allocatable           yes (but full)
  PE Size               4.00 MiB
  Total PE              59618
  Free PE               0
  Allocated PE          59618
  PV UUID               CFrtOF-iDtJ-FLjh-i1c7-6DEs-8K8g-K1Son5
   
# vgdisplay
  WARNING: Not using lvmetad because a repair command was run.
  /dev/cdrom: open failed: No medium found
  /dev/sr1: open failed: No medium found
  --- Volume group ---
  VG Name               ernie
  System ID             
  Format                lvm2
  Metadata Areas        2
  Metadata Sequence No  131
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                2
  Open LV               1
  Max PV                0
  Cur PV                2
  Act PV                2
  VG Size               <3.87 TiB
  PE Size               4.00 MiB
  Total PE              1013360
  Alloc PE / Size       1013360 / <3.87 TiB
  Free  PE / Size       0 / 0   
  VG UUID               zzTyFs-nGPU-ksKG-K37V-U2Pz-OBLs-djtFCH
   
# lvdisplay --all
  WARNING: Not using lvmetad because a repair command was run.
  /dev/cdrom: open failed: No medium found
  /dev/sr1: open failed: No medium found
  --- Logical volume ---
  LV Path                /dev/ernie/system
  LV Name                system
  VG Name                ernie
  LV UUID                BflUud-7t4Q-5j7W-TEg0-AJiL-gLLT-CH3l4Q
  LV Write Access        read/write
  LV Creation host, time archiso, 2018-03-06 16:13:22 -0500
  LV Cache pool name     cache
  LV Cache origin name   system_corig
  LV Status              NOT available
  LV Size                2.00 TiB
  Current LE             524288
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
   
  --- Logical volume ---
  LV Path                /dev/ernie/data
  LV Name                data
  VG Name                ernie
  LV UUID                Ac62Oc-hkkD-tJNH-EVFl-zjd0-w5KW-VXe1vn
  LV Write Access        read/write
  LV Creation host, time ernie, 2018-03-21 21:24:00 -0400
  LV Status              available
  # open                 1
  LV Size                <1.64 TiB
  Current LE             429454
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           253:0
   
  --- Logical volume ---
  Internal LV Name       cache
  VG Name                ernie
  LV UUID                d3w5lx-MYKd-hCmg-rOzn-22f9-QoUI-XzXjLt
  LV Write Access        read/write
  LV Creation host, time ernie, 2018-04-28 08:17:13 -0400
  LV Pool metadata       cache_cmeta
  LV Pool data           cache_cdata
  LV Status              NOT available
  LV Size                <232.79 GiB
  Current LE             59594
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
   
  --- Logical volume ---
  Internal LV Name       lvol0_pmspare
  VG Name                ernie
  LV UUID                9XxlMS-GEjl-H56Q-Qvy8-n7vR-0jpp-la07Ka
  LV Write Access        read/write
  LV Creation host, time ernie, 2018-04-28 08:17:13 -0400
  LV Status              NOT available
  LV Size                48.00 MiB
  Current LE             12
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
   
  --- Logical volume ---
  Internal LV Name       cache_cmeta
  VG Name                ernie
  LV UUID                oGkCUA-Do2q-zhEV-TMt7-TN8g-p25e-C0cpfG
  LV Write Access        read/write
  LV Creation host, time ernie, 2018-04-28 08:17:13 -0400
  LV Status              NOT available
  LV Size                48.00 MiB
  Current LE             12
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
   
  --- Logical volume ---
  Internal LV Name       cache_cdata
  VG Name                ernie
  LV UUID                J6HA4c-1zbK-0yXX-gdEf-HwZi-2wDn-0GtotN
  LV Write Access        read/write
  LV Creation host, time ernie, 2018-04-28 08:17:13 -0400
  LV Status              NOT available
  LV Size                <232.79 GiB
  Current LE             59594
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
   
  --- Logical volume ---
  Internal LV Name       system_corig
  VG Name                ernie
  LV UUID                3xrU9V-kzgH-7Ncr-AQoE-u4lv-iiki-BbZIom
  LV Write Access        read/write
  LV Creation host, time ernie, 2018-04-28 08:17:44 -0400
  LV origin of Cache LV  system
  LV Status              NOT available
  LV Size                2.00 TiB
  Current LE             524288
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
   
# lvchange -ay /dev/ernie/system
  WARNING: Not using lvmetad because a repair command was run.
  /dev/cdrom: open failed: No medium found
  /dev/sr1: open failed: No medium found
  Check of pool ernie/cache failed (status:1). Manual repair required!
# lvconvert --repair /dev/ernie/system
  WARNING: Disabling lvmetad cache for repair command.
  WARNING: Not using lvmetad because of repair.
  /dev/cdrom: open failed: No medium found
  /dev/sr1: open failed: No medium found
bad checksum in superblock
  Repair of cache metadata volume of cache ernie/system failed (status:1). Manual repair required!

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 659 bytes --]