* Fwd: csum failed during copy/compare [not found] <CAG6KGPS8Gvy2zGCe22mMmk4uXrqVyRP8FHayhe0ph-8vC+kA4A@mail.gmail.com> @ 2016-10-10 9:44 ` Martin Dev 2016-10-10 12:02 ` Martin Dev 2016-10-10 18:42 ` Roman Mamedov 0 siblings, 2 replies; 8+ messages in thread From: Martin Dev @ 2016-10-10 9:44 UTC (permalink / raw) To: linux-btrfs [-- Attachment #1: Type: text/plain, Size: 4086 bytes --] Hey everyone, I work for system verification of SSDs and we've recently come up against an issue with BTRFS on Ubuntu 16.04. We have a framework which follows the following steps: Generate verifiable 10GB file with FIO on internal drive Copy 10GB file to 2 target partitions on DUT (using "cp" command) Sync Verify copied files with FIO (using direct=1) Perform a power event (restart, shutdown, suspend, or hibernate) Verify both 10GB files Repeat. We keep the files from the first iteration on the target partitions, but subsequent iterations are deleted after verification. Every command is monitored for exit status and framework will fail with error if anything exits non zero. We've found that during this process (between 2-9 iterations of restarts or shutdowns) BTRFS will fail the pre-power verification of the file with 100% reproduction rate out of 7 attempts. So this is a "cp" command to copy from the internal to the btrfs partition, a sync, then a verify with fio. This seems to be a recent change as the same process has been used for the last 2 years including over the last month with no issues. Here are some more details: Linux ht_stress_b6_20 4.4.0-21-generic #37-Ubuntu SMP Mon Apr 18 18:33:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux btrfs-progs v4.4 Label: none uuid: 554b0043-052f-48d1-986f-5a6154496d89 Total devices 1 FS bytes used 20.03GiB devid 1 size 29.81GiB used 22.26GiB path /dev/sdb2 Data, single: total=22.00GiB, used=20.00GiB System, single: total=4.00MiB, used=16.00KiB Metadata, single: total=264.00MiB, used=20.64MiB GlobalReserve, single: total=16.00MiB, used=0.00B df -hT /dev/sdb1 ext4 30G 21G 7.7G 73% /mnt/f /dev/sdb2 btrfs 30G 21G 9.6G 68% /mnt/g /dev/sdb3 xfs 30G 33M 30G 1% /mnt/h /dev/sdb4 ext4 30G 44M 28G 1% /mnt/i /etc/fstab /dev/sdb2 /mnt/g/ btrfs defaults,discard 0 0 root@xxxx: ls -l /mnt/g/ total 20971520 -rw-r--r-- 1 root root 10737418240 Oct 10 09:42 shutdown-1.bin -rw-r--r-- 1 root root 10737418240 Oct 10 10:03 shutdown-4.bin root@xxxx# cat fio-screenlog.log test: (g=0): rw=read, bs=128K-128K/128K-128K/128K-128K, ioengine=libaio, iodepth=32 fio-2.13-88-g32bc8-dirty Starting 1 process verify: bad magic header 101, wanted acca at file /mnt/g/shutdown-4.bin offset 10547757056, length 131072 verify: bad magic header 101, wanted acca at file /mnt/g/shutdown-4.bin offset 10547888128, length 131072 fio: pid=2288, err=84/file:io_u.c:1978, func=io_u_queued_complete, error=Invalid or incomplete multibyte or wide character In this situation, FIO is reading "101" instead of the correct data from the shutdown-4.bin file. from the "ls -l" above, we can see the shutdown-1.bin and shutdown-4.bin are the same size and we know the cp command exited 0. shutdown-1.bin (OK): dd if=/mnt/g/shutdown-1.bin of=/tmp/header bs=512 count=1 skip=20601088 1+0 records in 1+0 records out 512 bytes copied, 0.00247518 s, 207 kB/s Data: 0000000 acca 0001 0000 0002 3d92 e664 178e 8421 0000010 0000 74b2 0002 0000 0016 0000 2bfa 0009 0000020 0001 3a59 c82b 1b3a a7b8 ee74 881a 0747 0000030 94f7 09f2 79c9 04e3 d29e d6c2 ea3f 04b8 ... shutdown-4.bin (FAILS): dd if=/mnt/g/shutdown-4.bin of=/tmp/header bs=512 count=1 skip=20601088 dd: error reading '/mnt/g/shutdown-4.bin': Input/output error 0+0 records in 0+0 records out 0 bytes copied, 0.00230287 s, 0.0 kB/s We can't even read the file at that offset correctly and have to go back to 20601087 (1 512 byte sector) before I can get valid data. What's interesting, is over 2 different drives, 2 different machines, and 7 reproductions, the data is always "101", this might be a quirk of FIO, as I would hope that btrfs would not return corrupt data to the user. Reproduction is straight forward, and takes around an hour. I have a large amount of duplicate machines at my disposal if debug / investigations need to be run. I can provide portions of our automation logs, full dmesg (attached), and any other information that needs to be gathered. [-- Attachment #2: dmesg.log --] [-- Type: text/x-log, Size: 63561 bytes --] [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 4.4.0-21-generic (buildd@lgw01-21) (gcc version 5.3.1 20160413 (Ubuntu 5.3.1-14ubuntu2) ) #37-Ubuntu SMP Mon Apr 18 18:33:37 UTC 2016 (Ubuntu 4.4.0-21.37-generic 4.4.6) [ 0.000000] Command line: BOOT_IMAGE=/vmlinuz-4.4.0-21-generic root=UUID=eca58483-5695-4068-828b-6b0a48eeb620 ro quiet splash vt.handoff=7 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Centaur CentaurHauls [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: xstate_offset[3]: 960, xstate_sizes[3]: 64 [ 0.000000] x86/fpu: xstate_offset[4]: 1024, xstate_sizes[4]: 64 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x01: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x02: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x04: 'AVX registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x08: 'MPX bounds registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x10: 'MPX CSR' [ 0.000000] x86/fpu: Enabled xstate features 0x1f, context size is 1088 bytes, using 'standard' format. [ 0.000000] x86/fpu: Using 'eager' FPU context switches. [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009c7ff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009c800-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000086855fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000086856000-0x0000000086856fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000086857000-0x0000000086880fff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000086881000-0x00000000868d4fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000868d5000-0x0000000086d41fff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000086d42000-0x0000000086d57fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000086d58000-0x00000000879d5fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000879d6000-0x0000000087f99fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000087f9a000-0x0000000087fcdfff] ACPI data [ 0.000000] BIOS-e820: [mem 0x0000000087fce000-0x0000000087ffffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fe000000-0x00000000fe010fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000471ffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: Gigabyte Technology Co., Ltd. To be filled by O.E.M./Z170M-D3H-CF, BIOS F2 07/23/2015 [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x472000 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 00C0000000 mask 7FC0000000 uncachable [ 0.000000] 1 base 00A0000000 mask 7FE0000000 uncachable [ 0.000000] 2 base 0090000000 mask 7FF0000000 uncachable [ 0.000000] 3 base 008C000000 mask 7FFC000000 uncachable [ 0.000000] 4 base 008A000000 mask 7FFE000000 uncachable [ 0.000000] 5 base 0089000000 mask 7FFF000000 uncachable [ 0.000000] 6 base 0088800000 mask 7FFF800000 uncachable [ 0.000000] 7 disabled [ 0.000000] 8 disabled [ 0.000000] 9 disabled [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT [ 0.000000] e820: last_pfn = 0x88000 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fcba0-0x000fcbaf] mapped at [ffff8800000fcba0] [ 0.000000] Scanning 1 areas for low memory corruption [ 0.000000] Base memory trampoline at [ffff880000096000] 96000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x021fe000, 0x021fefff] PGTABLE [ 0.000000] BRK [0x021ff000, 0x021fffff] PGTABLE [ 0.000000] BRK [0x02200000, 0x02200fff] PGTABLE [ 0.000000] BRK [0x02201000, 0x02201fff] PGTABLE [ 0.000000] BRK [0x02202000, 0x02202fff] PGTABLE [ 0.000000] BRK [0x02203000, 0x02203fff] PGTABLE [ 0.000000] RAMDISK: [mem 0x33fb6000-0x35fd2fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F05B0 000024 (v02 ALASKA) [ 0.000000] ACPI: XSDT 0x0000000087BFE098 0000B4 (v01 ALASKA A M I 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x0000000087C202B0 00010C (v05 ALASKA A M I 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x0000000087BFE1E8 0220C5 (v02 ALASKA A M I 01072009 INTL 20120913) [ 0.000000] ACPI: FACS 0x0000000087F99F80 000040 [ 0.000000] ACPI: APIC 0x0000000087C203C0 000084 (v03 ALASKA A M I 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x0000000087C20448 000044 (v01 ALASKA A M I 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x0000000087C20490 00009C (v01 ALASKA A M I 01072009 AMI 00010013) [ 0.000000] ACPI: MCFG 0x0000000087C20530 00003C (v01 ALASKA A M I 01072009 MSFT 00000097) [ 0.000000] ACPI: HPET 0x0000000087C20570 000038 (v01 ALASKA A M I 01072009 AMI. 0005000B) [ 0.000000] ACPI: SSDT 0x0000000087C205A8 00036D (v01 SataRe SataTabl 00001000 INTL 20120913) [ 0.000000] ACPI: SSDT 0x0000000087C20918 005384 (v02 SaSsdt SaSsdt 00003000 INTL 20120913) [ 0.000000] ACPI: UEFI 0x0000000087C25CA0 000042 (v01 00000000 00000000) [ 0.000000] ACPI: LPIT 0x0000000087C25CE8 000094 (v01 INTEL SKL 00000000 MSFT 0000005F) [ 0.000000] ACPI: SSDT 0x0000000087C25D80 000248 (v02 INTEL sensrhub 00000000 INTL 20120913) [ 0.000000] ACPI: SSDT 0x0000000087C25FC8 002BAE (v02 INTEL PtidDevc 00001000 INTL 20120913) [ 0.000000] ACPI: SSDT 0x0000000087C28B78 000C45 (v02 INTEL Ther_Rvp 00001000 INTL 20120913) [ 0.000000] ACPI: DBGP 0x0000000087C297C0 000034 (v01 INTEL 00000000 MSFT 0000005F) [ 0.000000] ACPI: DBG2 0x0000000087C297F8 000054 (v00 INTEL 00000000 MSFT 0000005F) [ 0.000000] ACPI: SSDT 0x0000000087C29850 000619 (v02 INTEL xh_rvp10 00000000 INTL 20120913) [ 0.000000] ACPI: SSDT 0x0000000087C29E70 000E58 (v02 CpuRef CpuSsdt 00003000 INTL 20120913) [ 0.000000] ACPI: ASF! 0x0000000087C2ACC8 0000A5 (v32 INTEL HCG 00000001 TFSM 000F4240) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000471ffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x471ff9000-0x471ffdfff] [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000471ffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009bfff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000086855fff] [ 0.000000] node 0: [mem 0x0000000086881000-0x00000000868d4fff] [ 0.000000] node 0: [mem 0x0000000086d42000-0x0000000086d57fff] [ 0.000000] node 0: [mem 0x0000000087fce000-0x0000000087ffffff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000471ffffff] [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000471ffffff] [ 0.000000] On node 0 totalpages: 4163725 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3995 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 8548 pages used for memmap [ 0.000000] DMA32 zone: 547058 pages, LIFO batch:31 [ 0.000000] Normal zone: 56448 pages used for memmap [ 0.000000] Normal zone: 3612672 pages, LIFO batch:31 [ 0.000000] Reserving Intel graphics stolen memory at 0x89000000-0x8cffffff [ 0.000000] ACPI: PM-Timer IO Port: 0x1808 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-119 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009c000-0x0009cfff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009d000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x86856000-0x86856fff] [ 0.000000] PM: Registered nosave memory: [mem 0x86857000-0x86880fff] [ 0.000000] PM: Registered nosave memory: [mem 0x868d5000-0x86d41fff] [ 0.000000] PM: Registered nosave memory: [mem 0x86d58000-0x879d5fff] [ 0.000000] PM: Registered nosave memory: [mem 0x879d6000-0x87f99fff] [ 0.000000] PM: Registered nosave memory: [mem 0x87f9a000-0x87fcdfff] [ 0.000000] PM: Registered nosave memory: [mem 0x88000000-0x88ffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x89000000-0x8cffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x8d000000-0xdfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xefffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfdffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfe000000-0xfe010fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfe011000-0xfebfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfedfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] e820: [mem 0x8d000000-0xdfffffff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 33 pages/cpu @ffff880471c00000 s98008 r8192 d28968 u524288 [ 0.000000] pcpu-alloc: s98008 r8192 d28968 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 4098644 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-4.4.0-21-generic root=UUID=eca58483-5695-4068-828b-6b0a48eeb620 ro quiet splash vt.handoff=7 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] Calgary: detecting Calgary via BIOS EBDA area [ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing! [ 0.000000] Memory: 16274480K/16654900K available (8356K kernel code, 1278K rwdata, 3920K rodata, 1476K init, 1292K bss, 380420K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] Build-time adjustment of leaf fanout to 64. [ 0.000000] RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4. [ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=4 [ 0.000000] NR_IRQS:16640 nr_irqs:1024 16 [ 0.000000] spurious 8259A interrupt: IRQ7. [ 0.000000] vt handoff: transparent VT on vt#7 [ 0.000000] Console: colour dummy device 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635855245 ns [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Unable to calibrate against PIT [ 0.000000] tsc: using HPET reference calibration [ 0.000000] tsc: Detected 3504.087 MHz processor [ 0.000019] Calibrating delay loop (skipped), value calculated using timer frequency.. 7008.17 BogoMIPS (lpj=14016348) [ 0.000021] pid_max: default: 32768 minimum: 301 [ 0.000024] ACPI: Core revision 20150930 [ 0.020852] ACPI Error: [\_SB_.PCI0.XHC_.RHUB.HS11] Namespace lookup failure, AE_NOT_FOUND (20150930/dswload-210) [ 0.020855] ACPI Exception: AE_NOT_FOUND, During name lookup/catalog (20150930/psobject-227) [ 0.020881] ACPI Exception: AE_NOT_FOUND, (SSDT:xh_rvp10) while loading table (20150930/tbxfload-193) [ 0.021688] ACPI Error: 1 table load failures, 7 successful (20150930/tbxfload-214) [ 0.021700] Security Framework initialized [ 0.021701] Yama: becoming mindful. [ 0.021709] AppArmor: AppArmor initialized [ 0.022446] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes) [ 0.024325] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes) [ 0.025087] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes) [ 0.025096] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes) [ 0.025240] Initializing cgroup subsys io [ 0.025242] Initializing cgroup subsys memory [ 0.025245] Initializing cgroup subsys devices [ 0.025246] Initializing cgroup subsys freezer [ 0.025247] Initializing cgroup subsys net_cls [ 0.025249] Initializing cgroup subsys perf_event [ 0.025250] Initializing cgroup subsys net_prio [ 0.025251] Initializing cgroup subsys hugetlb [ 0.025252] Initializing cgroup subsys pids [ 0.025268] CPU: Physical Processor ID: 0 [ 0.025269] CPU: Processor Core ID: 0 [ 0.026247] mce: CPU supports 10 MCE banks [ 0.026259] CPU0: Thermal monitoring enabled (TM1) [ 0.026266] process: using mwait in idle threads [ 0.026268] Last level iTLB entries: 4KB 128, 2MB 8, 4MB 8 [ 0.026268] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.026496] Freeing SMP alternatives memory: 28K (ffffffff820b2000 - ffffffff820b9000) [ 0.027843] ftrace: allocating 31878 entries in 125 pages [ 0.036162] smpboot: Max logical packages: 1 [ 0.036164] smpboot: APIC(0) Converting physical 0 to logical package 0 [ 0.037365] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.040550] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0 [ 0.080238] TSC deadline timer enabled [ 0.080243] smpboot: CPU0: Intel(R) Core(TM) i5-6600K CPU @ 3.50GHz (family: 0x6, model: 0x5e, stepping: 0x3) [ 0.080250] Performance Events: PEBS fmt3+, 32-deep LBR, Skylake events, full-width counters, Intel PMU driver. [ 0.080268] ... version: 4 [ 0.080268] ... bit width: 48 [ 0.080268] ... generic registers: 8 [ 0.080269] ... value mask: 0000ffffffffffff [ 0.080270] ... max period: 0000ffffffffffff [ 0.080270] ... fixed-purpose events: 3 [ 0.080270] ... event mask: 00000007000000ff [ 0.080735] x86: Booting SMP configuration: [ 0.080736] .... node #0, CPUs: #1 [ 0.084055] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. [ 0.084095] #2 #3 [ 0.090905] x86: Booted up 1 node, 4 CPUs [ 0.090907] smpboot: Total of 4 processors activated (28032.69 BogoMIPS) [ 0.093278] devtmpfs: initialized [ 0.094962] evm: security.selinux [ 0.094963] evm: security.SMACK64 [ 0.094964] evm: security.SMACK64EXEC [ 0.094964] evm: security.SMACK64TRANSMUTE [ 0.094965] evm: security.SMACK64MMAP [ 0.094965] evm: security.ima [ 0.094966] evm: security.capability [ 0.095000] PM: Registering ACPI NVS region [mem 0x86856000-0x86856fff] (4096 bytes) [ 0.095001] PM: Registering ACPI NVS region [mem 0x879d6000-0x87f99fff] (6045696 bytes) [ 0.095087] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 0.095134] pinctrl core: initialized pinctrl subsystem [ 0.095275] RTC time: 9:01:46, date: 10/10/16 [ 0.095351] NET: Registered protocol family 16 [ 0.105172] cpuidle: using governor ladder [ 0.117165] cpuidle: using governor menu [ 0.117174] PCCT header not found. [ 0.117280] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.117281] ACPI: bus type PCI registered [ 0.117282] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.117333] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000) [ 0.117334] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820 [ 0.117343] PCI: Using configuration type 1 for base access [ 0.133438] ACPI: Added _OSI(Module Device) [ 0.133439] ACPI: Added _OSI(Processor Device) [ 0.133440] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.133440] ACPI: Added _OSI(Processor Aggregator Device) [ 0.138391] ACPI: Executed 21 blocks of module-level executable AML code [ 0.142225] [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored [ 0.144242] ACPI: Dynamic OEM Table Load: [ 0.144246] ACPI: SSDT 0xFFFF88045F022800 000705 (v02 PmRef Cpu0Ist 00003000 INTL 20120913) [ 0.144818] ACPI: \_PR_.CPU0: _OSC native thermal LVT Acked [ 0.145852] ACPI: Dynamic OEM Table Load: [ 0.145855] ACPI: SSDT 0xFFFF88045F211000 00037F (v02 PmRef Cpu0Cst 00003001 INTL 20120913) [ 0.146811] ACPI: Dynamic OEM Table Load: [ 0.146814] ACPI: SSDT 0xFFFF88045F023000 0005AA (v02 PmRef ApIst 00003000 INTL 20120913) [ 0.147513] ACPI: Dynamic OEM Table Load: [ 0.147515] ACPI: SSDT 0xFFFF88045F296400 000119 (v02 PmRef ApCst 00003000 INTL 20120913) [ 0.149413] ACPI: Interpreter enabled [ 0.149420] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20150930/hwxface-580) [ 0.149426] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20150930/hwxface-580) [ 0.149439] ACPI: (supports S0 S3 S4 S5) [ 0.149440] ACPI: Using IOAPIC for interrupt routing [ 0.149461] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.150747] ACPI: Power Resource [PG00] (on) [ 0.150993] ACPI: Power Resource [PG01] (on) [ 0.151215] ACPI: Power Resource [PG02] (on) [ 0.152890] ACPI: Power Resource [WRST] (off) [ 0.153086] ACPI: Power Resource [WRST] (off) [ 0.153282] ACPI: Power Resource [WRST] (off) [ 0.153477] ACPI: Power Resource [WRST] (off) [ 0.153675] ACPI: Power Resource [WRST] (off) [ 0.153875] ACPI: Power Resource [WRST] (off) [ 0.154071] ACPI: Power Resource [WRST] (off) [ 0.154266] ACPI: Power Resource [WRST] (off) [ 0.154459] ACPI: Power Resource [WRST] (off) [ 0.154655] ACPI: Power Resource [WRST] (off) [ 0.154848] ACPI: Power Resource [WRST] (off) [ 0.155043] ACPI: Power Resource [WRST] (off) [ 0.155236] ACPI: Power Resource [WRST] (off) [ 0.155432] ACPI: Power Resource [WRST] (off) [ 0.155625] ACPI: Power Resource [WRST] (off) [ 0.155826] ACPI: Power Resource [WRST] (off) [ 0.156022] ACPI: Power Resource [WRST] (off) [ 0.156224] ACPI: Power Resource [WRST] (off) [ 0.156418] ACPI: Power Resource [WRST] (off) [ 0.156612] ACPI: Power Resource [WRST] (off) [ 0.161020] ACPI: Power Resource [FN00] (off) [ 0.161064] ACPI: Power Resource [FN01] (off) [ 0.161106] ACPI: Power Resource [FN02] (off) [ 0.161150] ACPI: Power Resource [FN03] (off) [ 0.161194] ACPI: Power Resource [FN04] (off) [ 0.161912] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.161916] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 0.162938] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability] [ 0.162939] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.163349] PCI host bridge to bus 0000:00 [ 0.163351] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.163352] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.163353] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.163354] pci_bus 0000:00: root bus resource [mem 0x8d000000-0xdfffffff window] [ 0.163355] pci_bus 0000:00: root bus resource [mem 0xfd000000-0xfe7fffff window] [ 0.163356] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.163361] pci 0000:00:00.0: [8086:191f] type 00 class 0x060000 [ 0.163555] pci 0000:00:02.0: [8086:1912] type 00 class 0x030000 [ 0.163565] pci 0000:00:02.0: reg 0x10: [mem 0xde000000-0xdeffffff 64bit] [ 0.163569] pci 0000:00:02.0: reg 0x18: [mem 0xc0000000-0xcfffffff 64bit pref] [ 0.163572] pci 0000:00:02.0: reg 0x20: [io 0xf000-0xf03f] [ 0.163704] pci 0000:00:14.0: [8086:a12f] type 00 class 0x0c0330 [ 0.163726] pci 0000:00:14.0: reg 0x10: [mem 0xdf030000-0xdf03ffff 64bit] [ 0.163772] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 0.163836] pci 0000:00:14.0: System wakeup disabled by ACPI [ 0.163862] pci 0000:00:14.2: [8086:a131] type 00 class 0x118000 [ 0.163884] pci 0000:00:14.2: reg 0x10: [mem 0xdf04e000-0xdf04efff 64bit] [ 0.163998] pci 0000:00:16.0: [8086:a13a] type 00 class 0x078000 [ 0.164024] pci 0000:00:16.0: reg 0x10: [mem 0xdf04d000-0xdf04dfff 64bit] [ 0.164072] pci 0000:00:16.0: PME# supported from D3hot [ 0.164170] pci 0000:00:17.0: [8086:a102] type 00 class 0x010601 [ 0.164188] pci 0000:00:17.0: reg 0x10: [mem 0xdf048000-0xdf049fff] [ 0.164194] pci 0000:00:17.0: reg 0x14: [mem 0xdf04c000-0xdf04c0ff] [ 0.164200] pci 0000:00:17.0: reg 0x18: [io 0xf090-0xf097] [ 0.164206] pci 0000:00:17.0: reg 0x1c: [io 0xf080-0xf083] [ 0.164211] pci 0000:00:17.0: reg 0x20: [io 0xf060-0xf07f] [ 0.164217] pci 0000:00:17.0: reg 0x24: [mem 0xdf04b000-0xdf04b7ff] [ 0.164241] pci 0000:00:17.0: PME# supported from D3hot [ 0.164326] pci 0000:00:1b.0: [8086:a167] type 01 class 0x060400 [ 0.164368] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold [ 0.164437] pci 0000:00:1b.0: System wakeup disabled by ACPI [ 0.164461] pci 0000:00:1b.2: [8086:a169] type 01 class 0x060400 [ 0.164503] pci 0000:00:1b.2: PME# supported from D0 D3hot D3cold [ 0.164575] pci 0000:00:1b.2: System wakeup disabled by ACPI [ 0.164615] pci 0000:00:1c.0: [8086:a110] type 01 class 0x060400 [ 0.164663] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 0.164732] pci 0000:00:1c.0: System wakeup disabled by ACPI [ 0.164764] pci 0000:00:1c.4: [8086:a114] type 01 class 0x060400 [ 0.164812] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 0.164880] pci 0000:00:1c.4: System wakeup disabled by ACPI [ 0.164911] pci 0000:00:1d.0: [8086:a118] type 01 class 0x060400 [ 0.164959] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 0.165027] pci 0000:00:1d.0: System wakeup disabled by ACPI [ 0.165061] pci 0000:00:1d.4: [8086:a11c] type 01 class 0x060400 [ 0.165110] pci 0000:00:1d.4: PME# supported from D0 D3hot D3cold [ 0.165182] pci 0000:00:1d.4: System wakeup disabled by ACPI [ 0.165215] pci 0000:00:1f.0: [8086:a145] type 00 class 0x060100 [ 0.165379] pci 0000:00:1f.2: [8086:a121] type 00 class 0x058000 [ 0.165390] pci 0000:00:1f.2: reg 0x10: [mem 0xdf044000-0xdf047fff] [ 0.165508] pci 0000:00:1f.3: [8086:a170] type 00 class 0x040300 [ 0.165539] pci 0000:00:1f.3: reg 0x10: [mem 0xdf040000-0xdf043fff 64bit] [ 0.165567] pci 0000:00:1f.3: reg 0x20: [mem 0xdf020000-0xdf02ffff 64bit] [ 0.165597] pci 0000:00:1f.3: PME# supported from D3hot D3cold [ 0.165692] pci 0000:00:1f.3: System wakeup disabled by ACPI [ 0.165721] pci 0000:00:1f.4: [8086:a123] type 00 class 0x0c0500 [ 0.165774] pci 0000:00:1f.4: reg 0x10: [mem 0xdf04a000-0xdf04a0ff 64bit] [ 0.165843] pci 0000:00:1f.4: reg 0x20: [io 0xf040-0xf05f] [ 0.165988] pci 0000:00:1f.6: [8086:15b8] type 00 class 0x020000 [ 0.166021] pci 0000:00:1f.6: reg 0x10: [mem 0xdf000000-0xdf01ffff] [ 0.166105] pci 0000:00:1f.6: PME# supported from D0 D3hot D3cold [ 0.166169] pci 0000:00:1f.6: System wakeup disabled by ACPI [ 0.166239] acpiphp: Slot [1] registered [ 0.166242] pci 0000:00:1b.0: PCI bridge to [bus 01] [ 0.166308] pci 0000:02:00.0: [1b21:1080] type 01 class 0x060400 [ 0.166417] pci 0000:02:00.0: supports D1 D2 [ 0.166418] pci 0000:02:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.166464] pci 0000:02:00.0: System wakeup disabled by ACPI [ 0.177213] pci 0000:00:1b.2: PCI bridge to [bus 02-03] [ 0.177347] pci 0000:02:00.0: PCI bridge to [bus 03] [ 0.177423] acpiphp: Slot [1-1] registered [ 0.177432] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 0.177487] pci 0000:00:1c.4: PCI bridge to [bus 05] [ 0.177541] pci 0000:00:1d.0: PCI bridge to [bus 06] [ 0.177598] acpiphp: Slot [1-2] registered [ 0.177601] pci 0000:00:1d.4: PCI bridge to [bus 07] [ 0.178893] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 *10 11 12 14 15) [ 0.178928] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 10 *11 12 14 15) [ 0.178961] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 10 11 12 *14 15) [ 0.178993] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 11 12 14 *15) [ 0.179025] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 10 *11 12 14 15) [ 0.179056] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15) [ 0.179088] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 10 *11 12 14 15) [ 0.179119] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 10 *11 12 14 15) [ 0.179365] ACPI: Enabled 5 GPEs in block 00 to 7F [ 0.179431] vgaarb: setting as boot device: PCI:0000:00:02.0 [ 0.179433] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none [ 0.179434] vgaarb: loaded [ 0.179435] vgaarb: bridge control possible 0000:00:02.0 [ 0.179571] SCSI subsystem initialized [ 0.179589] libata version 3.00 loaded. [ 0.179602] ACPI: bus type USB registered [ 0.179611] usbcore: registered new interface driver usbfs [ 0.179615] usbcore: registered new interface driver hub [ 0.179622] usbcore: registered new device driver usb [ 0.179696] PCI: Using ACPI for IRQ routing [ 0.207144] PCI: pci_cache_line_size set to 64 bytes [ 0.207189] e820: reserve RAM buffer [mem 0x0009c800-0x0009ffff] [ 0.207190] e820: reserve RAM buffer [mem 0x86856000-0x87ffffff] [ 0.207191] e820: reserve RAM buffer [mem 0x868d5000-0x87ffffff] [ 0.207191] e820: reserve RAM buffer [mem 0x86d58000-0x87ffffff] [ 0.207192] e820: reserve RAM buffer [mem 0x472000000-0x473ffffff] [ 0.207258] NetLabel: Initializing [ 0.207258] NetLabel: domain hash size = 128 [ 0.207259] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.207265] NetLabel: unlabeled traffic allowed by default [ 0.207337] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 0.207340] hpet0: 8 comparators, 64-bit 24.000000 MHz counter [ 0.209382] clocksource: Switched to clocksource hpet [ 0.212843] AppArmor: AppArmor Filesystem Enabled [ 0.212871] pnp: PnP ACPI init [ 0.213017] system 00:00: [io 0x0a00-0x0a2f] has been reserved [ 0.213019] system 00:00: [io 0x0a30-0x0a3f] has been reserved [ 0.213020] system 00:00: [io 0x0a40-0x0a4f] has been reserved [ 0.213022] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.213438] pnp 00:01: [dma 0 disabled] [ 0.213533] pnp 00:01: Plug and Play ACPI device, IDs PNP0400 (active) [ 0.213558] pnp 00:02: Plug and Play ACPI device, IDs PNP0303 PNP030b (active) [ 0.213587] pnp 00:03: Plug and Play ACPI device, IDs PNP0f03 PNP0f13 (active) [ 0.213822] pnp 00:04: [dma 0 disabled] [ 0.213845] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.213918] system 00:05: [io 0x0680-0x069f] has been reserved [ 0.213919] system 00:05: [io 0xffff] has been reserved [ 0.213920] system 00:05: [io 0xffff] has been reserved [ 0.213921] system 00:05: [io 0xffff] has been reserved [ 0.213922] system 00:05: [io 0x1800-0x18fe] could not be reserved [ 0.213923] system 00:05: [io 0x164e-0x164f] has been reserved [ 0.213924] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.213973] system 00:06: [io 0x0800-0x087f] has been reserved [ 0.213974] system 00:06: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.213987] pnp 00:07: Plug and Play ACPI device, IDs PNP0b00 (active) [ 0.214006] system 00:08: [io 0x1854-0x1857] has been reserved [ 0.214008] system 00:08: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active) [ 0.214129] system 00:09: [mem 0xfed10000-0xfed17fff] has been reserved [ 0.214130] system 00:09: [mem 0xfed18000-0xfed18fff] has been reserved [ 0.214131] system 00:09: [mem 0xfed19000-0xfed19fff] has been reserved [ 0.214132] system 00:09: [mem 0xe0000000-0xefffffff] has been reserved [ 0.214133] system 00:09: [mem 0xfed20000-0xfed3ffff] has been reserved [ 0.214134] system 00:09: [mem 0xfed90000-0xfed93fff] has been reserved [ 0.214135] system 00:09: [mem 0xfed45000-0xfed8ffff] has been reserved [ 0.214136] system 00:09: [mem 0xff000000-0xffffffff] has been reserved [ 0.214137] system 00:09: [mem 0xfee00000-0xfeefffff] could not be reserved [ 0.214138] system 00:09: [mem 0xdffe0000-0xdfffffff] has been reserved [ 0.214139] system 00:09: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.214162] system 00:0a: [mem 0xfd000000-0xfdabffff] has been reserved [ 0.214163] system 00:0a: [mem 0xfdad0000-0xfdadffff] has been reserved [ 0.214164] system 00:0a: [mem 0xfdb00000-0xfdffffff] has been reserved [ 0.214165] system 00:0a: [mem 0xfe000000-0xfe01ffff] could not be reserved [ 0.214166] system 00:0a: [mem 0xfe036000-0xfe03bfff] has been reserved [ 0.214167] system 00:0a: [mem 0xfe03d000-0xfe3fffff] has been reserved [ 0.214168] system 00:0a: [mem 0xfe410000-0xfe7fffff] has been reserved [ 0.214169] system 00:0a: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.214771] system 00:0b: [mem 0xfdaf0000-0xfdafffff] has been reserved [ 0.214773] system 00:0b: [mem 0xfdae0000-0xfdaeffff] has been reserved [ 0.214774] system 00:0b: [mem 0xfdac0000-0xfdacffff] has been reserved [ 0.214775] system 00:0b: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.215254] pnp: PnP ACPI: found 12 devices [ 0.223117] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.223148] pci 0000:00:1c.4: bridge window [io 0x1000-0x0fff] to [bus 05] add_size 1000 [ 0.223149] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 05] add_size 200000 add_align 100000 [ 0.223150] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff] to [bus 05] add_size 200000 add_align 100000 [ 0.223155] pci 0000:00:1d.0: bridge window [io 0x1000-0x0fff] to [bus 06] add_size 1000 [ 0.223156] pci 0000:00:1d.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 06] add_size 200000 add_align 100000 [ 0.223157] pci 0000:00:1d.0: bridge window [mem 0x00100000-0x000fffff] to [bus 06] add_size 200000 add_align 100000 [ 0.223165] pci 0000:00:1c.4: res[14]=[mem 0x00100000-0x000fffff] res_to_dev_res add_size 200000 min_align 100000 [ 0.223167] pci 0000:00:1c.4: res[14]=[mem 0x00100000-0x002fffff] res_to_dev_res add_size 200000 min_align 100000 [ 0.223168] pci 0000:00:1c.4: res[15]=[mem 0x00100000-0x000fffff 64bit pref] res_to_dev_res add_size 200000 min_align 100000 [ 0.223169] pci 0000:00:1c.4: res[15]=[mem 0x00100000-0x002fffff 64bit pref] res_to_dev_res add_size 200000 min_align 100000 [ 0.223169] pci 0000:00:1d.0: res[14]=[mem 0x00100000-0x000fffff] res_to_dev_res add_size 200000 min_align 100000 [ 0.223170] pci 0000:00:1d.0: res[14]=[mem 0x00100000-0x002fffff] res_to_dev_res add_size 200000 min_align 100000 [ 0.223171] pci 0000:00:1d.0: res[15]=[mem 0x00100000-0x000fffff 64bit pref] res_to_dev_res add_size 200000 min_align 100000 [ 0.223172] pci 0000:00:1d.0: res[15]=[mem 0x00100000-0x002fffff 64bit pref] res_to_dev_res add_size 200000 min_align 100000 [ 0.223173] pci 0000:00:1c.4: res[13]=[io 0x1000-0x0fff] res_to_dev_res add_size 1000 min_align 1000 [ 0.223174] pci 0000:00:1c.4: res[13]=[io 0x1000-0x1fff] res_to_dev_res add_size 1000 min_align 1000 [ 0.223175] pci 0000:00:1d.0: res[13]=[io 0x1000-0x0fff] res_to_dev_res add_size 1000 min_align 1000 [ 0.223176] pci 0000:00:1d.0: res[13]=[io 0x1000-0x1fff] res_to_dev_res add_size 1000 min_align 1000 [ 0.223178] pci 0000:00:1c.4: BAR 14: assigned [mem 0x8d000000-0x8d1fffff] [ 0.223181] pci 0000:00:1c.4: BAR 15: assigned [mem 0x8d200000-0x8d3fffff 64bit pref] [ 0.223182] pci 0000:00:1d.0: BAR 14: assigned [mem 0x8d400000-0x8d5fffff] [ 0.223184] pci 0000:00:1d.0: BAR 15: assigned [mem 0x8d600000-0x8d7fffff 64bit pref] [ 0.223186] pci 0000:00:1c.4: BAR 13: assigned [io 0x2000-0x2fff] [ 0.223187] pci 0000:00:1d.0: BAR 13: assigned [io 0x3000-0x3fff] [ 0.223188] pci 0000:00:1b.0: PCI bridge to [bus 01] [ 0.223195] pci 0000:02:00.0: PCI bridge to [bus 03] [ 0.223208] pci 0000:00:1b.2: PCI bridge to [bus 02-03] [ 0.223214] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 0.223222] pci 0000:00:1c.4: PCI bridge to [bus 05] [ 0.223224] pci 0000:00:1c.4: bridge window [io 0x2000-0x2fff] [ 0.223226] pci 0000:00:1c.4: bridge window [mem 0x8d000000-0x8d1fffff] [ 0.223229] pci 0000:00:1c.4: bridge window [mem 0x8d200000-0x8d3fffff 64bit pref] [ 0.223232] pci 0000:00:1d.0: PCI bridge to [bus 06] [ 0.223233] pci 0000:00:1d.0: bridge window [io 0x3000-0x3fff] [ 0.223236] pci 0000:00:1d.0: bridge window [mem 0x8d400000-0x8d5fffff] [ 0.223238] pci 0000:00:1d.0: bridge window [mem 0x8d600000-0x8d7fffff 64bit pref] [ 0.223241] pci 0000:00:1d.4: PCI bridge to [bus 07] [ 0.223250] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.223251] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.223252] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.223253] pci_bus 0000:00: resource 7 [mem 0x8d000000-0xdfffffff window] [ 0.223254] pci_bus 0000:00: resource 8 [mem 0xfd000000-0xfe7fffff window] [ 0.223255] pci_bus 0000:05: resource 0 [io 0x2000-0x2fff] [ 0.223256] pci_bus 0000:05: resource 1 [mem 0x8d000000-0x8d1fffff] [ 0.223257] pci_bus 0000:05: resource 2 [mem 0x8d200000-0x8d3fffff 64bit pref] [ 0.223258] pci_bus 0000:06: resource 0 [io 0x3000-0x3fff] [ 0.223258] pci_bus 0000:06: resource 1 [mem 0x8d400000-0x8d5fffff] [ 0.223259] pci_bus 0000:06: resource 2 [mem 0x8d600000-0x8d7fffff 64bit pref] [ 0.223276] NET: Registered protocol family 2 [ 0.223383] TCP established hash table entries: 131072 (order: 8, 1048576 bytes) [ 0.223507] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 0.223582] TCP: Hash tables configured (established 131072 bind 65536) [ 0.223600] UDP hash table entries: 8192 (order: 6, 262144 bytes) [ 0.223629] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes) [ 0.223669] NET: Registered protocol family 1 [ 0.223676] pci 0000:00:02.0: Video device with shadowed ROM [ 0.224035] PCI: CLS 0 bytes, default 64 [ 0.224058] Trying to unpack rootfs image as initramfs... [ 0.552007] Freeing initrd memory: 32884K (ffff880033fb6000 - ffff880035fd3000) [ 0.552023] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 0.552025] software IO TLB [mem 0x82856000-0x86856000] (64MB) mapped at [ffff880082856000-ffff880086855fff] [ 0.552138] Scanning for low memory corruption every 60 seconds [ 0.552398] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 0.552413] audit: initializing netlink subsys (disabled) [ 0.552421] audit: type=2000 audit(1476090106.560:1): initialized [ 0.552657] Initialise system trusted keyring [ 0.552799] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 0.552800] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 0.553709] zbud: loaded [ 0.553855] VFS: Disk quotas dquot_6.6.0 [ 0.553873] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.554176] fuse init (API version 7.23) [ 0.554259] Key type big_key registered [ 0.555159] Key type asymmetric registered [ 0.555161] Asymmetric key parser 'x509' registered [ 0.555181] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249) [ 0.555251] io scheduler noop registered [ 0.555253] io scheduler deadline registered (default) [ 0.555269] io scheduler cfq registered [ 0.556185] aer 0000:00:1b.2:pcie02: service driver aer loaded [ 0.556201] pcieport 0000:00:1b.0: Signaling PME through PCIe PME interrupt [ 0.556203] pcie_pme 0000:00:1b.0:pcie01: service driver pcie_pme loaded [ 0.556208] pcieport 0000:00:1b.2: Signaling PME through PCIe PME interrupt [ 0.556209] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt [ 0.556211] pcie_pme 0000:00:1b.2:pcie01: service driver pcie_pme loaded [ 0.556224] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt [ 0.556226] pcie_pme 0000:00:1c.0:pcie01: service driver pcie_pme loaded [ 0.556238] pcieport 0000:00:1c.4: Signaling PME through PCIe PME interrupt [ 0.556240] pcie_pme 0000:00:1c.4:pcie01: service driver pcie_pme loaded [ 0.556252] pcieport 0000:00:1d.0: Signaling PME through PCIe PME interrupt [ 0.556254] pcie_pme 0000:00:1d.0:pcie01: service driver pcie_pme loaded [ 0.556267] pcieport 0000:00:1d.4: Signaling PME through PCIe PME interrupt [ 0.556270] pcie_pme 0000:00:1d.4:pcie01: service driver pcie_pme loaded [ 0.556272] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 0.556279] pciehp 0000:00:1c.4:pcie04: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl+ LLActRep+ [ 0.556305] pciehp 0000:00:1c.4:pcie04: service driver pciehp loaded [ 0.556319] pciehp 0000:00:1d.0:pcie04: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl+ LLActRep+ [ 0.556343] pciehp 0000:00:1d.0:pcie04: service driver pciehp loaded [ 0.556346] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 0.556361] vesafb: mode is 1920x1080x32, linelength=7680, pages=0 [ 0.556362] vesafb: scrolling: redraw [ 0.556363] vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0 [ 0.556370] vesafb: framebuffer at 0xc0000000, mapped to 0xffffc90002000000, using 8128k, total 8128k [ 0.556434] Console: switching to colour frame buffer device 240x67 [ 0.556447] fb0: VESA VGA frame buffer device [ 0.556455] intel_idle: MWAIT substates: 0x142120 [ 0.556456] intel_idle: v0.4.1 model 0x5E [ 0.556457] intel_idle: lapic_timer_reliable_states 0xffffffff [ 0.556636] input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input0 [ 0.556645] ACPI: Sleep Button [SLPB] [ 0.556664] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input1 [ 0.556665] ACPI: Power Button [PWRB] [ 0.556684] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2 [ 0.556685] ACPI: Power Button [PWRF] [ 0.557188] thermal LNXTHERM:00: registered as thermal_zone0 [ 0.557189] ACPI: Thermal Zone [TZ00] (28 C) [ 0.557262] thermal LNXTHERM:01: registered as thermal_zone1 [ 0.557263] ACPI: Thermal Zone [TZ01] (30 C) [ 0.557285] GHES: HEST is not enabled! [ 0.557402] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 0.577966] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 0.579963] Linux agpgart interface v0.103 [ 0.584423] brd: module loaded [ 0.586459] loop: module loaded [ 0.586618] libphy: Fixed MDIO Bus: probed [ 0.586621] tun: Universal TUN/TAP device driver, 1.6 [ 0.586621] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com> [ 0.586719] PPP generic driver version 2.4.2 [ 0.586780] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 0.586783] ehci-pci: EHCI PCI platform driver [ 0.586789] ehci-platform: EHCI generic platform driver [ 0.586794] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 0.586797] ohci-pci: OHCI PCI platform driver [ 0.586802] ohci-platform: OHCI generic platform driver [ 0.586807] uhci_hcd: USB Universal Host Controller Interface driver [ 0.586892] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 0.586895] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1 [ 0.587966] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00109810 [ 0.587969] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 0.588065] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 [ 0.588066] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 0.588067] usb usb1: Product: xHCI Host Controller [ 0.588068] usb usb1: Manufacturer: Linux 4.4.0-21-generic xhci-hcd [ 0.588069] usb usb1: SerialNumber: 0000:00:14.0 [ 0.588146] hub 1-0:1.0: USB hub found [ 0.588159] hub 1-0:1.0: 16 ports detected [ 0.594520] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 0.594521] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 0.594537] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003 [ 0.594537] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 0.594538] usb usb2: Product: xHCI Host Controller [ 0.594539] usb usb2: Manufacturer: Linux 4.4.0-21-generic xhci-hcd [ 0.594539] usb usb2: SerialNumber: 0000:00:14.0 [ 0.594635] hub 2-0:1.0: USB hub found [ 0.594644] hub 2-0:1.0: 10 ports detected [ 0.598698] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12 [ 0.599393] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 0.599395] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 0.599536] mousedev: PS/2 mouse device common for all mice [ 0.599824] rtc_cmos 00:07: RTC can wake from S4 [ 0.600226] rtc_cmos 00:07: rtc core: registered rtc_cmos as rtc0 [ 0.600308] rtc_cmos 00:07: alarms up to one month, y3k, 242 bytes nvram, hpet irqs [ 0.600312] i2c /dev entries driver [ 0.600338] device-mapper: uevent: version 1.0.3 [ 0.600427] device-mapper: ioctl: 4.34.0-ioctl (2015-10-28) initialised: dm-devel@redhat.com [ 0.600434] Intel P-state driver initializing. [ 0.600436] intel_pstate: HWP enabled [ 0.601033] ledtrig-cpu: registered to indicate activity on CPUs [ 0.601664] NET: Registered protocol family 10 [ 0.601889] NET: Registered protocol family 17 [ 0.601897] Key type dns_resolver registered [ 0.602028] microcode: CPU0 sig=0x506e3, pf=0x2, revision=0x23 [ 0.602064] microcode: CPU1 sig=0x506e3, pf=0x2, revision=0x23 [ 0.602083] microcode: CPU2 sig=0x506e3, pf=0x2, revision=0x23 [ 0.602117] microcode: CPU3 sig=0x506e3, pf=0x2, revision=0x23 [ 0.602186] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba [ 0.602424] registered taskstats version 1 [ 0.602436] Loading compiled-in X.509 certificates [ 0.602856] Loaded X.509 cert 'Build time autogenerated kernel key: fc7c0e9f152f32eca50ea2d9722926e5127af244' [ 0.602866] zswap: loaded using pool lzo/zbud [ 0.604272] Key type trusted registered [ 0.607678] Key type encrypted registered [ 0.607695] AppArmor: AppArmor sha1 policy hashing enabled [ 0.607698] ima: No TPM chip found, activating TPM-bypass! [ 0.607708] evm: HMAC attrs: 0x1 [ 0.608602] Magic number: 4:689:19 [ 0.608880] rtc_cmos 00:07: setting system clock to 2016-10-10 09:01:47 UTC (1476090107) [ 0.609044] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found [ 0.609044] EDD information not available. [ 0.609086] PM: Hibernation image not present or could not be loaded. [ 0.609881] Freeing unused kernel memory: 1476K (ffffffff81f41000 - ffffffff820b2000) [ 0.609882] Write protecting the kernel read-only data: 14336k [ 0.610405] Freeing unused kernel memory: 1872K (ffff88000182c000 - ffff880001a00000) [ 0.610755] Freeing unused kernel memory: 176K (ffff880001dd4000 - ffff880001e00000) [ 0.618167] random: systemd-udevd urandom read with 1 bits of entropy available [ 0.634462] FUJITSU Extended Socket Network Device Driver - version 1.0 - Copyright (c) 2015 FUJITSU LIMITED [ 0.638148] hidraw: raw HID events driver (C) Jiri Kosina [ 0.641572] wmi: Mapper loaded [ 0.658942] ahci 0000:00:17.0: version 3.0 [ 0.659777] [drm] Initialized drm 1.1.0 20060810 [ 0.660351] pps_core: LinuxPPS API ver. 1 registered [ 0.660352] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it> [ 0.661046] PTP clock support registered [ 0.663355] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k [ 0.663356] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. [ 0.673677] ahci 0000:00:17.0: AHCI 0001.0301 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 0.673679] ahci 0000:00:17.0: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst [ 0.714500] scsi host0: ahci [ 0.714963] scsi host1: ahci [ 0.715555] scsi host2: ahci [ 0.716126] scsi host3: ahci [ 0.716701] scsi host4: ahci [ 0.717225] scsi host5: ahci [ 0.717260] ata1: SATA max UDMA/133 abar m2048@0xdf04b000 port 0xdf04b100 irq 127 [ 0.717264] ata2: SATA max UDMA/133 abar m2048@0xdf04b000 port 0xdf04b180 irq 127 [ 0.717269] ata3: SATA max UDMA/133 abar m2048@0xdf04b000 port 0xdf04b200 irq 127 [ 0.717273] ata4: SATA max UDMA/133 abar m2048@0xdf04b000 port 0xdf04b280 irq 127 [ 0.717278] ata5: SATA max UDMA/133 abar m2048@0xdf04b000 port 0xdf04b300 irq 127 [ 0.717282] ata6: SATA max UDMA/133 abar m2048@0xdf04b000 port 0xdf04b380 irq 127 [ 0.717627] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode [ 0.905683] usb 1-14: new low-speed USB device number 2 using xhci_hcd [ 1.037778] ata4: SATA link down (SStatus 4 SControl 300) [ 1.037794] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 1.037808] ata5: SATA link down (SStatus 4 SControl 300) [ 1.037833] ata6: SATA link down (SStatus 4 SControl 300) [ 1.037855] ata3: SATA link down (SStatus 4 SControl 300) [ 1.039830] ata2.00: supports DRM functions and may not be fully accessible [ 1.040063] ata2.00: disabling queued TRIM support [ 1.040064] ata2.00: ATA-9: YYYYYYYYYYYYY, max UDMA/133 [ 1.040065] ata2.00: 250069680 sectors, multi 1: LBA48 NCQ (depth 31/32), AA [ 1.040535] ata2.00: supports DRM functions and may not be fully accessible [ 1.040717] ata2.00: disabling queued TRIM support [ 1.040795] ata2.00: configured for UDMA/133 [ 1.094723] usb 1-14: New USB device found, idVendor=09eb, idProduct=0131 [ 1.094725] usb 1-14: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 1.094726] usb 1-14: Product: USB [ 1.094727] usb 1-14: Manufacturer: Generic [ 1.094903] usb 1-14: ep 0x81 - rounding interval to 64 microframes, ep desc says 80 microframes [ 1.094906] usb 1-14: ep 0x82 - rounding interval to 64 microframes, ep desc says 80 microframes [ 1.103373] usbcore: registered new interface driver usbhid [ 1.103374] usbhid: USB HID core driver [ 1.104455] input: Generic USB as /devices/pci0000:00/0000:00:14.0/usb1/1-14/1-14:1.0/0003:09EB:0131.0001/input/input6 [ 1.158000] hid-generic 0003:09EB:0131.0001: input,hidraw0: USB HID v1.10 Keyboard [Generic USB] on usb-0000:00:14.0-14/input0 [ 1.158150] input: Generic USB as /devices/pci0000:00/0000:00:14.0/usb1/1-14/1-14:1.1/0003:09EB:0131.0002/input/input7 [ 1.210117] e1000e 0000:00:1f.6 eth0: registered PHC clock [ 1.210119] e1000e 0000:00:1f.6 eth0: (PCI Express:2.5GT/s:Width x1) 40:8d:5c:71:b6:20 [ 1.210120] e1000e 0000:00:1f.6 eth0: Intel(R) PRO/1000 Network Connection [ 1.210185] e1000e 0000:00:1f.6 eth0: MAC: 12, PHY: 12, PBA No: FFFFFF-0FF [ 1.210795] e1000e 0000:00:1f.6 enp0s31f6: renamed from eth0 [ 1.211383] [drm] Memory usable by graphics device = 4096M [ 1.211385] checking generic (c0000000 7f0000) vs hw (c0000000 10000000) [ 1.211386] fb: switching to inteldrmfb from VESA VGA [ 1.211400] Console: switching to colour dummy device 80x25 [ 1.211610] [drm] Replacing VGA console driver [ 1.214063] hid-generic 0003:09EB:0131.0002: input,hidraw1: USB HID v1.00 Mouse [Generic USB] on usb-0000:00:14.0-14/input1 [ 1.218044] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013). [ 1.218045] [drm] Driver supports precise vblank timestamp query. [ 1.221974] [drm] Finished loading i915/skl_dmc_ver1.bin (v1.26) [ 1.226882] vgaarb: device changed decodes: PCI:0000:00:02.0,olddecodes=io+mem,decodes=io+mem:owns=io+mem [ 1.281644] [drm] failed to retrieve link info, disabling eDP [ 1.286387] ACPI: Video Device [GFX0] (multi-head: yes rom: no post: no) [ 1.286705] acpi device:0f: registered as cooling_device9 [ 1.286753] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/LNXVIDEO:00/input/input8 [ 1.286901] [drm] Initialized i915_bpo 1.6.0 20160229 for 0000:00:02.0 on minor 0 [ 1.549509] tsc: Refined TSC clocksource calibration: 3503.998 MHz [ 1.549511] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x328211acd6a, max_idle_ns: 440795259903 ns [ 1.561876] fbcon: inteldrmfb (fb0) is primary device [ 1.561916] Console: switching to colour frame buffer device 240x67 [ 1.561931] i915_bpo 0000:00:02.0: fb0: inteldrmfb frame buffer device [ 2.213655] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 2.213854] ata1.00: ATA-8: XXXXXXXXX, 1.51, max UDMA/133 [ 2.213855] ata1.00: 937703088 sectors, multi 1: LBA48 NCQ (depth 31/32), AA [ 2.219691] ata1.00: configured for UDMA/133 [ 2.220177] scsi 0:0:0:0: Direct-Access ATA XXXXXXXXX 1.51 PQ: 0 ANSI: 5 [ 2.220583] sd 0:0:0:0: [sda] 937703088 512-byte logical blocks: (480 GB/447 GiB) [ 2.220585] sd 0:0:0:0: [sda] 4096-byte physical blocks [ 2.220648] sd 0:0:0:0: Attached scsi generic sg0 type 0 [ 2.220903] scsi 1:0:0:0: Direct-Access ATA YYYYYYYYY 2B6Q PQ: 0 ANSI: 5 [ 2.221164] sd 0:0:0:0: [sda] Write Protect is off [ 2.221166] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 2.221280] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 2.221418] sd 1:0:0:0: Attached scsi generic sg1 type 0 [ 2.221481] sd 1:0:0:0: [sdb] 250069680 512-byte logical blocks: (128 GB/119 GiB) [ 2.221804] sd 1:0:0:0: [sdb] Write Protect is off [ 2.221806] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00 [ 2.221917] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 2.222591] sda: sda1 sda2 sda3 [ 2.223392] sd 0:0:0:0: [sda] Attached SCSI disk [ 2.272493] sdb: sdb1 sdb2 sdb3 sdb4 [ 2.273981] sd 1:0:0:0: [sdb] Attached SCSI disk [ 2.385437] raid6: sse2x1 gen() 11637 MB/s [ 2.453424] raid6: sse2x1 xor() 7120 MB/s [ 2.521426] raid6: sse2x2 gen() 13911 MB/s [ 2.589395] raid6: sse2x2 xor() 9040 MB/s [ 2.657398] raid6: sse2x4 gen() 14124 MB/s [ 2.725373] raid6: sse2x4 xor() 9884 MB/s [ 2.793372] raid6: avx2x1 gen() 25652 MB/s [ 2.861395] raid6: avx2x2 gen() 29272 MB/s [ 2.929386] raid6: avx2x4 gen() 30641 MB/s [ 2.929387] raid6: using algorithm avx2x4 gen() 30641 MB/s [ 2.929387] raid6: using avx2x2 recovery algorithm [ 2.929398] clocksource: Switched to clocksource tsc [ 2.929736] [drm] RC6 on [ 2.930355] xor: automatically using best checksumming function: [ 2.969342] avx : 32974.000 MB/sec [ 2.977193] Btrfs loaded [ 3.012872] BTRFS: device fsid 554b0043-052f-48d1-986f-5a6154496d89 devid 1 transid 67 /dev/sdb2 [ 3.046882] EXT4-fs (sda3): mounted filesystem with ordered data mode. Opts: (null) [ 3.107671] systemd[1]: systemd 229 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN) [ 3.107745] systemd[1]: Detected architecture x86-64. [ 3.107897] systemd[1]: Set hostname to <ht_stress_b6_20>. [ 3.152571] systemd[1]: [/etc/systemd/system/getty.target.wants/getty@tty2.service:10] Invalid URL, ignoring: --autologin [ 3.152576] systemd[1]: [/etc/systemd/system/getty.target.wants/getty@tty2.service:10] Invalid URL, ignoring: root(8) [ 3.155821] systemd[1]: Created slice System Slice. [ 3.155851] systemd[1]: Listening on Syslog Socket. [ 3.155879] systemd[1]: Created slice User and Session Slice. [ 3.155890] systemd[1]: Listening on fsck to fsckd communication Socket. [ 3.155903] systemd[1]: Listening on Journal Socket. [ 3.165464] systemd[1]: Mounting RPC Pipe File System... [ 3.165741] systemd[1]: Mounting Debug File System... [ 3.166007] systemd[1]: Started Read required files in advance. [ 3.166169] systemd[1]: Reached target Slices. [ 3.166387] systemd[1]: Mounting POSIX Message Queue File System... [ 3.166631] systemd[1]: Mounting Huge Pages File System... [ 3.168419] systemd[1]: Starting Uncomplicated firewall... [ 3.168454] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 3.168479] systemd[1]: Listening on udev Control Socket. [ 3.168748] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 3.168960] systemd[1]: Starting LSB: Create aliases for SCSI devices under /dev/scsi... [ 3.169004] systemd[1]: Listening on Journal Audit Socket. [ 3.169023] systemd[1]: Listening on udev Kernel Socket. [ 3.169136] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 3.170325] systemd[1]: Starting Set console keymap... [ 3.170541] systemd[1]: Starting Nameserver information manager... [ 3.170571] systemd[1]: Listening on Journal Socket (/dev/log). [ 3.170911] systemd[1]: Starting Journal Service... [ 3.171970] systemd[1]: Starting Load Kernel Modules... [ 3.171983] systemd[1]: Reached target User and Group Name Lookups. [ 3.172015] systemd[1]: Listening on /dev/initctl Compatibility Named Pipe. [ 3.172024] systemd[1]: Reached target Encrypted Volumes. [ 3.172075] systemd[1]: Created slice system-systemd\x2dfsck.slice. [ 3.172723] systemd[1]: Started Uncomplicated firewall. [ 3.172820] systemd[1]: Started Create list of required static device nodes for the current kernel. [ 3.174449] systemd[1]: Mounted Debug File System. [ 3.174467] systemd[1]: Mounted POSIX Message Queue File System. [ 3.174477] systemd[1]: Mounted Huge Pages File System. [ 3.175359] systemd[1]: Started Load Kernel Modules. [ 3.176965] systemd[1]: Started Nameserver information manager. [ 3.178268] systemd[1]: Started LSB: Create aliases for SCSI devices under /dev/scsi. [ 3.186339] RPC: Registered named UNIX socket transport module. [ 3.186340] RPC: Registered udp transport module. [ 3.186341] RPC: Registered tcp transport module. [ 3.186342] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 3.186853] systemd[1]: Mounted RPC Pipe File System. [ 3.195941] systemd[1]: Started Journal Service. [ 3.242178] EXT4-fs (sda3): re-mounted. Opts: errors=remount-ro [ 3.256425] systemd-journald[258]: Received request to flush runtime journal from PID 1 [ 3.297971] Bluetooth: Core ver 2.21 [ 3.297978] NET: Registered protocol family 31 [ 3.297979] Bluetooth: HCI device and connection manager initialized [ 3.297981] Bluetooth: HCI socket layer initialized [ 3.297982] Bluetooth: L2CAP socket layer initialized [ 3.297985] Bluetooth: SCO socket layer initialized [ 3.298524] parport_pc 00:01: reported by Plug and Play ACPI [ 3.298564] parport0: PC-style at 0x378, irq 5 [PCSPP,TRISTATE,EPP] [ 3.302002] Bluetooth: HCI UART driver ver 2.3 [ 3.302004] Bluetooth: HCI UART protocol H4 registered [ 3.302005] Bluetooth: HCI UART protocol BCSP registered [ 3.302005] Bluetooth: HCI UART protocol LL registered [ 3.302006] Bluetooth: HCI UART protocol ATH3K registered [ 3.302006] Bluetooth: HCI UART protocol Three-wire (H5) registered [ 3.302022] Bluetooth: HCI UART protocol Intel registered [ 3.302031] Bluetooth: HCI UART protocol BCM registered [ 3.302032] Bluetooth: HCI UART protocol QCA registered [ 3.315975] mei_me 0000:00:16.0: enabling device (0000 -> 0002) [ 3.331313] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.357730] AVX2 version of gcm_enc/dec engaged. [ 3.357731] AES CTR mode by8 optimization enabled [ 3.360880] Adding 31250428k swap on /dev/sda2. Priority:-1 extents:1 across:31250428k SSFS [ 3.365986] BTRFS info (device sdb2): turning on discard [ 3.365988] BTRFS info (device sdb2): disk space caching is enabled [ 3.365989] BTRFS: has skinny extents [ 3.373401] EXT4-fs (sdb4): mounted filesystem with ordered data mode. Opts: (null) [ 3.375787] EXT4-fs (sdb1): mounted filesystem with ordered data mode. Opts: (null) [ 3.375886] SGI XFS with ACLs, security attributes, realtime, no debug enabled [ 3.378973] XFS (sdb3): Mounting V5 Filesystem [ 3.385392] BTRFS: detected SSD devices, enabling SSD mode [ 3.391749] ppdev: user-space parallel port driver [ 3.395222] XFS (sdb3): Ending clean mount [ 3.421040] intel_rapl: Found RAPL domain package [ 3.421042] intel_rapl: Found RAPL domain core [ 3.421043] intel_rapl: Found RAPL domain uncore [ 3.421043] intel_rapl: Found RAPL domain dram [ 3.423178] EXT4-fs (sda1): mounting ext3 file system using the ext4 subsystem [ 3.431183] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ 3.745447] snd_hda_intel 0000:00:1f.3: bound 0000:00:02.0 (ops i915_audio_component_bind_ops [i915_bpo]) [ 3.927198] audit: type=1400 audit(1476090110.812:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/tcpdump" pid=662 comm="apparmor_parser" [ 3.927668] audit: type=1400 audit(1476090110.812:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/sbin/dhclient" pid=660 comm="apparmor_parser" [ 3.927672] audit: type=1400 audit(1476090110.812:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=660 comm="apparmor_parser" [ 3.927674] audit: type=1400 audit(1476090110.812:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=660 comm="apparmor_parser" [ 3.927693] audit: type=1400 audit(1476090110.812:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=660 comm="apparmor_parser" [ 4.177644] IPv6: ADDRCONF(NETDEV_UP): enp0s31f6: link is not ready [ 4.184945] SYSTEMTEST: Hostname set to ht_stress_b6_20 [ 4.185634] SYSTEMTEST: Re-Setting loopback hosts entry [ 4.187024] SYSTEMTEST: OK. [ 4.773287] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC892: line_outs=4 (0x14/0x15/0x16/0x17/0x0) type:line [ 4.773289] snd_hda_codec_realtek hdaudioC0D0: speaker_outs=0 (0x0/0x0/0x0/0x0/0x0) [ 4.773290] snd_hda_codec_realtek hdaudioC0D0: hp_outs=1 (0x1b/0x0/0x0/0x0/0x0) [ 4.773291] snd_hda_codec_realtek hdaudioC0D0: mono: mono_out=0x0 [ 4.773292] snd_hda_codec_realtek hdaudioC0D0: dig-out=0x11/0x0 [ 4.773292] snd_hda_codec_realtek hdaudioC0D0: inputs: [ 4.773294] snd_hda_codec_realtek hdaudioC0D0: Front Mic=0x19 [ 4.773294] snd_hda_codec_realtek hdaudioC0D0: Rear Mic=0x18 [ 4.773295] snd_hda_codec_realtek hdaudioC0D0: Line=0x1a [ 4.790223] input: HDA Intel PCH Front Mic as /devices/pci0000:00/0000:00:1f.3/sound/card0/input9 [ 4.790295] input: HDA Intel PCH Rear Mic as /devices/pci0000:00/0000:00:1f.3/sound/card0/input10 [ 4.790383] input: HDA Intel PCH Line as /devices/pci0000:00/0000:00:1f.3/sound/card0/input11 [ 4.790458] input: HDA Intel PCH Line Out Front as /devices/pci0000:00/0000:00:1f.3/sound/card0/input12 [ 4.790523] input: HDA Intel PCH Line Out Surround as /devices/pci0000:00/0000:00:1f.3/sound/card0/input13 [ 4.790567] input: HDA Intel PCH Line Out CLFE as /devices/pci0000:00/0000:00:1f.3/sound/card0/input14 [ 4.791038] input: HDA Intel PCH Line Out Side as /devices/pci0000:00/0000:00:1f.3/sound/card0/input15 [ 4.791075] input: HDA Intel PCH Front Headphone as /devices/pci0000:00/0000:00:1f.3/sound/card0/input16 [ 4.791107] input: HDA Intel PCH HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:1f.3/sound/card0/input17 [ 4.791137] input: HDA Intel PCH HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:1f.3/sound/card0/input18 [ 4.792225] input: HDA Intel PCH HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:1f.3/sound/card0/input19 [ 6.995561] e1000e: enp0s31f6 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx [ 6.995613] IPv6: ADDRCONF(NETDEV_CHANGE): enp0s31f6: link becomes ready [ 8.943503] random: nonblocking pool is initialized [ 152.560398] BTRFS warning (device sdb2): csum failed ino 270 off 10547757056 csum 2566472073 expected csum 2900097525 [ 152.560416] BTRFS warning (device sdb2): csum failed ino 270 off 10547761152 csum 2566472073 expected csum 2076957355 [ 152.560424] BTRFS warning (device sdb2): csum failed ino 270 off 10547765248 csum 2566472073 expected csum 3128666950 [ 152.560432] BTRFS warning (device sdb2): csum failed ino 270 off 10547769344 csum 2566472073 expected csum 3034888413 [ 152.560443] BTRFS warning (device sdb2): csum failed ino 270 off 10547888128 csum 2566472073 expected csum 4123569143 [ 152.560446] BTRFS warning (device sdb2): csum failed ino 270 off 10547773440 csum 2566472073 expected csum 3258925032 [ 152.560454] BTRFS warning (device sdb2): csum failed ino 270 off 10547777536 csum 2566472073 expected csum 3588704993 [ 152.560460] BTRFS warning (device sdb2): csum failed ino 270 off 10547781632 csum 2566472073 expected csum 1584150672 [ 152.560472] BTRFS warning (device sdb2): csum failed ino 270 off 10547892224 csum 2566472073 expected csum 3791989331 [ 152.560474] BTRFS warning (device sdb2): csum failed ino 270 off 10547785728 csum 2566472073 expected csum 2024003267 ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: csum failed during copy/compare 2016-10-10 9:44 ` Fwd: csum failed during copy/compare Martin Dev @ 2016-10-10 12:02 ` Martin Dev 2016-10-10 13:56 ` Martin Dev 2016-10-10 18:42 ` Roman Mamedov 1 sibling, 1 reply; 8+ messages in thread From: Martin Dev @ 2016-10-10 12:02 UTC (permalink / raw) To: linux-btrfs [-- Attachment #1: Type: text/plain, Size: 9151 bytes --] Additional BTRFS scrub logs root@xxxx# btrfs scrub start -B /mnt/g/ scrub done for 554b0043-052f-48d1-986f-5a6154496d89 scrub started at Mon Oct 10 12:52:40 2016 and finished after 00:00:39 total bytes scrubbed: 20.03GiB with 46304 errors error details: csum=46304 corrected errors: 0, uncorrectable errors: 46304, unverified errors: 0 ERROR: there are uncorrectable errors I've attached the dmesg log incase gmail wordwrap completely destroys formatting dmesg : [10284.452766] BTRFS warning (device sdb2): checksum error at logical 143896739840 on dev /dev/sdb2, sector 42509568, root 5, inode 270, offset 10548412416, length 4096, links 1 (path: shutdown-4.bin) [10284.452775] BTRFS warning (device sdb2): checksum error at logical 143896608768 on dev /dev/sdb2, sector 42509312, root 5, inode 270, offset 10548281344, length 4096, links 1 (path: shutdown-4.bin) [10284.452784] BTRFS warning (device sdb2): checksum error at logical 143896346624 on dev /dev/sdb2, sector 42508800, root 5, inode 270, offset 10548019200, length 4096, links 1 (path: shutdown-4.bin) [10284.452792] BTRFS warning (device sdb2): checksum error at logical 143896215552 on dev /dev/sdb2, sector 42508544, root 5, inode 270, offset 10547888128, length 4096, links 1 (path: shutdown-4.bin) [10284.452800] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 1, gen 0 [10284.452804] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 2, gen 0 [10284.452810] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 3, gen 0 [10284.452813] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896608768 on dev /dev/sdb2 [10284.452815] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896346624 on dev /dev/sdb2 [10284.452820] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896215552 on dev /dev/sdb2 [10284.452840] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 4, gen 0 [10284.452845] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896739840 on dev /dev/sdb2 [10284.452906] BTRFS warning (device sdb2): checksum error at logical 143896084480 on dev /dev/sdb2, sector 42508288, root 5, inode 270, offset 10547757056, length 4096, links 1 (path: shutdown-4.bin) [10284.453082] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 5, gen 0 [10284.453087] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896084480 on dev /dev/sdb2 [10284.453107] BTRFS warning (device sdb2): checksum error at logical 143896743936 on dev /dev/sdb2, sector 42509576, root 5, inode 270, offset 10548416512, length 4096, links 1 (path: shutdown-4.bin) [10284.453113] BTRFS warning (device sdb2): checksum error at logical 143896612864 on dev /dev/sdb2, sector 42509320, root 5, inode 270, offset 10548285440, length 4096, links 1 (path: shutdown-4.bin) [10284.453122] BTRFS warning (device sdb2): checksum error at logical 143896350720 on dev /dev/sdb2, sector 42508808, root 5, inode 270, offset 10548023296, length 4096, links 1 (path: shutdown-4.bin) [10284.453126] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 6, gen 0 [10284.453130] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896612864 on dev /dev/sdb2 [10284.453134] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 7, gen 0 [10284.453137] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896350720 on dev /dev/sdb2 [10284.453153] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 8, gen 0 [10284.453157] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896743936 on dev /dev/sdb2 [10284.453190] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 9, gen 0 [10284.453194] BTRFS warning (device sdb2): checksum error at logical 143896219648 on dev /dev/sdb2, sector 42508552, root 5, inode 270, offset 10547892224, length 4096, links 1 (path: shutdown-4.bin) [10284.453198] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 10, gen 0 [10284.453201] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896219648 on dev /dev/sdb2 [10284.453207] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896616960 on dev /dev/sdb2 [10284.453238] BTRFS warning (device sdb2): checksum error at logical 143896477696 on dev /dev/sdb2, sector 42509056, root 5, inode 270, offset 10548150272, length 4096, links 1 (path: shutdown-4.bin) Important to note this happens across 2 machines, now 3 different drives (all different brand SSDs), on a Z170 chipset and C612 chipset. On Mon, Oct 10, 2016 at 10:44 AM, Martin Dev <mrturtledev@gmail.com> wrote: > Hey everyone, > > I work for system verification of SSDs and we've recently come up > against an issue with BTRFS on Ubuntu 16.04. We have a framework which > follows the following steps: > > Generate verifiable 10GB file with FIO on internal drive > Copy 10GB file to 2 target partitions on DUT (using "cp" command) > Sync > Verify copied files with FIO (using direct=1) > Perform a power event (restart, shutdown, suspend, or hibernate) > Verify both 10GB files > Repeat. > > We keep the files from the first iteration on the target partitions, > but subsequent iterations are deleted after verification. Every > command is monitored for exit status and framework will fail with > error if anything exits non zero. > > We've found that during this process (between 2-9 iterations of > restarts or shutdowns) BTRFS will fail the pre-power verification of > the file with 100% reproduction rate out of 7 attempts. So this is a > "cp" command to copy from the internal to the btrfs partition, a sync, > then a verify with fio. This seems to be a recent change as the same > process has been used for the last 2 years including over the last > month with no issues. > > Here are some more details: > > Linux ht_stress_b6_20 4.4.0-21-generic #37-Ubuntu SMP Mon Apr 18 > 18:33:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux > > btrfs-progs v4.4 > > Label: none uuid: 554b0043-052f-48d1-986f-5a6154496d89 > Total devices 1 FS bytes used 20.03GiB > devid 1 size 29.81GiB used 22.26GiB path /dev/sdb2 > > Data, single: total=22.00GiB, used=20.00GiB > System, single: total=4.00MiB, used=16.00KiB > Metadata, single: total=264.00MiB, used=20.64MiB > GlobalReserve, single: total=16.00MiB, used=0.00B > > > df -hT > /dev/sdb1 ext4 30G 21G 7.7G 73% /mnt/f > /dev/sdb2 btrfs 30G 21G 9.6G 68% /mnt/g > /dev/sdb3 xfs 30G 33M 30G 1% /mnt/h > /dev/sdb4 ext4 30G 44M 28G 1% /mnt/i > > /etc/fstab > /dev/sdb2 /mnt/g/ btrfs > defaults,discard 0 0 > > root@xxxx: ls -l /mnt/g/ > total 20971520 > -rw-r--r-- 1 root root 10737418240 Oct 10 09:42 shutdown-1.bin > -rw-r--r-- 1 root root 10737418240 Oct 10 10:03 shutdown-4.bin > > > root@xxxx# cat fio-screenlog.log > test: (g=0): rw=read, bs=128K-128K/128K-128K/128K-128K, > ioengine=libaio, iodepth=32 > fio-2.13-88-g32bc8-dirty > Starting 1 process > verify: bad magic header 101, wanted acca at file > /mnt/g/shutdown-4.bin offset 10547757056, length 131072 > verify: bad magic header 101, wanted acca at file > /mnt/g/shutdown-4.bin offset 10547888128, length 131072 > fio: pid=2288, err=84/file:io_u.c:1978, func=io_u_queued_complete, > error=Invalid or incomplete multibyte or wide character > > In this situation, FIO is reading "101" instead of the correct data > from the shutdown-4.bin file. from the "ls -l" above, we can see the > shutdown-1.bin and shutdown-4.bin are the same size and we know the cp > command exited 0. > > shutdown-1.bin (OK): > dd if=/mnt/g/shutdown-1.bin of=/tmp/header bs=512 count=1 skip=20601088 > 1+0 records in > 1+0 records out > 512 bytes copied, 0.00247518 s, 207 kB/s > > Data: > 0000000 acca 0001 0000 0002 3d92 e664 178e 8421 > 0000010 0000 74b2 0002 0000 0016 0000 2bfa 0009 > 0000020 0001 3a59 c82b 1b3a a7b8 ee74 881a 0747 > 0000030 94f7 09f2 79c9 04e3 d29e d6c2 ea3f 04b8 > ... > > shutdown-4.bin (FAILS): > dd if=/mnt/g/shutdown-4.bin of=/tmp/header bs=512 count=1 skip=20601088 > dd: error reading '/mnt/g/shutdown-4.bin': Input/output error > 0+0 records in > 0+0 records out > 0 bytes copied, 0.00230287 s, 0.0 kB/s > > We can't even read the file at that offset correctly and have to go > back to 20601087 (1 512 byte sector) before I can get valid data. > What's interesting, is over 2 different drives, 2 different machines, > and 7 reproductions, the data is always "101", this might be a quirk > of FIO, as I would hope that btrfs would not return corrupt data to > the user. > > Reproduction is straight forward, and takes around an hour. I have a > large amount of duplicate machines at my disposal if debug / > investigations need to be run. I can provide portions of our > automation logs, full dmesg (attached), and any other information that > needs to be gathered. [-- Attachment #2: dmesg_btrfsscrub.log --] [-- Type: text/x-log, Size: 4171 bytes --] [10284.452766] BTRFS warning (device sdb2): checksum error at logical 143896739840 on dev /dev/sdb2, sector 42509568, root 5, inode 270, offset 10548412416, length 4096, links 1 (path: shutdown-4.bin) [10284.452775] BTRFS warning (device sdb2): checksum error at logical 143896608768 on dev /dev/sdb2, sector 42509312, root 5, inode 270, offset 10548281344, length 4096, links 1 (path: shutdown-4.bin) [10284.452784] BTRFS warning (device sdb2): checksum error at logical 143896346624 on dev /dev/sdb2, sector 42508800, root 5, inode 270, offset 10548019200, length 4096, links 1 (path: shutdown-4.bin) [10284.452792] BTRFS warning (device sdb2): checksum error at logical 143896215552 on dev /dev/sdb2, sector 42508544, root 5, inode 270, offset 10547888128, length 4096, links 1 (path: shutdown-4.bin) [10284.452800] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 1, gen 0 [10284.452804] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 2, gen 0 [10284.452810] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 3, gen 0 [10284.452813] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896608768 on dev /dev/sdb2 [10284.452815] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896346624 on dev /dev/sdb2 [10284.452820] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896215552 on dev /dev/sdb2 [10284.452840] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 4, gen 0 [10284.452845] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896739840 on dev /dev/sdb2 [10284.452906] BTRFS warning (device sdb2): checksum error at logical 143896084480 on dev /dev/sdb2, sector 42508288, root 5, inode 270, offset 10547757056, length 4096, links 1 (path: shutdown-4.bin) [10284.453082] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 5, gen 0 [10284.453087] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896084480 on dev /dev/sdb2 [10284.453107] BTRFS warning (device sdb2): checksum error at logical 143896743936 on dev /dev/sdb2, sector 42509576, root 5, inode 270, offset 10548416512, length 4096, links 1 (path: shutdown-4.bin) [10284.453113] BTRFS warning (device sdb2): checksum error at logical 143896612864 on dev /dev/sdb2, sector 42509320, root 5, inode 270, offset 10548285440, length 4096, links 1 (path: shutdown-4.bin) [10284.453122] BTRFS warning (device sdb2): checksum error at logical 143896350720 on dev /dev/sdb2, sector 42508808, root 5, inode 270, offset 10548023296, length 4096, links 1 (path: shutdown-4.bin) [10284.453126] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 6, gen 0 [10284.453130] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896612864 on dev /dev/sdb2 [10284.453134] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 7, gen 0 [10284.453137] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896350720 on dev /dev/sdb2 [10284.453153] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 8, gen 0 [10284.453157] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896743936 on dev /dev/sdb2 [10284.453190] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 9, gen 0 [10284.453194] BTRFS warning (device sdb2): checksum error at logical 143896219648 on dev /dev/sdb2, sector 42508552, root 5, inode 270, offset 10547892224, length 4096, links 1 (path: shutdown-4.bin) [10284.453198] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, rd 0, flush 0, corrupt 10, gen 0 [10284.453201] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896219648 on dev /dev/sdb2 [10284.453207] BTRFS error (device sdb2): unable to fixup (regular) error at logical 143896616960 on dev /dev/sdb2 [10284.453238] BTRFS warning (device sdb2): checksum error at logical 143896477696 on dev /dev/sdb2, sector 42509056, root 5, inode 270, offset 10548150272, length 4096, links 1 (path: shutdown-4.bin) ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: csum failed during copy/compare 2016-10-10 12:02 ` Martin Dev @ 2016-10-10 13:56 ` Martin Dev 0 siblings, 0 replies; 8+ messages in thread From: Martin Dev @ 2016-10-10 13:56 UTC (permalink / raw) To: linux-btrfs After some investigation this seems to follow the discard flag set in fstab. 9 or so reproductions with discard on partition 2 fail move discard flag to partition 1, then partition 1 fails. Re-running our tests with no discard options set in fstab On Mon, Oct 10, 2016 at 1:02 PM, Martin Dev <mrturtledev@gmail.com> wrote: > Additional BTRFS scrub logs > > root@xxxx# btrfs scrub start -B /mnt/g/ > scrub done for 554b0043-052f-48d1-986f-5a6154496d89 > scrub started at Mon Oct 10 12:52:40 2016 and finished after 00:00:39 > total bytes scrubbed: 20.03GiB with 46304 errors > error details: csum=46304 > corrected errors: 0, uncorrectable errors: 46304, unverified errors: 0 > ERROR: there are uncorrectable errors > > I've attached the dmesg log incase gmail wordwrap completely destroys formatting > > dmesg : > [10284.452766] BTRFS warning (device sdb2): checksum error at logical > 143896739840 on dev /dev/sdb2, sector 42509568, root 5, inode 270, > offset 10548412416, length 4096, links 1 (path: shutdown-4.bin) > [10284.452775] BTRFS warning (device sdb2): checksum error at logical > 143896608768 on dev /dev/sdb2, sector 42509312, root 5, inode 270, > offset 10548281344, length 4096, links 1 (path: shutdown-4.bin) > [10284.452784] BTRFS warning (device sdb2): checksum error at logical > 143896346624 on dev /dev/sdb2, sector 42508800, root 5, inode 270, > offset 10548019200, length 4096, links 1 (path: shutdown-4.bin) > [10284.452792] BTRFS warning (device sdb2): checksum error at logical > 143896215552 on dev /dev/sdb2, sector 42508544, root 5, inode 270, > offset 10547888128, length 4096, links 1 (path: shutdown-4.bin) > [10284.452800] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 1, gen 0 > [10284.452804] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 2, gen 0 > [10284.452810] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 3, gen 0 > [10284.452813] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896608768 on dev /dev/sdb2 > [10284.452815] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896346624 on dev /dev/sdb2 > [10284.452820] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896215552 on dev /dev/sdb2 > [10284.452840] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 4, gen 0 > [10284.452845] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896739840 on dev /dev/sdb2 > [10284.452906] BTRFS warning (device sdb2): checksum error at logical > 143896084480 on dev /dev/sdb2, sector 42508288, root 5, inode 270, > offset 10547757056, length 4096, links 1 (path: shutdown-4.bin) > [10284.453082] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 5, gen 0 > [10284.453087] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896084480 on dev /dev/sdb2 > [10284.453107] BTRFS warning (device sdb2): checksum error at logical > 143896743936 on dev /dev/sdb2, sector 42509576, root 5, inode 270, > offset 10548416512, length 4096, links 1 (path: shutdown-4.bin) > [10284.453113] BTRFS warning (device sdb2): checksum error at logical > 143896612864 on dev /dev/sdb2, sector 42509320, root 5, inode 270, > offset 10548285440, length 4096, links 1 (path: shutdown-4.bin) > [10284.453122] BTRFS warning (device sdb2): checksum error at logical > 143896350720 on dev /dev/sdb2, sector 42508808, root 5, inode 270, > offset 10548023296, length 4096, links 1 (path: shutdown-4.bin) > [10284.453126] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 6, gen 0 > [10284.453130] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896612864 on dev /dev/sdb2 > [10284.453134] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 7, gen 0 > [10284.453137] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896350720 on dev /dev/sdb2 > [10284.453153] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 8, gen 0 > [10284.453157] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896743936 on dev /dev/sdb2 > [10284.453190] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 9, gen 0 > [10284.453194] BTRFS warning (device sdb2): checksum error at logical > 143896219648 on dev /dev/sdb2, sector 42508552, root 5, inode 270, > offset 10547892224, length 4096, links 1 (path: shutdown-4.bin) > [10284.453198] BTRFS error (device sdb2): bdev /dev/sdb2 errs: wr 0, > rd 0, flush 0, corrupt 10, gen 0 > [10284.453201] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896219648 on dev /dev/sdb2 > [10284.453207] BTRFS error (device sdb2): unable to fixup (regular) > error at logical 143896616960 on dev /dev/sdb2 > [10284.453238] BTRFS warning (device sdb2): checksum error at logical > 143896477696 on dev /dev/sdb2, sector 42509056, root 5, inode 270, > offset 10548150272, length 4096, links 1 (path: shutdown-4.bin) > > Important to note this happens across 2 machines, now 3 different > drives (all different brand SSDs), on a Z170 chipset and C612 chipset. > > On Mon, Oct 10, 2016 at 10:44 AM, Martin Dev <mrturtledev@gmail.com> wrote: >> Hey everyone, >> >> I work for system verification of SSDs and we've recently come up >> against an issue with BTRFS on Ubuntu 16.04. We have a framework which >> follows the following steps: >> >> Generate verifiable 10GB file with FIO on internal drive >> Copy 10GB file to 2 target partitions on DUT (using "cp" command) >> Sync >> Verify copied files with FIO (using direct=1) >> Perform a power event (restart, shutdown, suspend, or hibernate) >> Verify both 10GB files >> Repeat. >> >> We keep the files from the first iteration on the target partitions, >> but subsequent iterations are deleted after verification. Every >> command is monitored for exit status and framework will fail with >> error if anything exits non zero. >> >> We've found that during this process (between 2-9 iterations of >> restarts or shutdowns) BTRFS will fail the pre-power verification of >> the file with 100% reproduction rate out of 7 attempts. So this is a >> "cp" command to copy from the internal to the btrfs partition, a sync, >> then a verify with fio. This seems to be a recent change as the same >> process has been used for the last 2 years including over the last >> month with no issues. >> >> Here are some more details: >> >> Linux ht_stress_b6_20 4.4.0-21-generic #37-Ubuntu SMP Mon Apr 18 >> 18:33:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux >> >> btrfs-progs v4.4 >> >> Label: none uuid: 554b0043-052f-48d1-986f-5a6154496d89 >> Total devices 1 FS bytes used 20.03GiB >> devid 1 size 29.81GiB used 22.26GiB path /dev/sdb2 >> >> Data, single: total=22.00GiB, used=20.00GiB >> System, single: total=4.00MiB, used=16.00KiB >> Metadata, single: total=264.00MiB, used=20.64MiB >> GlobalReserve, single: total=16.00MiB, used=0.00B >> >> >> df -hT >> /dev/sdb1 ext4 30G 21G 7.7G 73% /mnt/f >> /dev/sdb2 btrfs 30G 21G 9.6G 68% /mnt/g >> /dev/sdb3 xfs 30G 33M 30G 1% /mnt/h >> /dev/sdb4 ext4 30G 44M 28G 1% /mnt/i >> >> /etc/fstab >> /dev/sdb2 /mnt/g/ btrfs >> defaults,discard 0 0 >> >> root@xxxx: ls -l /mnt/g/ >> total 20971520 >> -rw-r--r-- 1 root root 10737418240 Oct 10 09:42 shutdown-1.bin >> -rw-r--r-- 1 root root 10737418240 Oct 10 10:03 shutdown-4.bin >> >> >> root@xxxx# cat fio-screenlog.log >> test: (g=0): rw=read, bs=128K-128K/128K-128K/128K-128K, >> ioengine=libaio, iodepth=32 >> fio-2.13-88-g32bc8-dirty >> Starting 1 process >> verify: bad magic header 101, wanted acca at file >> /mnt/g/shutdown-4.bin offset 10547757056, length 131072 >> verify: bad magic header 101, wanted acca at file >> /mnt/g/shutdown-4.bin offset 10547888128, length 131072 >> fio: pid=2288, err=84/file:io_u.c:1978, func=io_u_queued_complete, >> error=Invalid or incomplete multibyte or wide character >> >> In this situation, FIO is reading "101" instead of the correct data >> from the shutdown-4.bin file. from the "ls -l" above, we can see the >> shutdown-1.bin and shutdown-4.bin are the same size and we know the cp >> command exited 0. >> >> shutdown-1.bin (OK): >> dd if=/mnt/g/shutdown-1.bin of=/tmp/header bs=512 count=1 skip=20601088 >> 1+0 records in >> 1+0 records out >> 512 bytes copied, 0.00247518 s, 207 kB/s >> >> Data: >> 0000000 acca 0001 0000 0002 3d92 e664 178e 8421 >> 0000010 0000 74b2 0002 0000 0016 0000 2bfa 0009 >> 0000020 0001 3a59 c82b 1b3a a7b8 ee74 881a 0747 >> 0000030 94f7 09f2 79c9 04e3 d29e d6c2 ea3f 04b8 >> ... >> >> shutdown-4.bin (FAILS): >> dd if=/mnt/g/shutdown-4.bin of=/tmp/header bs=512 count=1 skip=20601088 >> dd: error reading '/mnt/g/shutdown-4.bin': Input/output error >> 0+0 records in >> 0+0 records out >> 0 bytes copied, 0.00230287 s, 0.0 kB/s >> >> We can't even read the file at that offset correctly and have to go >> back to 20601087 (1 512 byte sector) before I can get valid data. >> What's interesting, is over 2 different drives, 2 different machines, >> and 7 reproductions, the data is always "101", this might be a quirk >> of FIO, as I would hope that btrfs would not return corrupt data to >> the user. >> >> Reproduction is straight forward, and takes around an hour. I have a >> large amount of duplicate machines at my disposal if debug / >> investigations need to be run. I can provide portions of our >> automation logs, full dmesg (attached), and any other information that >> needs to be gathered. ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: csum failed during copy/compare 2016-10-10 9:44 ` Fwd: csum failed during copy/compare Martin Dev 2016-10-10 12:02 ` Martin Dev @ 2016-10-10 18:42 ` Roman Mamedov 2016-10-10 21:05 ` Chris Murphy 1 sibling, 1 reply; 8+ messages in thread From: Roman Mamedov @ 2016-10-10 18:42 UTC (permalink / raw) To: Martin Dev; +Cc: linux-btrfs [-- Attachment #1: Type: text/plain, Size: 1214 bytes --] On Mon, 10 Oct 2016 10:44:39 +0100 Martin Dev <mrturtledev@gmail.com> wrote: > I work for system verification of SSDs and we've recently come up > against an issue with BTRFS on Ubuntu 16.04 > This seems to be a recent change ...well, a change in what? If you really didn't change anything on your machines and the used process, there is no reason for anything to start breaking, other than obvious hardware issues from age/etc (likely not what's happening here). So you most likely did change something yourself, and perhaps the change was upgrading OS version, kernel version(!!!), or versions of software in general. As such, the first suggestion would be go through the recent software updates history, maybe even restore an OS image you used three months ago (if available) and confirm that the problem doesn't occur there. After that it's a process called bisecting, there are tools for that, but likely you don't even need those yet, just carefully note when you got which upgrades, paying highest attention to the kernel version, and note at which point the corruptions start to occur. > as the same process has been used for the last 2 years -- With respect, Roman [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 181 bytes --] ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: csum failed during copy/compare 2016-10-10 18:42 ` Roman Mamedov @ 2016-10-10 21:05 ` Chris Murphy 2016-10-19 14:39 ` Martin Dev 0 siblings, 1 reply; 8+ messages in thread From: Chris Murphy @ 2016-10-10 21:05 UTC (permalink / raw) To: Roman Mamedov; +Cc: Martin Dev, Btrfs BTRFS On Mon, Oct 10, 2016 at 12:42 PM, Roman Mamedov <rm@romanrm.net> wrote: > On Mon, 10 Oct 2016 10:44:39 +0100 > Martin Dev <mrturtledev@gmail.com> wrote: > >> I work for system verification of SSDs and we've recently come up >> against an issue with BTRFS on Ubuntu 16.04 > >> This seems to be a recent change > > ...well, a change in what? > > If you really didn't change anything on your machines and the used process, > there is no reason for anything to start breaking, other than obvious hardware > issues from age/etc (likely not what's happening here). > > So you most likely did change something yourself, and perhaps the change was > upgrading OS version, kernel version(!!!), or versions of software in general. > > As such, the first suggestion would be go through the recent software updates > history, maybe even restore an OS image you used three months ago (if > available) and confirm that the problem doesn't occur there. After that it's a > process called bisecting, there are tools for that, but likely you don't even > need those yet, just carefully note when you got which upgrades, paying > highest attention to the kernel version, and note at which point the > corruptions start to occur. There have been various trim bugs, in Btrfs but also in the block layer. And I don't remember all the different versions involved. I'd like to think 4.4.24 should behave the same as 4.8.1, so I would retest with those two, using something without ubuntu specific backports (i.e. something as close to the kernel.org trees of those versions as possible). I have no idea what Ubuntu generic 4.4.0-21 translates into. Because of the 0, it makes me think it's literally 4.4.0 with 21 sets of various backports, from some unknown time frame without going and looking it up. If that's really 4.4.21, then it's weirdly named, I don't know why any distro would do that. In any case I would compare 4.8.1 and 4.4.24 because those two should work and if not it's a bug that needs to get fixed. Independently, check the SSD firmware. There have been bugs there also. -- Chris Murphy ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: csum failed during copy/compare 2016-10-10 21:05 ` Chris Murphy @ 2016-10-19 14:39 ` Martin Dev 2016-10-21 13:19 ` Martin Dev 0 siblings, 1 reply; 8+ messages in thread From: Martin Dev @ 2016-10-19 14:39 UTC (permalink / raw) To: Chris Murphy; +Cc: Roman Mamedov, Btrfs BTRFS Fails on Antergos Linux 4.8.2-1-ARCH #1 SMP PREEMPT Mon Oct 17 08:11:46 CEST 2016 x86_64 GNU/Linux btrfs-progs v4.8.1 On Mon, Oct 10, 2016 at 10:05 PM, Chris Murphy <lists@colorremedies.com> wrote: > On Mon, Oct 10, 2016 at 12:42 PM, Roman Mamedov <rm@romanrm.net> wrote: >> On Mon, 10 Oct 2016 10:44:39 +0100 >> Martin Dev <mrturtledev@gmail.com> wrote: >> >>> I work for system verification of SSDs and we've recently come up >>> against an issue with BTRFS on Ubuntu 16.04 >> >>> This seems to be a recent change >> >> ...well, a change in what? >> >> If you really didn't change anything on your machines and the used process, >> there is no reason for anything to start breaking, other than obvious hardware >> issues from age/etc (likely not what's happening here). >> >> So you most likely did change something yourself, and perhaps the change was >> upgrading OS version, kernel version(!!!), or versions of software in general. >> >> As such, the first suggestion would be go through the recent software updates >> history, maybe even restore an OS image you used three months ago (if >> available) and confirm that the problem doesn't occur there. After that it's a >> process called bisecting, there are tools for that, but likely you don't even >> need those yet, just carefully note when you got which upgrades, paying >> highest attention to the kernel version, and note at which point the >> corruptions start to occur. > > > There have been various trim bugs, in Btrfs but also in the block > layer. And I don't remember all the different versions involved. I'd > like to think 4.4.24 should behave the same as 4.8.1, so I would > retest with those two, using something without ubuntu specific > backports (i.e. something as close to the kernel.org trees of those > versions as possible). I have no idea what Ubuntu generic 4.4.0-21 > translates into. Because of the 0, it makes me think it's literally > 4.4.0 with 21 sets of various backports, from some unknown time frame > without going and looking it up. If that's really 4.4.21, then it's > weirdly named, I don't know why any distro would do that. > > In any case I would compare 4.8.1 and 4.4.24 because those two should > work and if not it's a bug that needs to get fixed. Independently, > check the SSD firmware. There have been bugs there also. > > -- > Chris Murphy ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: csum failed during copy/compare 2016-10-19 14:39 ` Martin Dev @ 2016-10-21 13:19 ` Martin Dev 2016-10-21 16:19 ` Chris Murphy 0 siblings, 1 reply; 8+ messages in thread From: Martin Dev @ 2016-10-21 13:19 UTC (permalink / raw) To: Chris Murphy; +Cc: Roman Mamedov, Btrfs BTRFS SATA trace shows device behaving correctly. btrfs repair --ignore-errors /dev/sda2 /tmp/ will yield files that are not verifiable by FIO, and differ from the original files on the internal drive that they were copied from at the failing offset. On Wed, Oct 19, 2016 at 3:39 PM, Martin Dev <mrturtledev@gmail.com> wrote: > Fails on Antergos Linux 4.8.2-1-ARCH #1 SMP PREEMPT Mon Oct 17 > 08:11:46 CEST 2016 x86_64 GNU/Linux > > btrfs-progs v4.8.1 > > On Mon, Oct 10, 2016 at 10:05 PM, Chris Murphy <lists@colorremedies.com> wrote: >> On Mon, Oct 10, 2016 at 12:42 PM, Roman Mamedov <rm@romanrm.net> wrote: >>> On Mon, 10 Oct 2016 10:44:39 +0100 >>> Martin Dev <mrturtledev@gmail.com> wrote: >>> >>>> I work for system verification of SSDs and we've recently come up >>>> against an issue with BTRFS on Ubuntu 16.04 >>> >>>> This seems to be a recent change >>> >>> ...well, a change in what? >>> >>> If you really didn't change anything on your machines and the used process, >>> there is no reason for anything to start breaking, other than obvious hardware >>> issues from age/etc (likely not what's happening here). >>> >>> So you most likely did change something yourself, and perhaps the change was >>> upgrading OS version, kernel version(!!!), or versions of software in general. >>> >>> As such, the first suggestion would be go through the recent software updates >>> history, maybe even restore an OS image you used three months ago (if >>> available) and confirm that the problem doesn't occur there. After that it's a >>> process called bisecting, there are tools for that, but likely you don't even >>> need those yet, just carefully note when you got which upgrades, paying >>> highest attention to the kernel version, and note at which point the >>> corruptions start to occur. >> >> >> There have been various trim bugs, in Btrfs but also in the block >> layer. And I don't remember all the different versions involved. I'd >> like to think 4.4.24 should behave the same as 4.8.1, so I would >> retest with those two, using something without ubuntu specific >> backports (i.e. something as close to the kernel.org trees of those >> versions as possible). I have no idea what Ubuntu generic 4.4.0-21 >> translates into. Because of the 0, it makes me think it's literally >> 4.4.0 with 21 sets of various backports, from some unknown time frame >> without going and looking it up. If that's really 4.4.21, then it's >> weirdly named, I don't know why any distro would do that. >> >> In any case I would compare 4.8.1 and 4.4.24 because those two should >> work and if not it's a bug that needs to get fixed. Independently, >> check the SSD firmware. There have been bugs there also. >> >> -- >> Chris Murphy ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: csum failed during copy/compare 2016-10-21 13:19 ` Martin Dev @ 2016-10-21 16:19 ` Chris Murphy 0 siblings, 0 replies; 8+ messages in thread From: Chris Murphy @ 2016-10-21 16:19 UTC (permalink / raw) To: Martin Dev; +Cc: Chris Murphy, Roman Mamedov, Btrfs BTRFS On Fri, Oct 21, 2016 at 7:19 AM, Martin Dev <mrturtledev@gmail.com> wrote: > SATA trace shows device behaving correctly. > btrfs repair --ignore-errors /dev/sda2 /tmp/ will yield files that are > not verifiable by FIO, and differ from the original files on the > internal drive that they were copied from at the failing offset. Did you try without discard mount option? And did you get different results? I'm not following 'btrfs repair --ignore-errors /dev/sda2 /tmp/' at all. Is this actually restore? I'm not an expert in this particular area of finding problems as they're being written - but it sounds like that's what's going on in your case - since kernel messages are currently not revealing at all, all I can think of is to build a kernel.org kernel, I think for what you're doing it's fine to use 4.4.26 but it might get more traction to use 4.9.rc1 just because that's what's currently being worked on and likely where any fix would have to go first before it got backported. If it's a bug. And I'd build with these: CONFIG_BTRFS_FS_CHECK_INTEGRITY=y CONFIG_BTRFS_DEBUG=y The first does nothing unless you use one of two possible mount options check_int and check_int_data. https://btrfs.wiki.kernel.org/index.php/Mount_options I don't have any advice on how to test. Maybe leave out the check integrity mount options for the first round and see if you can still trigger the problem, since there are already two major changes: a.) it's a kernel.org kernel and b.) it has debug enabled. If you can trigger the problem but it's still not revealing then test with check_int which has less performance impact than check_int_data. It looks like what you're getting is a metadata inconsistency but I'm not certain. -- Chris Murphy ^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2016-10-21 16:19 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <CAG6KGPS8Gvy2zGCe22mMmk4uXrqVyRP8FHayhe0ph-8vC+kA4A@mail.gmail.com>
2016-10-10 9:44 ` Fwd: csum failed during copy/compare Martin Dev
2016-10-10 12:02 ` Martin Dev
2016-10-10 13:56 ` Martin Dev
2016-10-10 18:42 ` Roman Mamedov
2016-10-10 21:05 ` Chris Murphy
2016-10-19 14:39 ` Martin Dev
2016-10-21 13:19 ` Martin Dev
2016-10-21 16:19 ` Chris Murphy
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).